Family turns down millions for house next to Masters golf course