 It remained in the Cocke family for several generations and was the birthplace of General John Hartwell Cocke who later became associated with Bremo in Fluvanna County.In the mid-1900s, the plantation was purchased by state Sen. Garland Gray, who used it as a summer home until the manor house was destroyed by fire.Later, Gray, who was one of the wealthiest men in Virginia and owned tens of thousands of acres of land bet the Swann's Point property on game of cards and lost.