The earliest reference I can find to the phrase in print is in The Ohio Repository, May 1837: "One man, in Franklin County has lately realized thirty thousand dollars, in a speculation on slaves, which ho bought in Virginia, and sold down the river.