 He was the fourth of the eight children of Owen Brown (1771–1856) and Ruth Mills (1772–1808) and grandson of Capt.John Brown (1728–1776).Brown could trace his ancestry back to 17th-century English Puritans.