 Barker was an extended relation of Benjamin Franklin through his mother, who was a cousin of Franklin's mother, Abiah Folger Franklin (1667–1752), and grandfather Peter Folger.He went to New York at the age of 16, engaged in trade, and soon amassed a considerable fortune.In May 1811, he hired Connecticut native Fitz-Greene Halleck, who remained in his employ for twenty years.