 He married his first wife, Dinah Tarleton, in 1793 and they had eight children.Following her death in 1830, he married Elizabeth Butt, 36 years his junior, in 1832, and they had two more daughters.It was said of him that "though corpulent, his manners were elegant and easy."