 He married in Rochester in 1796 Esther daughter of John Puget, a London banker, by his wife, Esther, daughter of James Dunn, MP for Dublin 1758–62.Esther's siblings included John Puget, of Pointer's Grove, near Totteridge, Hertfordshire, Director of the Bank of England, and Rear-Admiral Peter Puget, CB, who explored with Captain George Vancouver and after whom Puget Sound is named.The family lived at Bickley Hall, built for his uncle John Wells by Robert Mylne in 1780, and extended to a design by Sir Robert Smirke in 1810.