 In 1805, Manigault sold part of his South Carolina land, and moved permanently to Clifton, an estate near Philadelphia, Pennsylvania.In 1785, Manigault was married to Margaret Izard (1768–1824), the daughter of Alice (née DeLancey) Izard and Ralph Izard, a member of the Continental Congress and a United States Senator from South Carolina from 1789 to 1805.After her father's death in 1804, her mother lived in Philadelphia.