 In 1830, Dolley's son Payne Todd, who had never found a career, went to debtors' prison in Philadelphia and the Madisons sold land in Kentucky and mortgaged half of the Montpelier plantation to pay his debts.James died at Montpelier on June 28, 1836.Dolley remained at Montpelier for a year.