 He began the deformalisation of the gardens between the river and the house and produced the (broad-lands) "gentle descent to the river".On 11 May 1738 at St Antholin, Budge Row, he married again, to Isabella Fryer, widow of Sir John Fryer, 1st Baronet, and daughter of Sir Francis Gerard, 4th Baronet.Palmerston died aged 84 on 10 June 1757.