 He married secondly Lady Margaret Ogilvy, daughter of the statesman James Ogilvy, 4th Earl of Findlater and 1st Earl of Seafield.His final address in Edinburgh is given as Parliament Close.He died in March 1773, aged 66, and was succeeded by his son from his second marriage, James Grant.