 He was sworn of the Privy Council of Ireland on 20 April 1756, where he had inherited extensive lands.In 1760 he commissioned Sir William Chambers to design the classical Duddingston House.From 1761 to 1787, he was a Tory representative peer for Scotland.