 Lord Hopetoun married Lady Elizabeth Carnegie (d. 1793), daughter of George Carnegie, 6th Earl of Northesk, in 1766.They had five daughters.Lord Hopetoun survived Elizabeth by over twenty years and died in May 1816, aged 74.