 He died in 1820.With Priscilla Bertie he had lived at Langley Park, Beckenham and had 3 sons and a daughter.He was succeeded in his titles by his eldest son Peter Robert Drummond-Burrell, 2nd Baron Gwydyr, 22nd Baron Willoughby de Eresby.