 Jane Matilda Mary, daughter of Lieutenant-Colonel Arthur Francis Southwell and Mary Ann Agnes Dillon and sister of Thomas Southwell, 4th Viscount Southwell.By his second wife, he had four sons and six daughters.Conservative politician Amber Rudd is his great-great-granddaughter.