 His second wife, married at St Giles in the Fields, Middlesex, on 14 December 1626, was Elizabeth widow of Sir John Ashburnham and daughter of Sir Thomas Beaumont of Stoughton, Leicestershire.She was the first Duke of Buckingham's maternal second cousin once removed.Richardson had twelve children by his first wife, of whom four daughters and one son, Thomas, survived him.