 The second but first surviving son of Robert Shirley, 1st Earl Ferrers (by his first wife, Elizabeth Washington), he matriculated at Trinity College, Oxford in 1693.In 1697, he was commissioned an ensign in the Coldstream Guards.He left the regiment at some time after 1702.