 He succeeded his father in the baronetcy on 8 August 1706.Kaye was elected Member of Parliament (MP) for Yorkshire at the 1710 general election and was returned there unopposed in 1713.He was returned unopposed for Yorkshire again at the 1715 and 1722 general elections.