 He matriculated at Christ Church, Oxford on 2 March 1686, aged 15.He succeeded his father in the baronetcy on 8 August 1706.Kaye was elected Member of Parliament (MP) for Yorkshire at the 1710 general election and was returned there unopposed in 1713.