 In August 1790, Kemp succeeded his theological instructor, Dr. Bowie and became rector of Great Choptank Parish, in Cambridge, Maryland, the county seat of Dorchester County.Rev.Kemp also served at Green Hill Church likewise on the Eastern Shore until 1813, when he was elected associate rector of St. Paul's Episcopal Church, Baltimore.