 He then spent three terms as Bishop’s Executive Officer (which position was latterly combined with that of diocesan secretary) under Bishop Njongonkulu Ndungane, in 1992-4, 1994-6 and (under Bishop Itumeleng Baldwin Moseki) in 1996-2000.Concurrently he served as the rector of St Augustine's Kimberley with St Alban's, then St Martin's, Douglas and then of St Barnabas, Kimberley, serving as the Acting Archdeacon of Kimberley.In 1994-6 Swartz was Sub-Dean at St Cyprian's Cathedral in Kimberley.