 Kitereza began schooling at Kagunguli Mission in 1905.There he was baptized and given the Christian name of Aniceti.Two years later, in 1907, King Mukaka died and was succeeded by his son Ruhumbika who encouraged Kitereza to leave Kagunguli in 1909 to pursue further schooling at the Rubya Roman Catholic Seminary in today's Kagera Region near the Ugandan border.