 On 9 March 1991, Byabazaire succeeded as diocesan bishop, following the resignation of Bishop Albert Edward Baharagate.Bishop Byabazaire died in office on 8 February 2014, at the age of 72 years and four months.He is buried at "Bujumbura Cathedral", in the city of Hoima, the seat of Hoima Catholic Diocese.