 He was ordained as the first auxiliary bishop of Milwaukee on September 4, 1911.On August 6, 1913, Pope Pius X appointed Koudelka the second bishop of the Diocese of Superior.He was installed at the pro-cathedral of Sacred Heart in Superior, Wisconsin by Archbishop Sebastian Messmer of Milwaukee.