 Later that year Goe was appointed curate at Kingston upon Hull.He was rector of Sunderland from 1873 to 1877 and St George's, Bloomsbury, London, from 1877 to 1887.Goe had shown ability as a parish worker, preacher and organiser and in 1886 he was appointed the Bishop of Melbourne in succession to James Moorhouse.