 Pelham was ordained by Charles James Blomfield, at that time Bishop of London, in 1834 and assumed the post as deacon of Eastergate, befriending Henry Edward Manning.In 1837, he was appointed rector at Bergh Apton until 1852, when he was transferred as curate to Christ Church, Hampstead.After three years, he became rector of Marylebone and in 1857 on the resignation of Samuel Hinds, he was consecrated the 64th Bishop of Norwich.