 Soon after his conversion, Milne decided to leave the Church of Scotland, and to join "another body of Christians" which was evangelical and with edifying preaching.As a result, in 1804, Mine was received as a member of a Congregational church pastored by George Cowie at Huntly.About 1809, he applied to the London Missionary Society.