 He came to prominence when he joined Canvey Island in March 2003 along with Lee Boylan and Wayne Purser who were with him at Canvey Island, with whom he gained promotion to the Conference, and on a number of occasions proved to be a key player for them with his solid goalkeeping skills.After Canvey dropped out of the Conference, he was signed by Stevenage Borough by new manager Mark Stimson and promptly impressed in pre-season.As the 2006–07 season began, Potter was first choice, with previous first choice Alan Julian struggling with injury and Potter remained first choice until he was sent off against Crawley Town.