 Born in the village of Wouldham in Kent, Fletcher began his career with the local team before joining Chatham Town of the Kent League.He subsequently played for other Kent-based non-league clubs Faversham Town and Maidstone United, where he was a leading goalscorer in the Corinthian League and was twice chosen to play for the England national amateur team.In 1957 he turned professional with Gillingham of the Football League Third Division South and made his debut in the first game of the 1957–58 season, partnering Ron Saunders in attack.