 Born in Greenock, Scotland, Nelson moved to Northern Ireland as a child where his father was employed as a ship builder.He started his football career there with junior sides St Paul's and Glenarm, before turning senior with Crusaders.Nelson moved to Wales in 1921 when signed by Cardiff City and stayed with the "Bluebirds" for nine seasons.