 Banfield was born in Poplar, London.He began his football career as a centre half with Crystal Palace, with whom he won the 1978 FA Youth Cup in a 1–0 victory over Aston Vila.When he left Palace in 1981, he had a spell with Australian side Adelaide City.