 Duffield was born on 20 May 1952, the son of Jack and Irene Duffield.He was educated at St Albans School, a then all-boys independent school in Hertfordshire.He graduated from Newcastle University in 1973 with a Bachelor of Arts (BA Hons).