 Clifford was born in Ballymacelligott, County Kerry, Ireland, on 25 January 1939.He was educated at Clogher National School and St Brendan's College, Killarney.Among his teachers at St. Brendan's was the late Bishop of Kerry, Diarmaid Ó Súilleabháin.