 Williams started off in amateur football with Clifton Athletic before joining Bristol Rovers in 1975.Unusually, he began with the League club as an amateur, combining playing League football with studying on a teacher training course, and later with teaching at Mostyn High School in Cardiff.After already making 113 League appearances, he finally turned fully professional in 1978.