 He played in local Texas bands and attended Wiley College, where he majored in music.After serving in the Air Force from 1952–56, he toured Europe with Lionel Hampton, and upon his return took a master's degree at the Manhattan School of Music.Williams played with Charles Mingus at the Newport Jazz Festival in 1959, and recorded with Mingus starting in that year.