 Gunter was born in Oglethorpe County, Georgia.As a child, he was in a gospel group with his brothers and cousins called the Gunter Brothers Quartet.In the early 1950s, he played in various blues groups around Nashville, Tennessee, and began recording for Excello Records in 1954.