 Yarbrough started his sports career at Morgan State University, where he became an offensive tackle for the college football team before joining the college wrestling team.He was given the nickname "Tiny" due to his large size.He achieved NCAA All-American Division II wrestler status in 1983 and 1985, later ascending to Division I in 1986, while in football he was a Division I in 1982 and 1983.