 He was inducted into the United States Olympic Hall of Fame.Hayes attended Matthew Gilbert High School in Jacksonville, where he was a backup halfback on the football team.The 1958 Gilbert High Panthers finished 12–0, winning the Florida High School Athletic Association black school state championship with a 14–7 victory over Dillard High School of Fort Lauderdale before more than 11,000 spectators.