 At Duquesne, Kemp was coached by Elmer Layden, a former member of Notre Dame's Four Horsemen (and later the commissioner of the NFL).Kemp became a starter for the Dukes during his sophomore year and by the end of his senior season, he received an honorable mention on some All-American lists.After graduation, Future Pirates owner, Art Rooney told Kemp that he would like for him to play for his "J.P. Rooney semi-pro team".