 From 1981-1985, he was the head freshman coach and in 1986 he served as the offensive coordinator.Spencer moved to Wesleyan University where he was the head coach for five years (1987-1991).With a 6-2 record in 1990, he finished with an overall record of 14-26.From 1989-1990, Spencer coached the Cleveland Browns and New York Jets former head coach Eric Mangini.