 Charlton accepted an athletic scholarship to attend the University of Florida in Gainesville, Florida, and played linebacker for coach Galen Hall's Florida Gators football team from 1984 to 1987.He was a member of the Gators' best-in-the-Southeastern Conference (SEC) football teams that posted identical 9–1–1 overall win-loss records in 1984 and 1985.He was also a first-team All-SEC selection in 1986 and 1987, and a first-team All-American and team captain in 1987.