 At age 29, he began a two-year stint as the head coach at Austin Peay State University.The Governors had a record of 14–8 under Brown.In 1981, Brown returned to Vanderbilt to become the school's offensive coordinator.