 Born in Oklahoma, Gilbert graduated from Bakersfield High School in Bakersfield, California in 1950.He went to Bakersfield College for a year and played on the football team before serving in the United States Air Force for the Korean War.He returned to Bakersfield College, then transferred to San Jose State University in 1956 and lettered in football for two years with the San Jose State Spartans.