 Olson played quarterback for Thousand Oaks High School for four years.For three of those years, he played on the varsity team, alongside David Anderson.Olson was considered the top quarterback prospect and even top high school football recruit in the country following a highly productive senior year in which he threw for 2,989 yards and 32 touchdowns, earning high school All-American honors in 2001.