 When Olsen ran for a sixth term in 1970, he was narrowly defeated for re-election by Richard G. Shoup, the Mayor of Missoula.He ran against Shoup again in 1972, but ultimately lost to him.In 1974, he ran for Congress one final time, but lost in the Democratic primary to Max Baucus, who ended up defeating Shoup in the general election.