 In his second season with Stabæk, the then-Norway U21 international attracted interest from English clubs Leeds United and Wimbledon.A transfer to Wimbledon seemed likely, but it fell through after Olsen was tackled by Heiðar Helguson in a league match and sustained a broken tibia and fibula.In Stabæk's return season to the Tippeliga in 2006, Olsen was one of the most important player for his team, and was linked to one of the favourites to win the league, Brann from Bergen.