 Born in Zlatitsa, Ivanov was inspired to become a footballer after watching the Bulgaria national football team's performance during their 1994 FIFA World Cup campaign.He made his debut with Pirin 1922, before moving to CSKA Sofia in 2005.With CSKA, he was a Bulgarian Cup winner in 2006 and Bulgarian Supercup winner in the same year.