 Ivanović made his first football steps with FK Srem in 2002, following in his father's footsteps.Here, he made his professional debut and his performances began to attract attention from Serbia's First League clubs.In December 2003, Ivanović joined OFK Beograd, in what was then the First League of Serbia and Montenegro.