 Milović started out at his hometown club Javor Ivanjica, aged 7.He went through all youth ranks, before being promoted to the senior squad in 1999.Over the course of the next four seasons, Milović established himself as a regular member of the team, before transferring to Partizan in June 2003.