 He was loaned to Cowdenbeath for the 1998–99 season before making his Hearts debut the following year.In 2000, Craig Levein, previously his manager at Cowdenbeath, was appointed Hearts head coach and their familiarity coupled with Hearts' lack of transfer funds, ensured Milne was afforded more first team opportunities.However, Milne was unable to establish himself in the Tynecastle side's starting XI and he left for Partick Thistle in 2002.