 The 2003–04 season proved to be Milne's final year with the club, scoring eight goals in 20 league appearances as Dundee were denied a top six place on goal difference.In April 2004, with Dundee trying to come out of administration, Milne was one of five players offered a new contract on "significantly reduced terms".A month later, Milne rejected Dundee and other SPL clubs to join Plymouth Argyle.