 In June 2004, Matlock Town's manager Ernie Moss moved to Hucknall Town and he swiftly returned to his former club to sign Taylor and also his brother Joe who had been with Worksop Town.On 31 March 2005 he joined Halifax Town until the end of the season but did not make an appearance for the club.In August 2005 he joined Guiseley on trial, eventually joining the club permanently for the season.