 Initially playing for the reserves at Walsall, he went on to score on his first team debut on 31 January 2004 in a 3–2 defeat away at Stoke City.He went on to make a further ten first-team appearances for the club that season and was retained upon the season's conclusion, signing a one-year deal.Walsall having been relegated in 2003–04, Taylor could still not break into the team in League One.