 Pitt made his debut for Luton Town on the opening day of the 2003–04 season in a 3–1 home victory over Rushden & Diamonds and he went on to feature in a further five matches for the Hatters, netting his first – and only – goal for the club with a free-kick in a 4–1 home win over Yeovil Town in the League Cup first round.He helped the side to a 2–1 win at Stockport County and a 3–2 home win over Hartlepool United, but, unfortunately, he sustained an Achilles tendon injury and it meant he would be forced to miss two weeks of action.Manager Mike Newell therefore decided it would be silly to extend his loan spell, and he returned to his club, Portsmouth.