 Born in Ndola, Zambia, Gregory began his career as an apprentice with Ipswich Town, turning professional in February 1992.His brother David was also a professional footballer.He joined Chesterfield on loan in February 1994, making his league debut for the Spirerites, and joined Scunthorpe United on loan in March 1995, hitting 7 goals in 10 games.