 Gregg played cricket for Gloucestershire up to under-16 level before deciding to concentrate on his football career.He played for Gloucester Primary Schools alongside future Torquay United teammate Wayne Thomas.He began his senior career as an apprentice with Torquay United, making his debut while still aged only 16 in the 1–1 draw with Wigan Athletic on 16 September 1995.