 On 22 August 2006, Brown had his first involvement with the first-team squad at as an unused substitute, at the age of just 16, in the 4–3 penalty shoot-out victory over Swindon Town, after the game had ended 2–2 in normal time, in the First Round of the 2006–07 League Cup.At the end of the 2007–08 season he signed his first professional contract with the League Two club.Brown was loaned to Southern League First Division South & West club Windsor & Eton to gain first team experience, making 25 appearances for the club.