 Oliver was born in Derby and joined Sheffield United as a trainee.He was released by Derby County when he was a youngster prior to signing with Sheffield United.Whilst at United he was in need of first team experience and was loaned, first to Hednesford Town in January 2007 and then to Torquay United on 1 March 2007.