 His league debut came on 10 March 2007 when he replaced Lee Thorpe as a late substitute in the 3–0 win at home to Wycombe Wanderers.However, this was his only appearance for Torquay before being recalled by Sheffield United on 24 April 2007, with Torquay already relegated to the Conference National.Oliver joined Halifax Town on a month's loan in October 2007, playing two games for The Shaymen.