 In 1830, he was elected President pro tempore of the State Senate and was Acting Lieutenant Governor until the end of the year.Elected as a Democrat to the 27th United States Congress, Oliver was United States Representative holding office from March 4, 1841, to March 3, 1843.Afterwards he became clerk of the New York Supreme Court, and was President of the Yates County Bank from the issuance of its charter until 1857.