 In 1819, he married Eunice Masters.He was a member of the New York State Senate from 1826 to 1829, sitting in the 49th, 50th, 51st and 52nd New York State Legislatures.When Governor Van Buren resigned to become Secretary of State in March 1829, and Lieutenant Governor Enos T. Throop succeeded to the governorship, Stebbins was elected President pro tempore of the State Senate and was Acting Lieutenant Governor of New York until the end of 1829.