 He was appointed secretary of the Commonwealth on January 18, 1887, and served until his resignation to accept nomination for Congress.Stone was elected as a Republican to the Fifty-first Congress to fill the vacancy caused by the death of Lewis F. Watson.He was reelected to the Fifty-second and to the three succeeding Congresses.