 Smith's political career began in 1889 when he was elected attorney for Chippewa County, Minnesota.He served only one term but was later elected Lieutenant Governor under Republican John Lind in 1899 and re-elected under his successor Samuel Van Sant in 1901.He returned to the position of Chippewa County attorney from 1903 to 1909 when he was appointed as assistant state Attorney General.