 Carroll was born in Davis County, Iowa; he graduated from the Missouri State Normal School (now Truman State University) in 1884.He worked as a livestock dealer, teacher, and newspaper publisher.He was a member of the Iowa Senate (1895–98), postmaster of Bloomfield, Iowa (1898–1903), and Iowa state auditor (1903–09).