 Bailey graduated from Brown University in 1807.Bailey worked as a tutor and librarian in Providence, Rhode Island from 1807 until 1814.Bailey was elected to the Massachusetts House of Representatives and served from 1814 to 1817; he served as a clerk in the Department of State in Washington, D.C. from 1817 until 1823.