 After leaving Congress, Bailey was the United States consul to Hamburg, Germany, by appointment of President James Garfield, and served in that capacity from 1881 to 1885.He served as a delegate to the Republican National Convention in 1888 and was appointed by President Benjamin Harrison as surveyor of customs at Albany, New York from 1889 to 1894.He resumed the practice of law.