 The Charles H. Spencer House was built at the corner of 6th Avenue and Main Street in the late 1860s as a private residence.Charles H. Spencer was the founder of the First National Bank of Grinnell.There was one intermediate move before the building was moved to its present location.