 Hays, who was born in Walden in 1840, served in the 124th New York Volunteer Infantry Regiment, a locally raised unit known as the "Orange Blossoms", during the Civil War.He saw action in many important battles of the conflict, including Chancellorsville, Fredericksburg and Gettysburg.After being wounded, he was honorably discharged as a lieutenant and returned home.