 Ayer was prominent in civic affairs, raising funds and materials for the American Civil War effort, and serving on various town committees.He served for two years on the board of selectmen, and served one term in the state legislature.Ayer's brother Albert, also prominent in local affairs, lived in a house that was originally adjacent to this one on Brooks Street, but has since been separated from it by infill construction.