 He was particularly passionate about supporting educational endeavors, and donated a public library (the Baxter Memorial Library) to his birthplace, Gorham, and a library to his adopted city, Portland.He was mayor of Portland for six years, and the moving spirit behind Baxter Boulevard, a tree-lined road that circles the edge of Back Cove, which is often used for exercise and recreation.He was also recognized as an authority on New England history, and among his other interests, he was president of the Maine Historical Society for thirty years and an overseer of Bowdoin College, and connected with many other organizations that furthered the interests of New England history.