 His personal library, containing over 100 leather-bound books of maps, portraits, engravings and personal letters, is available for reference at the Portland Public Library.James Phinney Baxter was the son of Dr. Elihu Baxter and Sarah Cone Baxter.He was born in Gorham, Maine (in what is now called the Baxter House), on March 23, 1831, but lived in Portland from 1840.