 Freeman was born April 22, 1759  to Lois Cobb and Constant Freeman in Charlestown, Massachusetts, just outside Boston.His father was a sea captain turned merchant.James received his secondary education at the Boston Latin Grammar School, where he studied under the well-known schoolmaster, John Lovell.