 Matthew was born in Fall River, Massachusetts on July 18, 1842.He was the son of prominent local businessman Richard Borden and Abby Durfee Borden.In 1860, he graduated from Phillips Academy in Andover.