 On October 1, 1872, Merrill was married to Florence A. Whittemore, a daughter of George W. and Synia H. Whittemore.Before her death on December 18, 1875, they were the parents of one daughter, Elinor Merrill.After the death of his first wife, he married Carrie A. Beebe on April 5, 1877.