 Brown's personal religion is fairly well documented in the papers of the Reverend Clarence Gee, a Brown family expert, now held in the Hudson [Ohio] Library and Historical Society.Brown's father had as an apprentice Jesse R. Grant, father of Ulysses S. Grant.At 16, Brown left his family and went to Plainfield, Massachusetts, where he enrolled in a preparatory program.