 His second wife was Sarah Mapps Douglass, who survived him by two decades.Between his two marriages, Douglass produced nine children.His passion for education influenced his eldest daughters Sarah, Elizabeth, Mary, Caroline to acquire trades.