 Bailly adopted the two daughters from this marriage, Agatha born in 1797 and Therese, born in 1803.Five more children were born of this second marriage, who were Esther in 1811, Rose in 1813, Eleanor in 1815, Robert in 1817 and Hortense in 1819.Joseph's marriage to Angelique McGulpin, born circa 1790 at Mackinac, is usually considered to be his first marriage.