 Caldwell moved to New York and enrolled his two daughters, Mary Guendaline and Mary Elizabeth in the Academy of the Sacred Heart on 17th Street.Caldwell died in 1874.Under the terms of his will, he subsidized ten places in the Richmond home for poor individuals of Fredericksburg; He also stipulated that upon reaching the age of twenty-one, his daughters were to donate one-third of their substantial inheritance to establish a Catholic university.