 In 1860, Rossiter married Mary (Mollie) Sterling and moved his family to Cold Spring, New York on the Hudson River.He designed a house, Fair Lawn, overlooking the Hudson River.It is listed on the National Register of Historic Places.