 He was seized as a prisoner of war in January 1814, while visiting his post at Parc Aux Vaches (very near the site of today's campus of the University of Notre Dame), by United States militia.He was taken to Fort Detroit and held for two months, until March.Bailly was on Mackinac Island when it was invaded by US forces in July, and was deported with the other Canadian Loyalists to Drummond Island, Canada (now Chippewa County, Michigan), though the Battle of Mackinac Island ended in the retreat of American forces.