 Isaac, Jr, attended College of William & Mary and served in the Continental Army during the American Revolutionary War.Upon their marriage in 1783, Isaac, Sr, gave his son and daughter-in-law – Nelly Conway Madison, sister of the future President – the Belle Grove house and grounds.In 1794, construction began on the new mansion, which was completed in three years.