 James Monroe constructed and resided at Oak Hill near Aldie after his presidency.American Civil War Brigadier General Robert H. Chilton (Chief of Staff under Robert E. Lee) was a native of Loudoun County.World War II general George C. Marshall resided at Dodona Manor in Leesburg.