 After his death, the estate was given to his daughter, Sarah and her husband, Col. William Lyles.The estate was originally called Battersea, but came to be called Harmony Hall some time after 1792, when it was rented to brothers John and Walter Dulaney Addison and their wives.The name "Harmony Hall" commemorates the two couples' harmonious coexistence.