 Key was taken into the nearby Benjamin Ogle Tayloe House and died moments later.Key's spirit, eyewitnesses and authors claim, now haunts Lafayette Square and can be seen on dark nights near the spot where he was shot.Decatur House (748 Jackson Place NW) is allegedly haunted by the ghost of Stephen Decatur.