 Wormley died on October 18, 1884.He was interred at Columbian Harmony Cemetery in Washington, D.C.In the 1890s, following James Wormley's death, his son, James T. Wormley took over management of the hotel.