 In 1944, the house was purchased by Mrs. Louise Graves and restored.It was the last house along Rainbow Row to be restored following many years of vacancy.In 1778, a former building was destroyed in a fire and was replaced by Scottish merchant James Gordon after he bought the land in 1792.