 Known as the Colonel Henry Smith House, it stood until the early 1920s, when it was razed to allow for construction of an annex for the Rhode Island State House.Elected to the Rhode Island Senate in 1803, he was the leader of the senate or "first senator" when Governor Arthur Fenner died.Lieutenant Governor Paul Mumford had died before Fenner, so as first senator Smith succeeded to the governorship.