 The building was added to the National Register of Historic Places in 1975, and included in the Newburyport Historic District in 1984.Brown Square is a narrow rectangular park at the northern end of a city block on the west side of Newburyport's downtown, bounded by Titcomb, Pleasant, and Green Streets on the west, north, and south, and by Brown Square on the south.The Brown Square House occupies the western end of the block facing the park to the north.