 In Colonial times the Hill was referred to as Holt Hill but was changed in the late 19th century to Prospect Hill, but reverted to its original name in the early 20th century..6ed.The first Holt in Andover was Nicholas Holt (1), an early officer of the town, who was a tanner who also ran the ferry across the Shawsheen River.Nicholas Holt's (1) grandson Timothy Holt (3) built his house on the land granted to his father James Holt (2) who was granted the original 100 acres from his father, Nicholas (1).