It later became the home of Annie Palmer when she married into the family; it is Annie who has given the house its fame and reputation.
The house is famous because of Annie Palmer, who married into the family.