 Elijah Hall built the first house in Caledonia County in Barnet, near the base of Stevens Falls.Colonel Alexander Harvey came from Dundee, Scotland, for those in the town who wished to find new land in the American colonies.Despite losing contact with almost all of them after the American Revolution broke out, he decided to stay, claiming of land and a lake, now known as Harvey's Lake.