 Joseph Goodrich, the founder of Milton, settled in Milton in 1839; he built a log cabin, since demolished, and brought the 1837 cabin to the site.Goodrich was a Seventh-Day Baptist from the Burned-over district of western New York, and like most people of his faith, he was known for his anti-slavery sentiments.Goodrich built the Milton House in 1845, which became a popular stop for travelers due to its location at the intersection of the military road between Chicago and Madison and the road from Janesville to Fort Atkinson.