 The unincorporated community of Danbury is located within the town.Swiss is located in northern Burnett County along the St. Croix River, which forms the Wisconsin–Minnesota border.The Yellow River enters the town from the south and drops in just over a mile before joining the St. Croix River at Danbury.