 Doyle is located in northeastern Barron County, along the border with Rusk County.The western end of the Blue Hills occupies the southern half of the town, with the highest point rising to , or about higher than the surrounding countryside.According to the United States Census Bureau, the town has a total area of , all of it land.