 Neighboring towns and cities are Ferrisburgh to the north, Vergennes to the northeast, Waltham to the east, and Addison to the south.Bordering across Lake Champlain, which is approximately wide in this area, is the town of Westport, New York.According to the United States Census Bureau, Panton has a total area of , of which is land and , or 29.70%, is water.