 Potter was established near a Native American village along the Manitowoc River.It was originally named Muskratville because of the large number of muskrats that lived in the river and were trapped for their fur.American Civil War Captain Orin R. Potter settled in Potter in 1859 and established a feed mill.