 The trees along the banks of the bay were logged first, and then oxen and horses were used to bring more distant logs to the mill.The mill was leased in 1858 to the Amos & Phinney Company, of which A. Phinney became the resident manager.The U.S. Federal Census of 1860 designated Port Ludlow as one of the three enumeration districts in Jefferson County, Washington Territory.