 SR 104 forms the southern edge of the CDP and leads east across Hood Canal to Port Gamble and west the same distance to U.S. Route 101.According to the United States Census Bureau, the Port Ludlow CDP has a total area of , of which , or 18.28%, are water.As of the census of 2000, there were 1,968 people, 954 households, and 742 families residing in the CDP.