 Nineteenth and early-twentieth century historians claimed that around 1540, French fur traders built a stone "castle" or fortified trading post on Castle Island in the location where Fort Nassau was later built.However, modern scholars have found no evidence to support this claim.Fort Nassau was the first Dutch settlement in North America.