 William de Enysford's family continued to hold Eynsford Castle on behalf of the archbishop until 1261, through six descendants, all named William and therefore distinguished for convenience as William de Eynsford II through to VII by historians.Around 1130, a new hall was built in the castle, superseding the older, by now abandoned Anglo-Saxon buildings, and the defences were strengthened with a new gate house and by raising the height of the curtain wall.William I retired to become a monk in the 1130s, and his son William II had passed control of the castle to William III by the late 1140s.