indeed it is said by our lore-masters that they have from of old this affinity with us that they are come from those same three houses of men as were the numenoreans in their beginning not from hador the goldenhaired , the elf-friend , maybe , yet from such of his sons and people as went not over sea into the west , refusing the call .