User-Agent Mozilla/50 (compatible  Yandex) string identifies Yandex robots Robots can send GET (for example  YandexBot/30) and HEAD (YandexWebmaster/20) requests to a server A reverse DNS lookup can be used to check the authenticity of Yandex robots