 ).This text file contains the instructions in a specific format (see examples below).Robots that "choose" to follow the instructions try to fetch this file and read the instructions before fetching any other file from the website.