Robots.txt is really a file that exists on the foundation Listing of each Site and can be employed to instruct engines like google on which directories/files of the website they could crawl and include things like in their index. What's the goal of SEO? The purpose of Search engine optimisation https://technik.forum