What is the difference between a robots.txt file and a sitemap?
FM
1 Answers 0 Views
Sitemap: A Sitemap is an XML file which lists all the URLs or webpages of your websites. The purpose of a Sitemap is to indicate the search engines of all the webpages that it should crawl on your website.
Robots.txt: A robots.txt file is created to signify the search engines which pages to crawl and which pages to omit.
Answered Date 10-May-17 by Mark J Stalling
Login to comment