The robots.txt file

The robots.txt file restricts access to your website by search engine robots that crawl websites.

Robots.txt files are used by website owners to stop search engines placing certain pages, or resources, in their index that they (the website owner) do not want to appear in results.


Does my site have a robots.txt file?

Yes. Our platform generates the robots.txt file automatically to exclude certain files of your website from search engines' indexes.

The robots.txt file for your site is located at

www.yourdomain.com/robots.txt

(substitute yourdomain.com for your website's actual domain name).


Can I change my robots.txt file?

No, the robots.txt file cannot be set individually for websites.

If you want to tell search engines not to list particular pages of your website please contact us for assistance.