Hi All,
I have a test forum, and I do not want it to be indexed by search engine spiders. Can I stop this?
-GBD
Put this in a robots.txt file in the root folder:
User-agent: *
Disallow: /
If the file does not exist, Do I create it?
Yep. By default it doesn't exist, you create it if you want to control what search engines can access.
Thanks. Does this work for general websites, or only forums?