MyBB Community Forums

Full Version: robots
You're currently viewing a stripped down version of our content. View the full version with proper formatting.
hi how to exclude robots to indexing of archives it is something like this in the robots.txt

example:

User-agent: *
Disallow: /cgi-bin/
Disallow: /tmp/
Disallow: /~Milos/
User-agent: *
Disallow: /archive/
(2012-04-21, 08:38 PM)Nathan Malcolm Wrote: [ -> ]
User-agent: *
Disallow: /archive/

Thanks