No spiders in forum <X> - Printable Version +- MyBB Community Forums (https://community.mybb.com) +-- Forum: Extensions (https://community.mybb.com/forum-201.html) +--- Forum: Plugins (https://community.mybb.com/forum-73.html) +---- Forum: Plugin Support (https://community.mybb.com/forum-72.html) +---- Thread: No spiders in forum <X> (/thread-115144.html) |
No spiders in forum <X> - xexes255 - 2012-03-17 I have a staff forum that is only visible to staff. Will spiders be reading, indexing, and archiving this particular forum for their search engines? If so, is there a plugin or modification I can make to prevent this? Sorry, I'm really not sure where this goes as I'm not sure what's available and what's not. RE: No spiders in forum <X> - Destroy666 - 2012-03-17 You can disallow page in robots.txt http://www.robotstxt.org/robotstxt.html RE: No spiders in forum <X> - linguist - 2012-03-17 You can exclude the groups "unregistered" or "bot" (if you have that) from forum access, that should be enough. |