Hi,
how can i block a particular forum let say a support forum from getting cached by google or any other bot.
Just need to block a particular forum.
I have a similar question. I would like to block my entire forum. I've edited robot.txt but not sure if this is the right way.
you are at your right way.
robot.txt is the priority step to block entire forum.
Provided it is filled correctly
only the bots that follow the robots.txt will do so, they don't have to follow that file at all. so honest bots will follow it, but others will not
if you want to block a particular forum, just make it for registered users only, no guests.
you can put the robots into a group and deny that group access to the forum, but some bad bots will spoof user-agents and wont fall into the bot group.
Thanks sir,
You actually sorted out the whole issue.
Thanks again.