MyBB Community Forums

Full Version: robots.txt file fails
You're currently viewing a stripped down version of our content. View the full version with proper formatting.
Hi,

today i found lots of spammed threads from a user id which i think is a robotic activity. I have already uploaded the robot.txt file on server but it fails to stop the robots, plz help me to find the solution...
I think you've misunderstood the function of the robots.txt file. In short, it prevents search engine bots from crawling your website and listing it in its search results. It won't prevent spam bots.

You'll need to install extra precautionary plugins to help reduce the threat of spammers. Here's a list of plugins you can consider using: http://community.mybb.com/thread-99893-p...#pid728686
(2011-08-29, 05:07 AM)Spencer Wrote: [ -> ]I think you've misunderstood the function of the robots.txt file. In short, it prevents search engine bots from crawling your website and listing it in its search results. It won't prevent spam bots.

You'll need to install extra precautionary plugins to help reduce the threat of spammers. Here's a list of plugins you can consider using: http://community.mybb.com/thread-99893-p...#pid728686

^This. And i would suggest three plugin out of the list.

1) Stop Forum Spam (with username option disabled, as it creates a lot of False Positives).
2) Re-Captcha.
3) Registration security questions.

I used to get minimum 20 spam posts per day. After i installed Recaptcha and Security questions, i rarely get any.