MyBB Community Forums

I checked google webmasters and saw that there are many crawl errors like these.



When i checked some of those threads like forums/thread-1685 they dont even exist, you get a page where it says- "
The specified thread does not exist." so why is it picking them up.

The sitemap which is there on google webmasters is for the main wordpress site for the "/forums" i have not added any sitemap.
Friendly URLs is enabled.

This is my robots.txt file

User-agent: *
Disallow: forums/private.php
Disallow: forums/calendar.php
Disallow: forums/online.php
Disallow: forums/contact.php
Disallow: forums/captcha.php
Disallow: forums/memberlist.php
Disallow: forums/showteam.php
Disallow: forums/printthread.php
Disallow: forums/search.php
Disallow: forums/modcp.php
Disallow: forums/reputation.php
Disallow: forums/task.php
Disallow: forums/usercp.php
Disallow: forums/ratethread.php
Disallow: forums/calendar.php
Disallow: forums/newreply.php
Disallow: forums/usercp2.php
Disallow: forums/newthread.php
Disallow: forums/misc.php
Disallow: forums/contact.php
Disallow: forums/editpost.php
Disallow: forums/sendthread.php
Disallow: forums/member.php
Disallow: forums/portal.php
Disallow: forums/*nextoldest*
Disallow: forums/*nextnewest*

Why are those errors displayed in google webmasters, whats wrong and how to get rid of them ?

anyone ?

If you had that folder in the past and now deleted it, it will cause 404 errors in webmaster tools. Placing a block with robots.txt won't make the errors go away, in fact they will stay there forever, because google cannot get access to the URLs to see if the return codes might have changed. You need to lift the robots.txt restriction so that google can firstly access those URLs, and secondly you need to make sure that those return code 410 or 301 to another location.