2015-07-20, 05:12 AM
Hi,
I am using this as robots.txt in my mybb installation.
task.php is also blocked using robots.txt as it is evident from above.
I am getting issues in google webmaster tools
that it is not not able to fetch ...../task.php even after I removed it from the robots.txt
kindly advise, since it is affecting more pages in GWT.
I am using this as robots.txt in my mybb installation.
User-Agent: *
Disallow: /captcha.php
Disallow: /editpost.php
Disallow: /modcp.php
Disallow: /moderation.php
Disallow: /newreply.php
Disallow: /newthread.php
Disallow: /online.php
Disallow: /printthread.php
Disallow: /private.php
Disallow: /ratethread.php
Disallow: /report.php
Disallow: /reputation.php
Disallow: /search.php
Disallow: /sendthread.php
Disallow: /task.php
Disallow: /usercp.php
Disallow: /usercp2.php
Disallow: /calendar.php
Disallow: /calendar.php
Disallow: /*action=emailuser*
Disallow: /*action=nextnewest*
Disallow: /*action=nextoldest*
Disallow: /*year=*
Disallow: /*action=weekview*
Disallow: /*action=nextnewest*
Disallow: /*action=nextoldest*
Disallow: /*sort=*
Disallow: /*order=*
Disallow: /*mode=*
Disallow: /*datecut=*
Disallow: /*action=nextoldest*
Disallow: /misc.php?action=help
Disallow: /memberlist.php
Disallow: /action=syndication
Disallow: /*action=profile*
Disallow: /showteam.php*
Disallow: /online.php*
Disallow: /stats.php*
Allow: /task.php is also blocked using robots.txt as it is evident from above.
I am getting issues in google webmaster tools
that it is not not able to fetch ...../task.php even after I removed it from the robots.txt
kindly advise, since it is affecting more pages in GWT.