MyBB Community Forums

Full Version: Robots.txt question
You're currently viewing a stripped down version of our content. View the full version with proper formatting.
deleted
You don't need that wildcard email deny, those actions are sent from member.php. Just disallowing member.php would do the job.
Not for me, Google is full of indexed "/user-USERNAME" links coming from my forum ..i manually removed (via gwt), roboted but they come out every time! a real nightmare Angry
User-agent: *
Disallow: /captcha.php
Disallow: /editpost.php
Disallow: /misc.php
Disallow: /modcp.php
Disallow: /moderation.php
Disallow: /newreply.php
Disallow: /newthread.php
Disallow: /private.php
Disallow: /ratethread.php
Disallow: /report.php
Disallow: /search.php
Disallow: /sendthread.php
Disallow: /task.php
Disallow: /usercp.php
Disallow: /usercp2.php
Disallow: /calendar.php
Disallow: /*action=emailuser*
Disallow: /*action=nextnewest*
Disallow: /*action=nextoldest*
Disallow: /*year=*
Disallow: /*action=weekview*
Disallow: /*action=nextnewest*
Disallow: /*action=nextoldest*
Disallow: /*sort=*
Disallow: /*order=*
Disallow: /*mode=*
Disallow: /*datecut=*
Allow: /