MyBB Community Forums

Full Version: robots.txt Question
You're currently viewing a stripped down version of our content. View the full version with proper formatting.
What is the recommended content to have in a robots.txt file when running a mybb forum. I like a staff member to answer this please, but feel free to leave your comments.
What ever you want it. There is no 'recommended' content for it.

I have mine as this:

User-agent: *
Disallow: /*action=emailuser*
Disallow: /ratethread.php
Disallow: /moderation.php
Disallow: /usercp2.php
Disallow: /*year=*
Disallow: /newreply.php
Disallow: /sendthread.php
Disallow:/editpost.php
Disallow: /memberlist.php
Disallow: /archive/
Disallow:/online.php
Disallow: /showteam.php
Disallow: /printthread.php
Disallow:/*action=nextoldest*
Disallow: /*order=*
Disallow: /private.php
Disallow: /report.php
Disallow: /search.php
Disallow: /misc.php
Disallow: /modcp.php
Disallow: /captcha.php
Disallow: /newthread.php
Disallow: /*datecut=*
Disallow: /contact.php
Disallow: /*mode=*
Disallow: /*action=nextnewest*
Allow: /
Disallow: /*action=weekview*
Disallow: /404.php
Disallow: /stats.php
Disallow: /calendar.php
Disallow: /*sort=*
Disallow: /usercp.php
Disallow: /task.php

It's about what content you want and don't want in search engines.