2011-02-12, 02:57 AM
Hello Gentlemen
Ive recently taken over a pretty dead forum and Webmaster Tools are indicating that it 2500+ threads are not indexed due to Robots.txt settings.
Things just dont seem right so i wondered if someone would be kind enough to look at the Robots.txt file and offer opinions on if it iis suitable.
User-Agent: *
Disallow: /captcha.php
Disallow: /editpost.php
Disallow: /misc.php
Disallow: /modcp.php
Disallow: /moderation.php
Disallow: /newreply.php
Disallow: /newthread.php
Disallow: /online.php
Disallow: /printthread.php
Disallow: /private.php
Disallow: /ratethread.php
Disallow: /report.php
Disallow: /reputation.php
Disallow: /search.php
Disallow: /sendthread.php
Disallow: /task.php
Disallow: /usercp.php
Disallow: /usercp2.php
Disallow: /calendar.php
Disallow: /*action=emailuser*
Disallow: /*action=nextnewest*
Disallow: /*action=nextoldest*
Disallow: /*year=*
Disallow: /*action=weekview*
Disallow: /*action=nextnewest*
Disallow: /*action=nextoldest*
Disallow: /*sort=*
Disallow: /*order=*
Disallow: /*mode=*
Disallow: /*datecut=*
Allow: /
Url = www.seobuild.net
If bots are treated as Guests, i shouldnt really need a Robots.txt at all, should I??
Thanks for your time and whilst waiting, lots of great info to read up on
Regards,
Snooks.
Ive recently taken over a pretty dead forum and Webmaster Tools are indicating that it 2500+ threads are not indexed due to Robots.txt settings.
Things just dont seem right so i wondered if someone would be kind enough to look at the Robots.txt file and offer opinions on if it iis suitable.
User-Agent: *
Disallow: /captcha.php
Disallow: /editpost.php
Disallow: /misc.php
Disallow: /modcp.php
Disallow: /moderation.php
Disallow: /newreply.php
Disallow: /newthread.php
Disallow: /online.php
Disallow: /printthread.php
Disallow: /private.php
Disallow: /ratethread.php
Disallow: /report.php
Disallow: /reputation.php
Disallow: /search.php
Disallow: /sendthread.php
Disallow: /task.php
Disallow: /usercp.php
Disallow: /usercp2.php
Disallow: /calendar.php
Disallow: /*action=emailuser*
Disallow: /*action=nextnewest*
Disallow: /*action=nextoldest*
Disallow: /*year=*
Disallow: /*action=weekview*
Disallow: /*action=nextnewest*
Disallow: /*action=nextoldest*
Disallow: /*sort=*
Disallow: /*order=*
Disallow: /*mode=*
Disallow: /*datecut=*
Allow: /
Url = www.seobuild.net
If bots are treated as Guests, i shouldnt really need a Robots.txt at all, should I??
Thanks for your time and whilst waiting, lots of great info to read up on
Regards,
Snooks.