MyBB Community Forums

Full Version: REPORTS FROM MY GOOGLE WEBMASTER(errors)
You're currently viewing a stripped down version of our content. View the full version with proper formatting.
REPORTS FROM MY GOOGLE WEBMASTER

robots.txt fetch failed

You have a robots.txt file that we are currently unable to fetch. In such cases we stop crawling your site until we get hold of a robots.txt, or fall back to the last known good robots.txt file



Server error
68
 
 
Do you have a robots.txt file in your root directory?
i wasnt having..i just added this robot.txt today
i just added this in my root directory


User-Agent: *
Disallow: captcha.php
Disallow: editpost.php
Disallow: misc.php
Disallow: modcp.php
Disallow: moderation.php
Disallow: newreply.php
Disallow: newthread.php
Disallow: online.php
Disallow: printthread.php
Disallow: private.php
Disallow: ratethread.php
Disallow: report.php
Disallow: reputation.php
Disallow: search.php
Disallow: sendthread.php
Disallow: task.php
Disallow: usercp.php
Disallow: usercp2.php
Disallow: calendar.php
Disallow: *action=emailuser*
Disallow: *action=nextnewest*
Disallow: *action=nextoldest*
Disallow: *year=*
Disallow: *action=weekview*
Disallow: *action=nextnewest*
Disallow: *action=nextoldest*
Disallow: *sort=*
Disallow: *order=*
Disallow: *mode=*
Disallow: *datecut=*
Allow: /

i saved it in a notepad as robots.txt and uploaded it in the public_html of my site


is that right?

any help?

hope this prevent my site from crawling?
i wan my site to grow bigger