disallow crawling to ratethread.php thru robots.txt file
other links (belonging to spam) were indexed before they were deleted !!
you may have to delete such links at Google webmaster's tools ...
(2011-09-29, 03:19 AM)ranjani Wrote: [ -> ]disallow crawling to ratethread.php thru robots.txt file
other links (belonging to spam) were indexed before they were deleted !!
you may have to delete such links at Google webmaster's tools ...
I don't understand what you saying. This is my current tobot.ttxt rime Please advice. Thanks
User-agent: *
Allow: /
My Problem Still remaining same. Any solutions???
for your information google bot follow all your links when you don't block it so for this replace your robots
Sitemap: http://yoursite/MyBB/sitemap-index.xml
User-Agent: *
Disallow: /MyBB/captcha.php
Disallow: /MyBB/editpost.php
Disallow: /MyBB/misc.php
Disallow: /MyBB/modcp.php
Disallow: /MyBB/moderation.php
Disallow: /MyBB/newreply.php
Disallow: /MyBB/newthread.php
Disallow: /MyBB/online.php
Disallow: /MyBB/printthread.php
Disallow: /MyBB/private.php
Disallow: /MyBB/ratethread.php
Disallow: /MyBB/report.php
Disallow: /MyBB/reputation.php
Disallow: /MyBB/search.php
Disallow: /MyBB/sendthread.php
Disallow: /MyBB/task.php
Disallow: /MyBB/usercp.php
Disallow: /MyBB/usercp2.php
Disallow: /MyBB/calendar.php
Disallow: /MyBB/*action=emailuser*
Disallow: /MyBB/*action=nextnewest*
Disallow: /MyBB/*action=nextoldest*
Disallow: /MyBB/*year=*
Disallow: /MyBB/*action=weekview*
Disallow: /MyBB/*action=nextnewest*
Disallow: /MyBB/*action=nextoldest*
Disallow: /MyBB/*sort=*
Disallow: /MyBB/*order=*
Disallow: /MyBB/*mode=*
Disallow: /MyBB/*datecut=*
Allow: /