2012-08-04, 07:10 AM
Hello everyone,
My Mybb forums runs on a subdomain ,ie, forum.realindianfreebies.in
I already have a robots.txt file :- forum.realindianfreebies.in/robots.txt
But still google webmaster shows me many errors on the links i have disallowed on the robots.txt, dont know why google crawlers are crawling them when they are disallowed.
Can any one help me out in building a new robots.txt file please ???
My Mybb forums runs on a subdomain ,ie, forum.realindianfreebies.in
I already have a robots.txt file :- forum.realindianfreebies.in/robots.txt
But still google webmaster shows me many errors on the links i have disallowed on the robots.txt, dont know why google crawlers are crawling them when they are disallowed.
Can any one help me out in building a new robots.txt file please ???