MyBB Community Forums

Full Version: Stuck Robot
You're currently viewing a stripped down version of our content. View the full version with proper formatting.
I have recently set up my site. Not long after I started I found Google had started indexing it. They were quick. Anyway after 2 days it is still indexing it and seems stuck on the no permissions page. I've added a robots.txt now but it is clearly too late for this poor robot.

Will it time out or do I need to do something to kill it?
Google will see the robots.txt file soon and, provided it's correctly designed, Google will follow it and not crawl the pages you specified. There's nothing to worry about.
OK. Thanks for that. It just seems worrying to see it on the Who's Online list all the time