Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Not Solved Stuck Robot
Not Solved
I have recently set up my site. Not long after I started I found Google had started indexing it. They were quick. Anyway after 2 days it is still indexing it and seems stuck on the no permissions page. I've added a robots.txt now but it is clearly too late for this poor robot.

Will it time out or do I need to do something to kill it?
Not Solved
Google will see the robots.txt file soon and, provided it's correctly designed, Google will follow it and not crawl the pages you specified. There's nothing to worry about.
Not Solved
OK. Thanks for that. It just seems worrying to see it on the Who's Online list all the time

Forum Jump:

Users browsing this thread: 1 Guest(s)