Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Not Solved Stuck Robot
#1
Not Solved
I have recently set up my site. Not long after I started I found Google had started indexing it. They were quick. Anyway after 2 days it is still indexing it and seems stuck on the no permissions page. I've added a robots.txt now but it is clearly too late for this poor robot.

Will it time out or do I need to do something to kill it?
#2
Not Solved
Google will see the robots.txt file soon and, provided it's correctly designed, Google will follow it and not crawl the pages you specified. There's nothing to worry about.
#3
Not Solved
OK. Thanks for that. It just seems worrying to see it on the Who's Online list all the time


Forum Jump:


Users browsing this thread: 1 Guest(s)