MyBB Community Forums

Is my robots text ok the way it is?

http://mostlyanimefun.com/robots.txt

I'd disallow calendar.php too, bots could spend ages on that going through each day, week, month, year etc, there's thousands of potential URLs there, and a waste of bandwidth really.

(2009-12-28, 02:42 PM)MattRogowski Wrote: [ -> ]I'd disallow calendar.php too, bots could spend ages on that going through each day, week, month, year etc, there's thousands of potential URLs there, and a waste of bandwidth really.

ok, will do thank you.