MyBB Community Forums

MyBB Community Forums > Community Archive > Archived Forums > Archived Development and Support > MyBB 1.6 > 1.6 General Support > Google Bot attack
Full Version: Google Bot attack
You're currently viewing a stripped down version of our content. View the full version with proper formatting.

lexy

2012-03-18, 09:59 AM
constant attacks Google Bot on my site can someone explain me how to block this

66.249.71.198 - - [17/Mar/2012:08:41:33 -0400] "GET /showthread.php?tid=977&language=english HTTP/1.0" 503 1821 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:08:41:33 -0400] "GET /showthread.php?tid=977&language=english HTTP/1.1" 503 1833 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:08:41:40 -0400] "GET /showthread.php?tid=908 HTTP/1.0" 503 1821 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:08:41:40 -0400] "GET /showthread.php?tid=908 HTTP/1.1" 503 1833 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:08:41:42 -0400] "GET /showthread.php?tid=916 HTTP/1.0" 503 1821 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:08:41:42 -0400] "GET /showthread.php?tid=916 HTTP/1.1" 503 1833 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:08:42:04 -0400] "GET /archive/index.php/forum-15-2.html HTTP/1.0" 503 1840 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:08:42:04 -0400] "GET /archive/index.php/forum-15-2.html HTTP/1.1" 503 1852 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:08:42:11 -0400] "GET /ratethread.php?tid=1810&rating=1&my_post_key=23c73571795047c262bafd49d1f6018b HTTP/1.0" 503 1821 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:08:42:11 -0400] "GET /ratethread.php?tid=1810&rating=1&my_post_key=23c73571795047c262bafd49d1f6018b HTTP/1.1" 503 1833 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:08:42:12 -0400] "GET /archive/index.php/forum-24-1.html HTTP/1.0" 503 1840 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:08:42:12 -0400] "GET /archive/index.php/forum-24-1.html HTTP/1.1" 503 1852 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:08:42:17 -0400] "GET /archive/index.php/thread-1528.html HTTP/1.0" 503 1841 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:08:42:17 -0400] "GET /archive/index.php/thread-1528.html HTTP/1.1" 503 1853 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:08:42:24 -0400] "GET /archive/index.php/thread-1422.html HTTP/1.0" 503 1841 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:08:42:24 -0400] "GET /archive/index.php/thread-1422.html HTTP/1.1" 503 1853 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:08:42:31 -0400] "GET /archive/index.php/forum-65.html HTTP/1.0" 503 1838 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:08:42:31 -0400] "GET /archive/index.php/forum-65.html HTTP/1.1" 503 1850 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"

66.249.71.198 - - [17/Mar/2012:09:07:44 -0400] "GET /newreply.php?tid=2635&language=english HTTP/1.0" 200 10160 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:09:07:45 -0400] "GET /newreply.php?tid=2635&language=english HTTP/1.1" 200 3324 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:09:07:46 -0400] "GET /newreply.php?tid=2185&language=sh HTTP/1.0" 200 8489 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:09:07:46 -0400] "GET /newreply.php?tid=2185&language=sh HTTP/1.1" 200 2810 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:09:07:47 -0400] "GET /newreply.php?tid=2480&language=sh HTTP/1.0" 200 10160 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:09:07:47 -0400] "GET /newreply.php?tid=2480&language=sh HTTP/1.1" 200 3325 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:09:07:48 -0400] "GET /newreply.php?tid=2588&language=english HTTP/1.0" 200 10160 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:09:07:48 -0400] "GET /newreply.php?tid=2588&language=english HTTP/1.1" 200 3325 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:09:07:50 -0400] "GET /newreply.php?tid=48&pid=60&language=english HTTP/1.0" 200 10204 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:09:07:51 -0400] "GET /newreply.php?tid=48&pid=60&language=english HTTP/1.1" 200 3331 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:09:07:55 -0400] "GET /newreply.php?tid=625&pid=701&language=english HTTP/1.0" 200 8535 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:09:07:55 -0400] "GET /newreply.php?tid=625&pid=701&language=english HTTP/1.1" 200 2819 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:09:07:56 -0400] "GET /newreply.php?tid=512&language=english HTTP/1.0" 200 8488 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:09:07:57 -0400] "GET /newreply.php?tid=512&language=english HTTP/1.1" 200 2809 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:09:08:03 -0400] "GET /newreply.php?tid=517&language=english HTTP/1.0" 200 8488 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:09:08:04 -0400] "GET /newreply.php?tid=517&language=english HTTP/1.1" 200 2809 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:09:08:04 -0400] "GET /newreply.php?tid=487&pid=563&language=english HTTP/1.0" 200 8535 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:09:08:05 -0400] "GET /newreply.php?tid=487&pid=563&language=english HTTP/1.1" 200 2819 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"

66.249.71.198 - - [17/Mar/2012:09:08:11 -0400] "GET /newreply.php?tid=623&language=english HTTP/1.0" 200 8488 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:09:08:11 -0400] "GET /newreply.php?tid=623&language=english HTTP/1.1" 200 2809 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:09:08:13 -0400] "GET /newreply.php?tid=689&language=english HTTP/1.0" 200 8488 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:09:08:14 -0400] "GET /newreply.php?tid=689&language=english HTTP/1.1" 200 2809 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:09:08:19 -0400] "GET /newreply.php?tid=549&language=english HTTP/1.0" 200 8488 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:09:08:19 -0400] "GET /newreply.php?tid=549&language=english HTTP/1.1" 200 2810 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:09:08:20 -0400] "GET /newreply.php?tid=526&pid=602&language=english HTTP/1.0" 200 8535 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:09:08:20 -0400] "GET /newreply.php?tid=526&pid=602&language=english HTTP/1.1" 200 2820 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:09:08:21 -0400] "GET /newreply.php?tid=533&language=english HTTP/1.0" 200 8488 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:09:08:21 -0400] "GET /newreply.php?tid=533&language=english HTTP/1.1" 200 2809 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:09:08:25 -0400] "GET /newreply.php?tid=659&pid=783&my_post_key=23c73571795047c262bafd49d1f6018b&language=english HTTP/1.0" 200 10290 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; 

66.249.71.58 - - [17/Mar/2012:12:21:40 -0400] "GET /showthread.php?mode=linear&tid=673&pid=921 HTTP/1.0" 200 81516 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.58 - - [17/Mar/2012:12:21:41 -0400] "GET /showthread.php?mode=linear&tid=673&pid=921 HTTP/1.1" 200 8288 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:12:21:53 -0400] "GET /printthread.php?tid=657&my_post_key=23c73571795047c262bafd49d1f6018b&language=english HTTP/1.0" 200 3176 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:12:21:54 -0400] "GET /printthread.php?tid=657&my_post_key=23c73571795047c262bafd49d1f6018b&language=english HTTP/1.1" 200 1638 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:12:22:16 -0400] "GET /printthread.php?tid=669&my_post_key=23c73571795047c262bafd49d1f6018b&language=english HTTP/1.0" 200 2257 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:12:22:16 -0400] "GET /printthread.php?tid=669&my_post_key=23c73571795047c262bafd49d1f6018b&language=english HTTP/1.1" 200 1132 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:12:22:35 -0400] "GET /showthread.php?mode=linear&tid=97&pid=141 HTTP/1.0" 200 92711 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:12:22:36 -0400] "GET /showthread.php?mode=linear&tid=97&pid=141 HTTP/1.1" 200 14976 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:12:22:39 -0400] "GET /printthread.php?tid=662&my_post_key=23c73571795047c262bafd49d1f6018b&language=english HTTP/1.0" 200 3689 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:12:22:40 -0400] "GET /printthread.php?tid=662&my_post_key=23c73571795047c262bafd49d1f6018b&language=english HTTP/1.1" 200 1802 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"

66.249.71.198 - - [17/Mar/2012:16:14:32 -0400] "GET /mybb/calendar.php?action=addevent&calendar=1&day=10&month=12&year=2014&my_post_key=fb7d2d147be9372187308c09d65e4c38&language=espanol HTTP/1.0" 302 463 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:16:14:32 -0400] "GET /mybb/calendar.php?action=addevent&calendar=1&day=10&month=12&year=2014&my_post_key=fb7d2d147be9372187308c09d65e4c38&language=espanol HTTP/1.1" 302 463 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:16:14:34 -0400] "GET /mybb/calendar.php?action=addevent&calendar=1&day=10&month=12&year=2012&my_post_key=fb7d2d147be9372187308c09d65e4c38&language=sh HTTP/1.0" 302 463 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:16:14:34 -0400] "GET /mybb/calendar.php?action=addevent&calendar=1&day=10&month=12&year=2012&my_post_key=fb7d2d147be9372187308c09d65e4c38&language=sh HTTP/1.1" 302 463 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:16:14:37 -0400] "GET /printthread.php?tid=772&my_post_key=23c73571795047c262bafd49d1f6018b&my_post_key=23c73571795047c262bafd49d1f6018b&language=english HTTP/1.0" 200 8575 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:16:14:37 -0400] "GET /printthread.php?tid=772&my_post_key=23c73571795047c262bafd49d1f6018b&my_post_key=23c73571795047c262bafd49d1f6018b&language=english HTTP/1.1" 200 2848 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:16:14:38 -0400] "GET /forumdisplay.php?fid=51 HTTP/1.0" 200 62730 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:16:14:39 -0400] "GET /forumdisplay.php?fid=51 HTTP/1.1" 200 8392 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:16:14:39 -0400] "GET /mybb/calendar.php?action=addevent&calendar=1&day=10&month=12&year=2013&my_post_key=fb7d2d147be9372187308c09d65e4c38&language=farsi HTTP/1.0" 302 463 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:16:14:39 -0400] "GET /mybb/calendar.php?action=addevent&calendar=1&day=10&month=12&year=2013&my_post_key=fb7d2d147be9372187308c09d65e4c38&language=farsi HTTP/1.1" 302 463 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:16:14:43 -0400] "GET /mybb/calendar.php?action=addevent&calendar=1&day=10&month=12&year=2010&my_post_key=fb7d2d147be9372187308c09d65e4c38&language=greek HTTP/1.0" 302 463 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:16:14:43 -0400] "GET /mybb/calendar.php?action=addevent&calendar=1&day=10&month=12&year=2010&my_post_key=fb7d2d147be9372187308c09d65e4c38&language=greek HTTP/1.1" 302 463 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:16:14:51 -0400] "GET /mybb/calendar.php?action=addevent&calendar=1&day=10&month=12&year=2013&my_post_key=fb7d2d147be9372187308c09d65e4c38&language=czech HTTP/1.0" 302 463 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:16:14:51 -0400] "GET /mybb/calendar.php?action=addevent&calendar=1&day=10&month=12&year=2013&my_post_key=fb7d2d147be9372187308c09d65e4c38&language=czech HTTP/1.1" 302 463 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"

66.249.71.198 - - [17/Mar/2012:19:06:19 -0400] "GET /showthread.php?tid=3252 HTTP/1.0" 200 35167 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:19:06:19 -0400] "GET /showthread.php?tid=3252 HTTP/1.1" 200 7213 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:19:06:20 -0400] "GET /printthread.php?tid=2748 HTTP/1.0" 200 34275 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:19:06:21 -0400] "GET /printthread.php?tid=2748 HTTP/1.1" 200 14517 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:19:06:24 -0400] "GET /archive/index.php/forum-19-8.html HTTP/1.0" 200 6857 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:19:06:24 -0400] "GET /archive/index.php/forum-19-8.html HTTP/1.1" 200 1463 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:19:06:32 -0400] "GET /printthread.php?tid=461&my_post_key=23c73571795047c262bafd49d1f6018b&language=english HTTP/1.0" 200 8575 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:19:06:33 -0400] "GET /printthread.php?tid=461&my_post_key=23c73571795047c262bafd49d1f6018b&language=english HTTP/1.1" 200 2848 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:19:02:45 -0400] "GET /showthread.php?tid=755&pid=1057&language=english HTTP/1.0" 200 27100 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:19:02:45 -0400] "GET /showthread.php?tid=755&pid=1057&language=english HTTP/1.1" 200 6729 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:19:02:47 -0400] "GET /showthread.php?tid=2233&language=english HTTP/1.0" 200 26755 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:19:02:47 -0400] "GET /showthread.php?tid=2233&language=english HTTP/1.1" 200 6759 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:19:02:59 -0400] "GET /showthread.php?tid=504&my_post_key=23c73571795047c262bafd49d1f6018b&language=english HTTP/1.0" 200 8794 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:19:03:00 -0400] "GET /showthread.php?tid=504&my_post_key=23c73571795047c262bafd49d1f6018b&language=english HTTP/1.1" 200 2863 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:19:03:37 -0400] "GET /showthread.php?tid=96&page=4&language=english HTTP/1.0" 200 93696 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:19:03:39 -0400] "GET /showthread.php?tid=96&page=4&language=english HTTP/1.1" 200 9794 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:19:03:41 -0400] "GET /showthread.php?tid=2278 HTTP/1.0" 200 8711 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:19:03:41 -0400] "GET /showthread.php?tid=2278 HTTP/1.1" 200 2828 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:19:03:53 -0400] "GET /showthread.php?tid=2209&highlight=illuminati+licem+u+lice&my_post_key=23c73571795047c262bafd49d1f6018b&language=english HTTP/1.0" 200 32452 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:18:55:05 -0400] "GET /showthread.php?mode=linear&tid=1481&pid=1917 HTTP/1.0" 200 36450 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:18:55:06 -0400] "GET /showthread.php?mode=linear&tid=1481&pid=1917 HTTP/1.1" 200 7102 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:18:57:24 -0400] "GET /showthread.php?tid=1983&my_post_key=23c73571795047c262bafd49d1f6018b&my_post_key=23c73571795047c262bafd49d1f6018b&language=sh HTTP/1.0" 200 27043 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:18:57:25 -0400] "GET /showthread.php?tid=1983&my_post_key=23c73571795047c262bafd49d1f6018b&my_post_key=23c73571795047c262bafd49d1f6018b&language=sh HTTP/1.1" 200 6773 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:18:57:25 -0400] "GET /showthread.php?tid=1962&language=english HTTP/1.0" 200 26858 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:18:57:25 -0400] "GET /showthread.php?tid=1962&language=english HTTP/1.1" 200 6674 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:18:57:36 -0400] "GET /showthread.php?tid=1839 HTTP/1.0" 200 8711 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:18:57:36 -0400] "GET /showthread.php?tid=1839 HTTP/1.1" 200 2827 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:18:57:37 -0400] "GET /showthread.php?tid=1842&action=nextoldest HTTP/1.0" 302 - "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:18:57:38 -0400] "GET /showthread.php?tid=1842&action=nextoldest HTTP/1.1" 302 0 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:18:57:52 -0400] "GET /showthread.php?tid=1966&language=english HTTP/1.0" 200 26902 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:18:57:52 -0400] "GET /showthread.php?tid=1966&language=english HTTP/1.1" 200 6654 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:18:57:54 -0400] "GET /showthread.php?tid=1484&language=english HTTP/1.0" 200 25950 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:18:57:54 -0400] "GET /showthread.php?tid=1484&language=english HTTP/1.1" 200 6596 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:18:58:11 -0400] "GET /showthread.php?tid=1779 HTTP/1.0" 200 26182 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:18:58:12 -0400] "GET /showthread.php?tid=1779 HTTP/1.1" 200 6582 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:18:58:14 -0400] "GET /showthread.php?tid=1772&pid=2263 HTTP/1.0" 200 25970 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:18:58:14 -0400] "GET /showthread.php?tid=1772&pid=2263 HTTP/1.1" 200 6529 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:18:59:23 -0400] "GET /showthread.php?tid=2090&language=english HTTP/1.0" 200 26879 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:18:59:24 -0400] "GET /showthread.php?tid=2090&language=english HTTP/1.1" 200 6725 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:18:59:45 -0400] "GET /showthread.php?mode=linear&tid=1691&pid=2190 HTTP/1.0" 200 31613 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:18:59:46 -0400] "GET /showthread.php?mode=linear&tid=1691&pid=2190 HTTP/1.1" 200 6893 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:18:59:55 -0400] "GET /showthread.php?tid=2164&pid=2713&my_post_key=23c73571795047c262bafd49d1f6018b&language=english HTTP/1.0" 200 27047 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
66.249.71.198 - - [17/Mar/2012:18:59:55 -0400] "GET /showthread.php?tid=2164&pid=2713&my_post_key=23c73571795047c262bafd49d1f6018b&language=english HTTP/1.1" 200 6734 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"

Nathan Malcolm

2012-03-18, 10:05 AM
Google isn't attacking your site. It's crawling it. That's a good thing.

If you wish, you can specify the crawl rate of the bot.

http://support.google.com/webmasters/bin...swer=48620

lexy

2012-03-18, 10:08 AM
but php files because the constant load and many times cause of achievement of the process limits and CPU limits.

Nathan Malcolm

2012-03-18, 10:20 AM
Did you read the link I provided? You should. You can also do similar through robots.txt

lexy

2012-03-18, 10:33 AM
so where do i put this codes from robot text in headerinclude??

<!DOCTYPE html>
<html><head>
<meta name="robots" content="noindex" />
(…)
</head>
<body>(…)</body>
</html>

Nathan Malcolm

2012-03-18, 10:37 AM
I would highly advise against that because no visitors will be able to find your site via search engines. Instead you should delay the crawl rate for best results.

But if you're sure you wish to completely block search engines (All that obey robots.txt that is), then replace the contents of your robots.txt file with the following:

User-agent: *
Disallow: /

User 2877

2012-03-18, 10:53 AM
I'm sorry but this is humorous. Google is not attacking you. They are viewing pages of your site to include in their index so when people search you have a chance at being in the results.
MyBB Community Forums > Community Archive > Archived Forums > Archived Development and Support > MyBB 1.6 > 1.6 General Support > Google Bot attack