2012-08-01, 10:46 AM
2012-08-01, 10:52 AM
Use robots.txt to block specific Useragent: http://www.seosandwitch.com/2012/06/robotstxt.html
2012-08-01, 10:52 AM
i have found this to put in .htaccess:
BrowserMatchNoCase Baiduspider bad_bot
Deny from env=bad_bot
is that ok?
BrowserMatchNoCase Baiduspider bad_bot
Deny from env=bad_bot
is that ok?
2012-08-16, 10:02 AM
Hi
Funny thing, I`ve encountered this same question just recently on several forums.
From what I`ve read, Baidubot will ignore robots.txt, so, to overcome this, most people set up an IP based deny rule, using .htaccess - you can learn more here:
http://forums.oscommerce.com/topic/38292...stop-them/
Also, you can find out user-agent info and IP check tool in here: http://www.Botopedia.org
Funny thing, I`ve encountered this same question just recently on several forums.
From what I`ve read, Baidubot will ignore robots.txt, so, to overcome this, most people set up an IP based deny rule, using .htaccess - you can learn more here:
http://forums.oscommerce.com/topic/38292...stop-them/
Also, you can find out user-agent info and IP check tool in here: http://www.Botopedia.org