MyBB Community Forums

I'm submitting this tutorial as i dont find any topic regarding adding new bots to MyBB to help optimize the website in search-engines easily.

I'm preparing huge bots [source: google] list for mybb and i will update them here regularly. For now i'm submitting a 250 Bots .sql file which can be restored to your database by changing the table prefix.

Adding these bots manually in ACP is headache and i would like to provide database restore file. Before restoring this file to your database through
phpMyAdmin, Go to your account's phpMyAdmin, browse to tablePrefix_spiders, delete all the spiders by checking the boxes to left and clicking on 'X' mark to delete them.

After that, make the trablePrefix changes to the downloaded Bots .sql file name and inner contents.
Open the file using Notepad++ or any text editor and change the occurances of mybb_spiders to your tablePrefix_spiders. Suppose your table prefix is dbase then change the mybb_spiders part to dbase_spiders at all occurances and save the file as tablePrefix_spiders.sql Don't forget the extension .sql while saving the file.

Using the import option in your phpMyAdmin panel, select this file and upload. All the 250Bots will be added to your database.

Caution: Keep an eye on the bots activity, if you find something wrong with the bot, please delete that bot and inform here. As there are huge number of bots it is not possible to check the behaviour of all the bots. Some are good and some are bad, please report the bad bots/spam bots here. If you know any new bot, please share with us.

Download:
250 Bots List: 1-250: http://rapidshare.com/files/425376349/mybb_spiders.rar
250 Bots List: 251-500: http://rapidshare.com/files/426131645/mybb_spiders2.rar
250 Bots List: 500-750: http://rapidshare.com/files/428440222/mybb_spiders3.rar
250 Bots List: 750-1000: http://rapidshare.com/files/428440230/mybb_spiders4.rar
150~ Bots List: 1000-1150~: http://rapidshare.com/files/428440233/mybb_spiders5.rar

Can you please post it on a less sketchy site? Or an attachment here.

(I'm just paranoid)

Ok. As i'm unable to add the sql files as attachments i rared that file. Well, as you asked to attach here only, i changed the file extension as .txt.

Open the file in Notepad++ and save it as .sql to make it back again as database restore file.

I have attached the 250bots restore database file. Still more to come.[attachment=20268]

Very good. Might use it sometimes

Added another 250 bots list (251-500)

I tend to get pretty annoyed with them haha, but good tut.

500-750. Another 250bots list added to first post.

750-1000. Another 250bots list added to first post.

Damn, 1000 bots. I wonder if this can hurt your site somehow (besides the huge who's online list).

Nah. I dont this so. Do you think all bots visit at the same time? No, they don't. So there is no problem of having huge online list.
I had hidden the bots from the who is online list. It will not be a problem.

Well, this gives better indexing of our site at many search engines.

Last bot list is on the way. (1001 to 1230)

P.S: Lists may contain some repeated, dead bots becuase its hard to filter them. Best practice is to remove the duplicate entries when they crawl your site and delete the bots that may not crawl for long time.