MyBB Community Forums

It is great, that we have the possibility to manage spiders and bots via ACP.

I'd like to have an option to not identify them by user agent, which can easily be manipulated, but by ip host.

A host that looks like that:

Quote:crawl-66-249-73-139.googlebot.com

is for sure from google and with a host option I could just say that GoogleBot must contain a host with googlebot.com.

That would be more secure and efficient.

The option to eighter choose user agent or host would be great.

I've already seen bots with faked rDNS entries.

Well, there is no 100% protection but a faked rDNS entry is more complex to do then a fake user agent as far as I know.

It's quite easy if your host offers to change your rDNS.

But more complex then giving my Firefox a different user agent string

And I always can check the IP adress manually to see if it really belongs to Google if I have the evidence, one of the "Google Bots" might be something different with a faked rDNS.

What do you propose instead if not the host info? Is there something more secure?