Extensions > botdetection
Helper class to detect search engines, bots, spiders, crawlers ...
Bot Detection is a helper class for other extensions (Frontend) the need to detect whether the access is human or machine :-)
A reliable detection is not possible.
It is to use two methods to detect this:
- User Agent
- IP address
The modul includes a method for the agent (BD_CheckBotAgent) and one for the IP detection (BD_CheckBotIP).
These two methods return only "true" or "false" and are only a rough search on strings and substrings to identify the most important bots.
Another method (BD_CheckBotAgentAdvanced) comes with an external configuration file for the user agent detection. As a result, it returns the short name of the bots or "false".
A test is attached to be called directly, as well as 2 front end module as a demo for the implementation in your own modules.
New Bots found with my detection script:
- Internet Archive (archive.org_bot)
- false positive : AppleWebKit in CheckBotAgentAdvanced -> (Google Web Preview)