This non-buffered output filter for fluentd will filter web events based on blacklisted ip addresses. It is intended to ignore traffic and events sent by bots/crawlers.
Usage:
Alter your td-agent.conf file to have these directives:
<match your.event.tag>
type bot_filter
</match>
<match filtered>
type stdout
</match>
Drop the out_bot_filter.rb file into your fluent/plugin directory, put the filters directory on the same level as the plugin directory, with the ip_addresses.txt file in there and restart the service.
Profit!