IP Blocking / banning software – Stop Bots!

You got a slow website although you do not see much traffic in your google analytics. The most likely reason for this are bots, crawlers, spiders; all of which almost means the same ; these are machines visiting your website!

The main objective of these are to index a website so as to provide better search results to humans searching online. As every good things has evil so does they. Some are good bots and most are bad.

Then there are text bots, image bots, ad bots and more perhaps. And there are in thousands of numbers. We recently built a piece of software to view hits from each ip address each hour. Below is a basic screen showing hits per hour from unique ips in a day.

We can also do a reverse DNS lookup on the IP to find out if it is amongst any of the good bots that we let crawl our website. And we can also find the country of origin of the ip by doing a look up against a GEO database lookup and set access restriction based on country as well.

More improvements in the form of patter of requests, requests to sensitive files etc are to trigger auto response and alerts are planned.

[1] Top 10 Bots You Should Know About