Auto ban IP from Honeypot attempts?

[chuzie]

Not sure if it a DoS or a valid attempt to break in, but I've had multiple incidents in the past month of attacks on my Honeypot trying to login (1600+). Luckily I get the emails and manually ban the source IP. Yes, I realize this is the point of the Honeypot and it's a zero threat, but I'd rather just have a mechanism in place to ban the IP after X failed login attempts. 

Is this possible at the non-geek level?

Thanks!