On one of my websites I use a feed that has a limited bandwith quota, normally the quota limit is not a problem, but occasionally the website gets hammered by various intenet spiders, bots, and screen scrapers, so whenever I get near to the quota I implement a simple throttle that says no to bad bots.
Well, that was the theory, unfortunately one of the ip numbers that I banned was that of a googlebot and as a result I ended up number one on google for the search term ” “Sorry site not available – database ip-throttle in effect – please try again later….”.
Sometimes number 1 on google is not all it is cracked up to be!