Hi,
I have robots.meta installed and it seems to be working okay except it's not stopping endlessly repeating visits, perhaps because it's not caching the results?
In the month of January these damn robots/crawlers chowed 3.5 gigs of bandwidth that's costing me money!
Is there any way to stop this?
Bill
