I don’t know if anyone else is having the same problem, so I thought I’d post on it–I just checked my stattraq summary to discover that the Inktomi/Yahoo user agent his hit my site 319 time over the last hour or so. Does anyone know exactly what this means? Does it mean that there are people finding my site in searches on Yahoo? Does it mean that Yahoo is spidering my site excessively? I’m baffled–however, I really don’t want a freakin’ spider/bot to hog all of my bandwidth. I may add a new line to my htaccess just to stop it–but won’t that harm my search engine results?
I’m so confused…
- The topic ‘Over 300 hits from Inktomi/Yahoo User Agent in 1 hr’ is closed to new replies.