ePressureCooker
Forum Replies Created
-
Okay, thank you. So presumably there isn’t anything I can do on my side to correct this, or exclude this particular bot from the numbers?
Forum: Plugins
In reply to: [SEO Ultimate] 404 Module – 404 Errors on webpages/src=No Abhi, you misunderstand. It has nothing to do with your host. FileZilla is an FTP program, its totally free, if you run a search for “Filezilla download” you can find it and download it to your system. It allows you to upload files, pictures and the like to your website. You can access your robots.txt file through that program.
Actually, Hostgator is my host too, they are very nice and helpful, if you call them and tell them you want to add that text to your robots.txt file, they would probably be able to either do it for you, or help you step by step how to do it. But I would go ahead and download Filezilla, because I’m sure you’ll want to load photos up to your site sometime. And if you have it on your system, that might help Hostgator tell you how to access your file. ;D
Forum: Plugins
In reply to: [SEO Ultimate] 404 Module – 404 Errors on webpages/src=Its in the main directory of your blog. If you use FileZilla (a free program which allows you to upload photos and files to your blog), once you find the file, you can right click on the file, choose “View/Edit”, paste in the additional text to disallow Yandex, and then save it back up to your website with the changes.
Forum: Plugins
In reply to: [SEO Ultimate] 404 Module – 404 Errors on webpages/src=I fail to see how it matters whether he adds to my thread or not, given that it hadn’t attracted any interest.
Be that as it may, abhi, I did realize that many of the errors were being prompted by something called the Yandex bot. I did a little research, and apparently its a Russian search engine that crawls sites excessively and takes up way more bandwidth than its worth. Its not clear whether its pernicious in some way, or just incredibly inefficient and annoying.
Did some research into how to block it, and ran across both a technique on a webmaster forum to use 403 errors to screw with Yandex (which judging by the reactions of those more in the know than I am is a nasty way of making them go away, one that could be used if a robots.txt disallow doesn’t work.
I also found this yandex page telling you the various Yandex bots you can block, and what they will and will not comply with:
http://help.yandex.com/webmaster/?id=1113851
So I added the following to my robots.txt file:
User-agent: Yandex
Disallow: /
User-agent: YandexBot
Disallow: /
User-agent: YandexMedia
Disallow: /
User-agent: YandexImages
Disallow: /
User-agent: YandexCatalog
Disallow: /
User-agent: YandexDirect
Disallow: /
User-agent: YandexBlogs
Disallow: /
User-agent: YandexNews
Disallow: /
User-agent: YandexPagechecker
Disallow: /
User-agent: YandexMetrika
Disallow: /
User-agent: YandexMarket
Disallow: /
User-agent: YandexCalendar
Disallow: /
(this was a day or two ago, and it took a little while to kick in, but the number of SEO 404 errors reported by SEO Ultimate plugin have dropped to very little, whereas they were pretty numerous before. So, thus far, it looks like Yandex has backed off and is leaving my site alone. My site isn’t in Russian, I don’t need Russian speaking traffic, so no loss to me, plus I save bandwidth they were wasting.