• Popseo

    (@chacko)


    Is there a plugin which enforces no index and no follow only for google?

    Other search engines should not be affected by it.

Viewing 12 replies - 1 through 12 (of 12 total)
  • catacaustic

    (@catacaustic)

    I haven’t seen one, but even if I had, I would not be uisng it.

    The reason for that is simple. Googles IP addresses change from time ot time as they add and change around the servers that run their indexing bots. As soon as one hits your site that isn’t uisng a known IP address or user-agent string it will see that you’re changing your pages HTML to suit Google crawlers only, and that’s a very big black mark against your stie from their point of view. If you’re lucky your site will only get downgraded in the search results. If you’re not lucky your entire site can be blacklisted.

    In short, it’s not worth the risk, so if you have something as nofollow, keep it as nofollow for everything.

    Thread Starter Popseo

    (@chacko)

    One can always define with googlebot designation without getting into ip based block. Isn’t it?

    catacaustic

    (@catacaustic)

    Maybe, but my point still remains. If you do that you will always run the very real risk that your site will get blacklisted for serving different content to the bots then to every other visitor.

    Oh, and just so you know, I don’t think for a second that Google includes their bot indicator with every request from their bots. they do with the majority of them, but for checking I’d be very surprised if they didn’t use a set of standard browser user-agent strings that would not get picked up. And even if that’s not the case when a real person from Google manually looks at the site (they do do that) they’ll see the difference and flag it as breaking their rules too.

    Just why is it so important to have the nofollow on these links of yours only for Google? I can’t see why there’d be a differnce in having that for all visitors or none. There’s no visible difference, only if they want to look at the source code. The only reason that I can think of is that you’re trying to cheat backlinks by showing normal people that their links aren’t nofollow, but then forcing nofollow when Google visits to try and preserve your own “page rank” (which by the way doesn’t actually work, that’s been disproven by google many times in the past).

    Thread Starter Popseo

    (@chacko)

    Hypothetically, if there was a way of noindex, nnollow for only google, then its not illegal to show follow and index to other bots. Why should google penalise websites for applying nofollow, no index only for google?

    Thread Starter Popseo

    (@chacko)

    I am talking about nofollow no index selective posts of wordpress install.

    catacaustic

    (@catacaustic)

    Because you’re serving different content to users then you are to the bots, and that is against their guidelines, so you will get blacklisted. That’s what the whole argument is – and that comes from Google themselves. Do a search for ‘cloaking’ sometime and you’ll see what I mean.

    http://google.about.com/od/searchengineoptimization/tp/badseo.htm
    http://www.free-seo-news.com/newsletter293.htm

    While what you are doing is not changing the entire content, you are still manipulating their bots for your own benefit, and tht makes then very sad.

    All other search engines are the same. They might be a little behind Google in detecting that sort of cloaking, but they will, and they will all penalise your site for that.

    You still haven’t said why you want to do this? What is your reason for wanting this functionality? If you have a valid raeson for it I’d be happy to help.

    Thread Starter Popseo

    (@chacko)

    Ok. See, we sell products from a woo install. Google see’s most products as duplicate content, for example books. One cannot write an entirely new description for 1000’s of books, change their authors, isbn etc. This is google’s particular problem. The same is not the issue with other bots as per my experience. Google anyway does not require it, so why get noindexed in other search engines? Hypothetically, you may argue that other bots have same policies, but are not reflecting.

    catacaustic

    (@catacaustic)

    You can’t change authors, etc, but you can change a description – unless you’re just using a copy-and-paste description from your suppliers. Sure it’s a big job, but that’s how you get ranking for those products.

    From what I’ve seen with stores, the duplicate content filter is highly de-valued for products. I’ve done work in an area where there’s almost complete replication of product details across 1,000’s of sites, and it doesn’t hurt for that exact reason. The products are all the same, so there is always a lot of those products around and you can’t change things.

    http://searchengineland.com/googles-matt-cutts-duplicate-content-wont-hurt-you-unless-it-is-spammy-167459

    There’s also a lot of resources for doing things the right way.

    http://www.toprankblog.com/2013/01/seo-for-ecommerce/
    http://moz.com/community/q/product-descriptions-duplicate-content-between-fears-and-reality

    But, if you really feel that it’s required, I’d suggest setting up a shortcode and the associated function that can check against the user-agent to see if it is a googlebot and if it is, output the nofollow tag. That way you can use it from within your content as well as from template pages. Just remember that it has to be added manually to each link that you have on the site. I don’t think that there’s an autoamted way to do it thanks to the content of most <a> tags being hard-coded everywhere.

    Thread Starter Popseo

    (@chacko)

    All those things said by google employees and other articles are fine. The reality is that if you search for a book or other product, you will end up with amazon or such big sites. others are rarely visible, even if not spammy. Google search is so pathetic now that lot of small companies (even non eCommerce), have disappeared in their searchs and there are more chances that they might be found in Bing or twitter or facebook. To sum up, google’s complex rules (which they claim is simple), is not understood by most folks out there and have disappeared. This renders google search useless and people will eventually move out to explore more search options.

    Can you anyone come up with a solution to selectively ban google from certain posts. This way the website will be relevant to google policies and other search engines too.

    catacaustic

    (@catacaustic)

    The reality is that if you search for a book or other product, you will end up with amazon or such big sites. others are rarely visible, even if not spammy

    Welcome to the wild, and mostly unfair, world of SEO.

    I agree, it is very far from simple. Even the “experts” have no idea of what to do to get 100% effective results now and in the future. But there’s always some rules that will be the best way to work.

    On top of that, people aren’t going to leave Googles serach because it’s not bringing up small independant retailers. They will kepe using it because it gives them what they want. They asked for that book, and it gave them that book at Amazon. For users, that’s a win. For you, not so much, but for a very different reason.

    If seaach results are your concern, then word harder on your own sites SEO. It will take time, and most likely cost some money, but you can’t play with the big boys unless you can do the same things that they are doing. It doesn’t take the budget of Amazon to get higher in the rankings, but there’s more to it then just them having a big budget. As a cople of points:

    • Their site is huge. content is King, so when your site has a few 1,000 pages you’ll always pale in comparison to the larger sites with 1,000,000’s.
    • They’ve been around a very long time. The age of a domain is also a big factor in determining rankings.
    • They are a well-known and trusted brand. Your brand might be offer the same or better, but unless you’ve got the sme world-wide reputation as Amazon, you’ll never match them.

    And that’s just them. There’s a whole heap of other sites that will have those points over your site, and always will. Big sites with big budgets will always get higher rankings. Evne in rall life it’s the same. Small players might advertise with a small add in a local newspaper becaues that’s all their budget allows, while the big players will insert their own glossy brochures into national newspapers because that’s what they can afford.

    By effectvly banning Google from indexing your content you’re not even giving yourself a chanceto rank for those products. You’re telling them that you don’t want to be included in their results, even if you could one day.

    You don’t need to block Google from anything. What you really need is a better SEO strategy. If you really feel that you need to continue with the blocking, you can still follow what I said before. I’d advise against it, but if you want to give up I can’t stop you. πŸ™‚

    Thread Starter Popseo

    (@chacko)

    i couldn’t find you in google , so i used another search engine is now a developing phrase. We have stats that more people are streaming in with bing and yahoo in terms of volume. people might not leave google, but there is a huge chance that people will search in an alternative too. For example, a lot of small companies publish unique books which are not in google search or in market places like amazon. If people are unlikely to find that in google but know of its existence via word of mouth and media, then they are most likely to take another search route.

    Most people, who are anyway downgraded or disappeared in google, are not spending on SEO. People will never confirm to rules, besides no one understands google. Google itself is getting penalised for its unfair business practices, which includes allotting key words (see the case in India) to some. The big sites which rank good on google have following characteristics 1) have affiliates that google can earn money on 2) big sites use advt network. There are exceptions too because people are searching for them and google needs to show it.

    There is going to be an alternative search market developing in few months to few years. Webmasters have to focus on that too. I am willing to be a case study, if someone can develop a plugin that I am asking for.

    Thread Starter Popseo

    (@chacko)

    There is google specific noindex <meta name=”googlebot” content=”noindex”>

    http://en.wikipedia.org/wiki/Noindex#Bot-specific_directives

    Now, can I have a plugin?

Viewing 12 replies - 1 through 12 (of 12 total)
  • The topic ‘Google no index and no follow’ is closed to new replies.