Support » Plugin: Yoast SEO » Adding “noindex, follow” tag to Paginated Pages

  • Resolved Dhananjay

    (@dhananjaygbhardwaj)


    Hello,

    I want to know how I could add “noindex, follow” robots tag to all paginated pages on my website? For example:

    1) http://www.xyz.com/page/2
    2) http://www.xyx.com/category/page/2

    I tried using a functions.php code for this and ended up have two tags on paginated pages – (1) “index, follow” by Yoast, and (2) “noindex, follow” by the code I implemented.

    Is there a proper way to deal with this?

Viewing 9 replies - 1 through 9 (of 9 total)
  • Thread Starter Dhananjay

    (@dhananjaygbhardwaj)

    This is the code I have used:

    add_filter( 'wpseo_robots', 'my_robots_func' );
    function my_robots_func( $robotsstr ) {
      if ( is_page() && is_paged() ) {
        return 'noindex,follow';    
      }
      return $robotsstr;
    }

    Please note that I have little to no knowledge about the code. It was provided to me by my previous developer.

    Plugin Support devnihil

    (@devnihil)

    @dhananjaygbhardwaj The ability to noindex paginated archives was previously a feature in the plugin, but was removed from Yoast SEO in version 6.3. You can find more information on this here: https://kb.yoast.com/kb/how-do-i-noindex-urls/#archives and the changes in version 6.3 in this article: https://yoast.com/yoast-seo-6-3/

    The reason being is that if what a user is searching for is located on the 5th page of a paginated archive, the most useful search result for them is a link to that specific page, and not the first page of a paginated archive.

    Thread Starter Dhananjay

    (@dhananjaygbhardwaj)

    @devnihil Thanks for the prompt response. Yes, I do remember there being a feature in older versions of Yoast.

    And yes, I understand that explanation. It makes sense, but my website mostly covers How-Tos and Tips. Most users should be able to find what they are searching for from the direct links to my posts in the SERPs.

    Why would I want them to visit the archive page first and then find the exact article against their query when they can visit the article directly from the SERPs. I would surely not want my website’s archive page to be ranked above the main content (article) itself.

    Please do correct me if I am wrong.

    This begs to my question, is there a way to implement noindex, follow robots tag to all my website’s paginated pages?

    Plugin Support Md Mazedul Islam Khan

    (@mazedulislamkhan)

    We are afraid to say that we are unable to confirm how you can add the noindex, follow robots meta to your site’s paginated archives since the feature was removed from Yoast SEO plugin.

    We recommend you please read the article here to understand why you shouldn’t set noindex, follow to paginated archives pages.

    Thread Starter Dhananjay

    (@dhananjaygbhardwaj)

    @mazedulislamkhan Thank you!

    Plugin Support devnihil

    (@devnihil)

    @dhananjaygbhardwaj You’re welcome.

    Regarding adding the noindex robots metadata to your site’s paginated archives, we can’t offer support on custom code (needed to change (core) features of our plugin). Since we don’t want to take the risk that we break your website by suggesting incorrect or incomplete code, we cannot advise you on how to make such changes. Maybe someone watching these forums can assist you further, but if your topic is inactive for 7 days, we’ll mark it as resolved to keep the overview.

    Thread Starter Dhananjay

    (@dhananjaygbhardwaj)

    @devnihil Thank you again for following up. That’s completely justified.

    I didn’t have noindex,follow until last month. I already read the info on the page shared by @mazedulislamkhan the day it was published (keep a good tab on Yoast’s knowledgebase, you know).

    However, last month, a fellow webmaster was able to convince me that indexing the pagination would affect my site’s crawl budget and could cause duplicate content issues.

    Does that still stand true? Or is Google really able to efficiently handle those things by its own?

    Plugin Support Pcosta88

    (@pcosta88)

    @dhananjaygbhardwaj

    Crawl budgets become an issue if you have a massive site. We are not sure how many pages you have but in theory there could be at some point a limit. This guide explains more and describes a test you can perform to see if you are having crawl budget issues: https://yoast.com/crawl-budget-optimization/.

    In terms of duplicate content, yes, there are duplicate content issues but it only matters for the title. For meta descriptions, according to John Mueller (who works for Google), it is expected. See this tweet: https://twitter.com/johnmu/status/973688530873585664?s=21

    With titles you can resolve these by going to SEO-Search Appearance-Taxonomies and make sure you see the %%page%% template variable in the title field (it would appear as purple circle). This will output a page number into the title of each pagination page thus making the title different enough.

    Thread Starter Dhananjay

    (@dhananjaygbhardwaj)

    @pcosta88 Thank you for pointing me to the resources. Really helpful. My website isn’t that big, so I guess the crawl budget shouldn’t be an issue after all.

    As for duplicate content caused by titles, I have already implemented your advice. Thanks again @pcosta88 @devnihil and @mazedulislamkhan for being so helpful and patient with my questions.

Viewing 9 replies - 1 through 9 (of 9 total)
  • The topic ‘Adding “noindex, follow” tag to Paginated Pages’ is closed to new replies.