No: ‘noindex’ detected in ‘X-Robots-Tag’ http header

  • caila2jarrett

    (@caila2jarrett)


    3 years, 1 month ago

    I am getting an error message on Google Search Console stating “url is not on google.” page indexing “page is not indexed: excluded by ‘noindex’ tag.” In my WordPress admin, I have unchecked discourage search engines from indexing. in the SEO program I’m using All in one SEO it is allowing the pages to be indexed and the robots.txt is showing

    User-agent: *

    Allow: /wp-admin/admin-ajax.php

    Disallow: /wp-admin/

    Sitemap: https://www.healthandmom.com/sitemap.xml

    Sitemap: https://www.healthandmom.com/sitemap.rss

    I am not sure what else to do and would appreciate any help I can get. Thank you

    The page I need help with: [log in to see the link]

Viewing 9 replies - 1 through 9 (of 9 total)
  • Moderator threadi

    (@threadi)

    3 years, 1 month ago

    I can’t understand Google’s message either. Your page has no indexing block. Or do you mean a specific subpage?

    George Appiah

    (@gappiah)

    3 years, 1 month ago

    The 3 feed URLs provided in the post above all have x-robots-tag: noindex, follow in the HTTP response header. You can see this using the Network tab of your browser’s developer tool.

    This is likely coming from the Nginx web server, not WordPress.

    Thread Starter caila2jarrett

    (@caila2jarrett)

    3 years, 1 month ago

    How am I able to fix this and remove the header?

    George Appiah

    (@gappiah)

    3 years, 1 month ago

    For an easy fix, try: https://wordpress.org/plugins/http-headers/

    Alternatively, dig into your Nngix webserver’s config for this domain and comment out any line this: add_header X-Robots-Tag "noindex, follow";.

    Thread Starter caila2jarrett

    (@caila2jarrett)

    3 years, 1 month ago

    will this remove the no index, no follow issues?

    Moderator threadi

    (@threadi)

    3 years, 1 month ago

    I still don’t see such HTTP header at your site. Also the source code as well as the robots.txt is ok from my point of view. Therefore, I see no need for action at the moment. Ask Google to check the page again so that their systems recognize it.

    George Appiah

    (@gappiah)

    3 years, 1 month ago

    threadi: You’re probably checking the public website. It’s not the public site itself, but the specific sitemap and RSS feed URLs given in the post.

    caila2jarrett:

    will this remove the no index, no follow issues?

    The plugin should, in theory. And it would probably have taken you less time to try it and know for sure, than posting to ask if the suggested solution will solve your problem 😀

    Editing your web sever’s config should absolutely solve the problem. But only if you know what you’re doing. It’s unfortunately not possible for anyone here to help you with that. Contact your host if you need help doing this.

    George Appiah

    (@gappiah)

    3 years, 1 month ago

    @caila2jarrett: Please note that, and I think this is what threadi was getting at (but I was too dumb to understand 😀 ), this header shouldn’t stop Google from indexing your site.

    It’s just these specific URLs — /sitemap.xml, /sitemap.rss and /feed/ that won’t be indexed.

    And, thinking about it, you probably ONLY want search engines to FOLLOW the links in these URLs, but NOT index them. Which is exactly what your server/site is doing.

    So, yes, there’s really no problem to solve here after all 😀

    And sorry to both of you for the confusion I must have created. Back into my mancave!

    Thread Starter caila2jarrett

    (@caila2jarrett)

    3 years, 1 month ago

    Ah okay so this is okay and I don’t need to change anything? Sorry I am very new to this and just want to make sure I am doing the right thing

Viewing 9 replies - 1 through 9 (of 9 total)

The topic ‘No: ‘noindex’ detected in ‘X-Robots-Tag’ http header’ is closed to new replies.