• Resolved JDTravel

    (@jdtravel)


    Hi,
    Pages set to NoIndex are appearing in the XML sitemap, noindex pages should not appear in the XML sitemap as it causes unwanted crawling by the web crawlers.
    There is an option to exclude individual pages from the xml sitemap but this should be automatic for noindex pages. Please can this issue be investigated.
    Thanks.

Viewing 12 replies - 1 through 12 (of 12 total)
  • Plugin Support Md Mazedul Islam Khan

    (@mazedulislamkhan)

    By default, Yoast SEO automatically excludes noindex URLs from the sitemaps. However, if the noindex URLs are appearing on your site, please refer to our this knowledge base guide to troubleshoot this issue.

    Thread Starter JDTravel

    (@jdtravel)

    URLs still appear in the XML sitemap if the Override setting for post types In Titles and Metas is set to Noindex.
    Therefore for each individual post

    If set to ‘Index’ it will appear in the XML Sitemap
    If set to ‘NoIndex’ it will not appear in the XML Sitemap
    But
    If the ‘Default for post type is set to NoIndex’ it will appear in the XML Sitemap.
    This should not happen, please can this be corrected.
    Thanks

    Thread Starter JDTravel

    (@jdtravel)

    Hi
    Just wondered if this is being investigated and whether this is something that I could highlight in Github, although I’m not a coding expert 🙂
    I’ve checked the html code for pages that have ‘Noindex’ set and can’t see any difference from pages that have the setting ‘Default for this post type, currently: noindex’. But pages with the former set are excluded from the sitemap while with the latter set are included.

    Thread Starter JDTravel

    (@jdtravel)

    Hi, I was disappointed that Version 6.0 did not fix this issue, please can I have some feedback please.

    Plugin Support Md Mazedul Islam Khan

    (@mazedulislamkhan)

    Based on the information you provided, we expect this to be a bug. We’re actively using the bug tracking on our GitHub repository so your best next step would be to create a new issue for our developers at https://github.com/Yoast/wordpress-seo/issues/new. You will need an account to create a new issue. If this is your first bug report, please check out: https://kb.yoast.com/kb/how-to-write-a-good-bug-report/.

    Don’t forget to include the URL to this conversation in your bug report.

    Plugin Support Jerlyn

    (@jerparx)

    Closed due to inactivity.

    Thread Starter JDTravel

    (@jdtravel)

    Thread Starter JDTravel

    (@jdtravel)

    Hi please could this be reopened and set back to unresolved as this is still an issue and awaiting action on github.
    https://github.com/Yoast/wordpress-seo/issues/8618

    Thanks

    • This reply was modified 6 years, 3 months ago by JDTravel.
    • This reply was modified 6 years, 3 months ago by JDTravel.
    • This reply was modified 6 years, 3 months ago by JDTravel.
    Thread Starter JDTravel

    (@jdtravel)

    This issue is now being flagged as an error in Googles New Search Console (Beta). I’ve flagged this on the following github issue:
    https://github.com/Yoast/wordpress-seo/issues/6237

    Hi all,

    This topic is the best one I’ve found so far about no-index and sitemap.xml

    I’m trying to understand why if I set a page to: “Default for post type, currently: noindex”, the page appears in the sitemap.xml file

    However, if I change it to “noindex”, it is removed from the sitemap file.

    What’s the difference between default noindex and manual noindex?

    Thread Starter JDTravel

    (@jdtravel)

    Hi dprusak,
    I never understood the reasoning for the setting “Default for post type, currently: noindex”. But it seems that Yoast have aknowledged this and have removed it from the latest version. Now there is just Index and NoIndex, Great News!!!

    • This reply was modified 6 years, 2 months ago by JDTravel.

    I saw that in the beta release. That does removing the confusion around that issue. 🙂

    Now I’m trying to figure out how to no-index the entire site except for a handful of pages we’d set to index at the page level. In the beta, if you disable the entire site, you cannot index any page, however, the opposite works (index the entire site, then no-index at the page level). Of the 4000 pages we have, we only want to index, maybe, 20 of them.

    Looking into using some sort of add_filter to achieve this so the sitemap.xml doesn’t cause errors for google.

Viewing 12 replies - 1 through 12 (of 12 total)
  • The topic ‘Exclude NoIndex Pages From XML Sitemap’ is closed to new replies.