Title: sibi84's Replies | WordPress.org --- # sibi84 [ ](https://wordpress.org/support/users/sibi84/) * [Profile](https://wordpress.org/support/users/sibi84/) * [Topics Started](https://wordpress.org/support/users/sibi84/topics/) * [Replies Created](https://wordpress.org/support/users/sibi84/replies/) * [Reviews Written](https://wordpress.org/support/users/sibi84/reviews/) * [Topics Replied To](https://wordpress.org/support/users/sibi84/replied-to/) * [Engagements](https://wordpress.org/support/users/sibi84/engagements/) * [Favorites](https://wordpress.org/support/users/sibi84/favorites/) Search replies: ## Forum Replies Created Viewing 8 replies - 1 through 8 (of 8 total) * Forum: [Plugins](https://wordpress.org/support/forum/plugins-and-hacks/) In reply to: [[Yoast SEO - Advanced SEO with real-time guidance and built-in AI] ‘noindex’ detected in the ‘robots’ meta tag”](https://wordpress.org/support/topic/noindex-detected-in-the-robots-meta-tag-10/) * Thread Starter [sibi84](https://wordpress.org/support/users/sibi84/) * (@sibi84) * [1 year, 10 months ago](https://wordpress.org/support/topic/noindex-detected-in-the-robots-meta-tag-10/#post-17870241) * thank you very much, I replaced the file and fixed the problem on the site. As for the indexing problems I hope the modified robots file will help us, I already set to retry the indexing validation, we will see what happens * Thanks again for everything you have been very kind * Forum: [Plugins](https://wordpress.org/support/forum/plugins-and-hacks/) In reply to: [[Yoast SEO - Advanced SEO with real-time guidance and built-in AI] ‘noindex’ detected in the ‘robots’ meta tag”](https://wordpress.org/support/topic/noindex-detected-in-the-robots-meta-tag-10/) * Thread Starter [sibi84](https://wordpress.org/support/users/sibi84/) * (@sibi84) * [1 year, 10 months ago](https://wordpress.org/support/topic/noindex-detected-in-the-robots-meta-tag-10/#post-17868086) * ps: line 10 of the header.php file is this: * ” > * Forum: [Plugins](https://wordpress.org/support/forum/plugins-and-hacks/) In reply to: [[Yoast SEO - Advanced SEO with real-time guidance and built-in AI] ‘noindex’ detected in the ‘robots’ meta tag”](https://wordpress.org/support/topic/noindex-detected-in-the-robots-meta-tag-10/) * Thread Starter [sibi84](https://wordpress.org/support/users/sibi84/) * (@sibi84) * [1 year, 10 months ago](https://wordpress.org/support/topic/noindex-detected-in-the-robots-meta-tag-10/#post-17868081) * I added the lines in the code as per your advice, thank you. I went searching on the web for how to disable archive dates as per your advice and found this article: [https://vielhuber.de/it/blog/disattivare-le-pagine-archivio-wordpress/](https://vielhuber.de/it/blog/disattivare-le-pagine-archivio-wordpress/) * so I added this code: * set_404(); status_header(404);nocache_headers();}}add_action(‘template_redirect’,‘ disable_uneeded_archives’); * but now everything has disappeared from the site on the products page and also news, I have tried re-inserting the menu (which was a link to the articles with the given category ‘products’ and ‘news’ but still nothing can be seen on the two pages of the site. * [https://val-tec.it/category/prodotti/](https://val-tec.it/category/prodotti/) [https://val-tec.it/category/news/](https://val-tec.it/category/news/) * I’ve tried going back into functions.php to remove the lines inserted above but it tells me this: * Your changes to the PHP code were cancelled due to an error on line 10 of the file wp-content/themes/oceanwp/header.php. Please correct and try saving again. * Error not detected: Call to undefined function oceanwp_html_classes() in wp-content/ themes/oceanwp/header.php:10 Stack trace: 0 wp-includes/template.php(810): require_once() 1 wp-includes/template.php(745): load_template() 2 wp-includes/general-template. php(48): locate_template() 3 wp-content/themes/oceanwp/page.php(12): get_header() 4 wp-includes/template-loader.php(106): include(‘…’) 5 wp-blog-header.php(19): require_once(‘…’) 6 index.php(17): require(‘…’) 7 {main} * launched * What have I done???? probably the code I found on that site caused me an error… but I don’t know how to fix it, I don’t know if perhaps it was better to keep the error of archives rather than having this problem. Can you help me overcome it?Thank you very much * Forum: [Plugins](https://wordpress.org/support/forum/plugins-and-hacks/) In reply to: [[Yoast SEO - Advanced SEO with real-time guidance and built-in AI] ‘noindex’ detected in the ‘robots’ meta tag”](https://wordpress.org/support/topic/noindex-detected-in-the-robots-meta-tag-10/) * Thread Starter [sibi84](https://wordpress.org/support/users/sibi84/) * (@sibi84) * [1 year, 10 months ago](https://wordpress.org/support/topic/noindex-detected-in-the-robots-meta-tag-10/#post-17865210) * Hello [@maybellyne](https://wordpress.org/support/users/maybellyne/), first of all: thanks so much for the reply. The block for indexing concerns 88 pages, of which: - 19 blocked by robots.txt - 37 excluded by the ‘noindex’ tag - 25 Page scanned but not currently indexed * Should I put the code block you sent me in the robots.txt file deleting everything else, or in a specific place? Sorry, but I really don’t know anything about code. * Here are some examples of links to pages I have blocked by robots (most are pdfs of data sheets of our products): * [https://val-tec.it/wp-content/uploads/2023/03/scheda-power-cool-180-evans.pdf](https://val-tec.it/wp-content/uploads/2023/03/scheda-power-cool-180-evans.pdf) * [https://val-tec.it/wp-content/uploads/2024/05/Vestas-Wind-Turbine-Gearbox-Lube-Oil.pdf](https://val-tec.it/wp-content/uploads/2024/05/Vestas-Wind-Turbine-Gearbox-Lube-Oil.pdf) * Instead, here are some examples of links to pages that I have excluded based on the “noindex” tag: * [https://val-tec.it/2023/10/12/](https://val-tec.it/2023/10/12/) * [https://val-tec.it/2024/06/13/](https://val-tec.it/2024/06/13/) * The strange thing about these is that I do not have any articles on the site where I have left the date as the permalink, I have set it as a setting that there is always the title of the page as the permalink so in reality I do not know why these pages with the date as the permalink were created. * Thank you so much for the advice you are giving me, I really appreciate it * Forum: [Plugins](https://wordpress.org/support/forum/plugins-and-hacks/) In reply to: [[Yoast SEO - Advanced SEO with real-time guidance and built-in AI] ‘noindex’ detected in the ‘robots’ meta tag”](https://wordpress.org/support/topic/noindex-detected-in-the-robots-meta-tag-10/) * Thread Starter [sibi84](https://wordpress.org/support/users/sibi84/) * (@sibi84) * [1 year, 10 months ago](https://wordpress.org/support/topic/noindex-detected-in-the-robots-meta-tag-10/#post-17862758) * update: I went into the Yoast SEO tools and found the robots.txt file, this is what it says in the file: * User-agent: DomainCrawler Disallow: / * User-agent: SemrushBot Disallow: / * User-agent: AhrefsBot Disallow: / * User-agent: * Disallow: /_.jpg Disallow: /_.JPGDisallow: /_.png Disallow: /_. PDFDisallow: /_.pdf Disallow: /_.mp3Disallow: /_.MOV Disallow: /_.movDisallow:/_. avi Disallow: /_.aviDisallow: /_.csv Disallow: /_.dataCrawl-delay: 2 * Can anyone tell me if there is any error to correct? Because I’ve noticed that most of the pages on my site blocked by robots are links to pdf example [https://val-tec.it/wp-content/uploads/2023/03/scheda-power-cool-180-evans.pdf](https://val-tec.it/wp-content/uploads/2023/03/scheda-power-cool-180-evans.pdf) * Forum: [Themes and Templates](https://wordpress.org/support/forum/themes-and-templates/) In reply to: [[OceanWP] “noindex” in the robots tag that blocks indexing by search engines](https://wordpress.org/support/topic/noindex-in-the-robots-tag-that-blocks-indexing-by-search-engines/) * Thread Starter [sibi84](https://wordpress.org/support/users/sibi84/) * (@sibi84) * [1 year, 10 months ago](https://wordpress.org/support/topic/noindex-in-the-robots-tag-that-blocks-indexing-by-search-engines/#post-17860487) * Thank you very much for your support, I tried asking in the yoast seo plugin forum, let’s see what they say. * Thanks again * Forum: [Themes and Templates](https://wordpress.org/support/forum/themes-and-templates/) In reply to: [[OceanWP] “noindex” in the robots tag that blocks indexing by search engines](https://wordpress.org/support/topic/noindex-in-the-robots-tag-that-blocks-indexing-by-search-engines/) * Thread Starter [sibi84](https://wordpress.org/support/users/sibi84/) * (@sibi84) * [1 year, 10 months ago](https://wordpress.org/support/topic/noindex-in-the-robots-tag-that-blocks-indexing-by-search-engines/#post-17853621) * Good morning Unfortunately, the problem is not solved. I tried to redo the indexing request but it tells me that the problem could not be solved. if I go to the list of non-indexed pages and open one at random I get this: * Page indexing Page is not indexed: Excluded based on “noindex” tag DetectionSitemap No referral sitemap detectedReferral page. [https://val-tec.it/filtri-di-processo-filtration-group/](https://val-tec.it/filtri-di-processo-filtration-group/) Scan. Last scan. 7 May 2024, 07:07:56Scan performed by Googlebot for smartphoneScan allowed? YesPage retrieval SuccessfulIndexing allowed? No: ‘noindex’ detected in ‘robots’ meta tagIndexing User-reported canonical content NoneCanonical content selected by Google: URL checkedI don’t know what to do anymoreSibi * Forum: [Themes and Templates](https://wordpress.org/support/forum/themes-and-templates/) In reply to: [[OceanWP] “noindex” in the robots tag that blocks indexing by search engines](https://wordpress.org/support/topic/noindex-in-the-robots-tag-that-blocks-indexing-by-search-engines/) * Thread Starter [sibi84](https://wordpress.org/support/users/sibi84/) * (@sibi84) * [1 year, 11 months ago](https://wordpress.org/support/topic/noindex-in-the-robots-tag-that-blocks-indexing-by-search-engines/#post-17838043) * Hello Shahin, Thank you very much for the clarification. I looked in the various settings of the site but as I suspected I already had the correct settings, I also looked in the theme settings, and finally I looked for the advanced settings of yoast seo, and there I checked all the recommended or recommended things, and indeed there were things I had not checked.I tried again from Google search console to request the indexing of the unindexed pages and now unlike before it tells me that the request has been sent, so I’m hoping that I’ll get confirmation that the problem has been resolved shortly.I thank you so much for your help, the topic is very broad and for a non-IT like me I really didn’t know where to“ hit my head” * Thanks so much Sibi Viewing 8 replies - 1 through 8 (of 8 total)