{"id":18992401,"date":"2026-08-13T10:45:14","date_gmt":"2026-08-13T10:45:14","guid":{"rendered":"https:\/\/wordpress.org\/support\/topic\/robots-txt-y-llms\/"},"modified":"2026-08-13T10:45:14","modified_gmt":"2026-08-13T10:45:14","slug":"robots-txt-y-llms","status":"publish","type":"topic","link":"https:\/\/wordpress.org\/support\/topic\/robots-txt-y-llms\/","title":{"rendered":"Robots.txt y LLMs"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\">Hola,<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Uso el plugin VigIA y quer\u00eda  una recomendaci\u00f3n tras detectar un error al analizar el sitio con <strong>PageSpeed Insights<\/strong> (informe de Rastreo e Indexaci\u00f3n) y con el validador de robots.txt de <strong>Search Console<\/strong>.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><code>LLMs:<\/code> y <code>LLMs-full:<\/code> no son directivas v\u00e1lidas del est\u00e1ndar robots.txt (RFC 9309). Las \u00fanicas directivas reconocidas son <code>User-agent<\/code>, <code>Disallow<\/code>, <code>Allow<\/code>, <code>Sitemap<\/code> y, de forma no est\u00e1ndar, <code>Crawl-delay<\/code>. Por eso tanto PageSpeed Insights como el validador de Search Console marcan el archivo como <strong>no v\u00e1lido<\/strong>, con el error &#8220;Unknown directive&#8221; en esas dos l\u00edneas.<br \/><br \/>Recomiendan desactivarlas del robots?<\/p>\n","protected":false},"template":"","class_list":["post-18992401","topic","type-topic","status-publish","hentry"],"jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/wordpress.org\/support\/wp-json\/wp\/v2\/topic\/18992401","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/wordpress.org\/support\/wp-json\/wp\/v2\/topic"}],"about":[{"href":"https:\/\/wordpress.org\/support\/wp-json\/wp\/v2\/types\/topic"}],"version-history":[{"count":0,"href":"https:\/\/wordpress.org\/support\/wp-json\/wp\/v2\/topic\/18992401\/revisions"}],"wp:attachment":[{"href":"https:\/\/wordpress.org\/support\/wp-json\/wp\/v2\/media?parent=18992401"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}