• Resolved uronpen

    (@uronpen)


    How to generate the llms-full.txt file, and how to resolve the problem of the generated llms.txt file being too large due to an excessive number of posts on the website?

Viewing 1 replies (of 1 total)
  • Plugin Author Ryan Howard

    (@ryhowa)

    Hi Uronpen,

    Thanks for using the plugin!

    At one time, we did support llms-full.txt, but it was causing issues. We also do not have strong indications that llms are looking at llms-full.txt. I have tried hundreds of tests from the gpt user agent and can’t get it to access llms-full.txt. Seems that there is a security block. Additionally there were a couple of instances reported by users that created a llms-full.txt, submitted it to search console, got it indexed, and that resulted in their main pages on the site being dropped from the index as Google saw it as duplicate content.

    For llms.txt on all sites (especially large ones) we recommend reducing the frequency of updates and reducing the maximum number of posts per type and words per summary in the plugin settings.

    Let me know if you have additional questions. Thanks!

Viewing 1 replies (of 1 total)

You must be logged in to reply to this topic.