Clustova LLMs.txt – Markdown Generator

Description

This plugin generates and serves llms.txt and llms-full.txt files according to the official specification at https://llmstxt.org/. It also provides clean Markdown (.md) versions of your content at the same URL (for example /your-post.md) and includes a bulk export tool.

It does not write any static files to your server. All output is generated on demand with caching.

Key Features

  • Virtual llms.txt and llms-full.txt endpoints.
  • Optional .md endpoints for individual posts, pages, and public custom post types (including WooCommerce products when the ‘product’ post type is enabled).
  • Per-post controls: include or exclude content and add custom notes via the post editor metabox.
  • Respects noindex settings and can use meta descriptions from popular SEO plugins (Yoast, Rank Math, SEOPress, and similar).
  • Bulk export of published content as a ZIP archive containing one .md file per item (with YAML frontmatter).
  • Admin settings page with live preview, cache regeneration, and rewrite rule flushing.
  • WP-CLI commands for generation and export.

All content is produced from your WordPress database. No data is sent to external services. Generation uses internal caching.

Configuration

The settings page offers four main areas:

  • LLMs.txt Config: Choose which public post types to include (supports standard posts, pages, and custom post types such as WooCommerce products), set max items per section, override the site description, add preamble text or extra custom sections.
  • Markdown & Endpoints: Toggle public .md serving, control frontmatter fields.
  • Export Tool: Generate and download a complete ZIP archive of your content as clean .md files (with frontmatter).
  • Advanced: Regenerate cache, flush rewrites, view current generated output live in the admin preview panel.

Per-post settings appear in a metabox on the edit screen for supported post types.

Usage

llms.txt and llms-full.txt:
– The plugin serves the files at the root of your site (e.g. https://yoursite.com/llms.txt).
– These files follow the structure defined at https://llmstxt.org/.

.md endpoints:
– Append .md to a public post, page, or custom post type URL (for example WooCommerce product URLs like /product/your-product.md) to receive a Markdown version.
– The output includes YAML frontmatter (title, date, modified, taxonomies, custom notes when present).

Bulk export:
– Use the Export Tool in the plugin settings or the WP-CLI command to download a ZIP containing .md files for selected post types.

WP-CLI (when available):
wp clustova llms generate
wp clustova export markdown --zip

See the plugin settings page for live preview and one-click actions.

Installation

  1. Upload the clustova-llms-txt-markdown-generator folder to the /wp-content/plugins/ directory, or install via the WordPress Plugins screen.
  2. Activate the plugin through the ‘Plugins’ menu in WordPress.
  3. Go to Settings > Clustova LLMs.txt to configure included post types, limits, custom text, and more.
  4. Visit https://yoursite.com/llms.txt and https://yoursite.com/llms-full.txt to see the results.
  5. (Optional) Enable Markdown endpoints and test https://yoursite.com/your-post-slug.md.

After activation, visit Settings > Permalinks and click Save Changes (this is required for the rewrite rules to take effect, especially on subdirectory installs like /wordpress/). You can also use the “Flush Rewrite Rules” button in the plugin’s Advanced tab.

FAQ

What is llms.txt?

llms.txt is a standardized Markdown file defined at https://llmstxt.org/. It is intended to be placed at the root of a website and provides a structured summary of the site’s content for consumption by large language models.

How to add llms.txt to WordPress?

Install Clustova LLMs.txt & Markdown Generator, activate it, and go to Settings > Clustova LLMs.txt. The file is served automatically at yourdomain.com/llms.txt. No manual file uploads required.

How is this plugin different from other llms.txt generators?

Features provided by this plugin include:
– A metabox on individual posts/pages for per-item inclusion control and custom notes.
– Public .md endpoints (in addition to the llms.txt files).
– Bulk export of content as a ZIP of .md files that include YAML frontmatter.
– Awareness of noindex and meta description data from several popular SEO plugins.
– Virtual serving (no physical files are created on disk).
– WP-CLI commands for generation and export.

What is llms.txt intended to do?

llms.txt is a proposed standard (https://llmstxt.org/) for providing a concise, structured overview of a website’s content in Markdown format. The goal is to help large language models understand the site structure and important pages more reliably than HTML crawling alone.

How do I generate Markdown from WordPress posts?

When .md endpoints are enabled, appending .md to a public post URL returns a Markdown version of that post. The admin area also provides a bulk ZIP export and per-post download links.

Does it work with Yoast SEO, Rank Math, or SEOPress?

The plugin checks for noindex directives from supported SEO plugins and can use their meta description fields when available. You can disable this behavior in the settings.

Can I customize the content that appears in my llms.txt file?

Yes. Choose which post types to include, set limits per section, add custom preamble text or extra sections, and override descriptions on individual posts via the metabox.

What is the difference between llms.txt and llms-full.txt?

llms.txt is the shorter, primary file. llms-full.txt includes longer excerpts from the selected content. You can enable or disable either file independently in the settings.

Is any of my content sent to external services?

No. Everything is generated locally on your WordPress server. Your data never leaves your site.

Reviews

There are no reviews for this plugin.

Contributors & Developers

“Clustova LLMs.txt – Markdown Generator” is open source software. The following people have contributed to this plugin.

Contributors

Changelog

1.0.9

  • Added mention of WooCommerce product support (.md endpoints and bulk export work for the ‘product’ post type when enabled in Included Post Types settings).
  • Updated relevant sections in Description, Key Features, Usage, and Configuration for clarity.

1.0.8

  • Major UI/UX refactor to match the parent Clustova AI Writer plugin’s card-based layout and component styles for consistent branding.
  • Converted settings forms to use .aiw-card, .aiw-field, and related components (matching parent’s flat design).
  • Added dashicons to tabs, improved headers, and applied full violet color scheme, fonts, borders, and spacing throughout the admin pages.
  • Version 1.0.7 changes included initial violet palette application.

1.0.6

  • Revised readme.txt and plugin header description to remove promotional language, comparative claims (“best”, “AI prefers”, “LLMs love”, “actually read”, etc.), and marketing-style wording per WordPress.org plugin review feedback.
  • Focused description, FAQ, and usage sections on factual functionality, configuration steps, and how to use the features.
  • Bumped version per mandatory project rule.

1.0.5

  • Refined $_POST['post_types'] handling in the admin export form (handle_export_form) to inline sanitize_key sanitization. This resolves the final WordPress.Security.ValidatedSanitizedInput.InputNotSanitized warning reported by Plugin Check.
  • Bumped version per mandatory project rule (use official version.sh script + update Changelog on every change).

1.0.4

  • Fixed Plugin Check (WP.org) errors: corrected Text Domain to exactly match the plugin slug (clustova-llms-txt-markdown-generator) in the main plugin header, CLST_TEXT_DOMAIN constant, and every translation function call across admin and exporter classes.
  • Updated internal admin settings page slug and related links for full consistency with the plugin slug.
  • Fixed multiple WordPress.Security.ValidatedSanitizedInput.InputNotSanitized warnings (properly sanitize $_POST nonces and post_types, and $_SERVER['HTTP_X_WP_NONCE'] before use in verify_nonce).
  • Replaced discouraged unlink() calls with wp_delete_file() in the Markdown ZIP exporter. Added compliant handling + phpcs ignore for the controlled readfile() streaming of the generated temporary ZIP before deletion.
  • Prefixed all top-level variables in uninstall.php ($clst_*) and added matching phpcs:disable comments for the direct database queries used only during plugin uninstall cleanup.
  • Shortened the plugin “Short Description” in readme.txt to comply with the 150 character limit.
  • Fixed outdated folder name reference in Installation instructions.
  • Bumped version per mandatory project rule (use official version.sh script + update Changelog on every change).

1.0.3

  • SEO-optimized readme.txt for better visibility in WordPress.org search and plugin directory (stronger keywords around llms.txt, llms txt generator, markdown for wordpress, ai content optimization, etc.).
  • Improved short description, description section, and FAQ with high-intent search terms while staying 100% compliant with WP.org rules.
  • Updated screenshots captions for better SEO.

1.0.2

  • Added comprehensive PHPDoc comments to all classes, methods, and files for professional code quality (required for wp.org uploads from this account).
  • Reinforced in skill that directory name + main .php file must exactly match the plugin slug derived from Plugin Name.
  • Bumped version per the mandatory “update version on every change + add PHPDocs” rule now saved in the wordpress-plugin-dev skill.

1.0.1

  • Fixed Plugin Check errors (updated “Tested up to” to current WP version, added proper ABSPATH guard in class-cli.php)
  • Improved rewrite flushing with flush_rewrite_rules( true ) (hard flush) in activation and admin button for better reliability, especially on subdirectory installs (e.g. /wordpress/)
  • Updated installation instructions to emphasize visiting Settings > Permalinks > Save Changes after activation
  • Always increment version on any code changes going forward (per project rule)

1.0.0

  • Initial release
  • Virtual /llms.txt and /llms-full.txt serving with spec-compliant formatting and caching
  • Public .md endpoints for posts, pages and public CPTs
  • Professional pure-PHP Markdown converter with YAML frontmatter
  • Full site Markdown ZIP export
  • Per-post metabox + list table integration
  • Live admin preview, regenerate, and settings with full security (nonces, capabilities, sanitization, escaping)
  • WP-CLI commands
  • Follows WordPress Plugin Directory guidelines and coding standards