Description
Kennedy Site Scout prepares your WordPress site to be read, indexed, and cited by AI systems — including ChatGPT, Claude, Perplexity, Gemini, and 20+ other crawlers.
What it does
- Generates
/llms.txt,/llms-full.txt, and/llms-sitemap.xmldynamically from your published content — no physical files written to disk - Logs AI crawler visits across every page of your site, not just the LLM files
- Detects 25+ known AI bots including GPTBot, ClaudeBot, Anthropic-AI, PerplexityBot, Meta ExternalAgent, Cohere AI, ByteSpider, AmazonBot, and more
- Respects Yoast SEO and Rank Math noindex settings — excluded content stays excluded
- Dashboard widget with bot visit stats, summary pills, settings, and one-click regeneration
- Auto-regenerates on publish and on a configurable cron schedule
Free tier
- Up to 100 pages indexed
- 200 log entries stored
- 80-word content excerpts in llms-full.txt
- All core features
Pro tier
- Unlimited pages indexed
- 5,000 log entries
- CSV export of crawler logs
- 300-word content excerpts
- Image tags in llms-sitemap.xml
- Tag data included in LLM files
Why llms.txt?
The emerging llms.txt standard gives AI systems a clean, structured entry point to your site’s content — similar to what robots.txt did for search engines. This plugin automates generating and maintaining that file.
External Services
This plugin connects to an external license verification service operated by Kennedy Media Group. This service is used solely to validate Pro license keys entered by users who have purchased a Pro upgrade.
What data is sent and when:
The license verification endpoint is only contacted when a site administrator manually enters a license key in the plugin’s dashboard widget and clicks “Activate”. At that point, the plugin sends:
- The license key entered by the administrator
- The home URL of the WordPress installation (e.g. https://example.com)
No personal data, user data, post content, or any other site information is transmitted. The free version of the plugin never contacts this service.
Service details:
* Provider: Kennedy Media Group
* Endpoint: https://kennedymedia.com/wp-json/kssr-license/v1/verify
* Terms of Service: https://kennedymedia.com/terms/
* Privacy Policy: https://kennedymedia.com/privacy/
This plugin does not connect to any other external services. All LLM file generation and AI crawler logging happens entirely on your own server.
Screenshots
Installation
- Upload the
kennedy-site-scoutfolder to/wp-content/plugins/ - Activate via the Plugins menu in WordPress
- Go to your Dashboard — find the Kennedy Site Scout widget
- Click Regenerate Now to build your LLM files
- Verify:
https://yoursite.com/llms.txt
Note: If the LLM file URLs return 404, go to Settings > Permalinks > Save Changes to flush rewrite rules.
FAQ
-
Why aren’t any crawlers showing up in the logs?
-
Earlier versions of this plugin only logged bots when they visited the /llms.txt endpoint directly. v2.0 fixes this — bots are now logged on every page they visit. Make sure you are running v2.0 or later and that your site is live and public.
-
Does this create physical files on my server?
-
No. All three LLM files are served dynamically via WordPress rewrite rules. No files are written to your filesystem.
-
Will this conflict with my existing sitemap plugin?
-
No. The llms-sitemap.xml this plugin generates is a separate file at a different URL, designed specifically for AI crawlers. It does not replace your standard XML sitemap.
-
Does this work with WooCommerce?
-
Yes. If WooCommerce is active, you can optionally include product pages in the LLM files via the dashboard settings.
-
How does Pro licensing work?
-
Pro is sold as an annual subscription. After purchase you receive a license key by email. Enter it in the dashboard widget to unlock Pro features on that site. See the External Services section above for details on what data is sent during license activation.
Reviews
There are no reviews for this plugin.
Contributors & Developers
“Kennedy Site Scout” is open source software. The following people have contributed to this plugin.
Contributors
Translate “Kennedy Site Scout” into your language.
Interested in development?
Browse the code, check out the SVN repository, or subscribe to the development log by RSS.
Changelog
2.1.0
- Moved admin CSS and JS to external enqueued files (admin.css, admin.js) for WP.org compliance
- Added External Services documentation to readme.txt
- Used wp_localize_script for all translatable JS strings
2.0.0
- BUG FIX: AI crawlers now logged on ALL front-end page requests, not just LLM file hits
- Added 20+ new bot signatures (PerplexityBot, Anthropic-AI, Meta ExternalAgent, Cohere AI, ByteSpider, AmazonBot, Mistral AI, HuggingFaceBot, and more)
- Refactored into separate class files
- Added Pro tier with license activation/deactivation
- CSV export of crawler logs (Pro)
- Full i18n / translation-ready
1.0.4
- Initial release as AI Site Scout