Description
Msite AI Crawler Monitor shows you how AI engines treat your website.
Bot statistics
- Logs visits from known AI crawlers: GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, Claude-SearchBot, Claude-User, PerplexityBot, Perplexity-User, Google-Extended, GoogleOther, Bytespider, Amazonbot and Meta’s external agent.
- Separates learning scans (crawlers that build an index or training set) from real-time queries (requests sent the moment a person asks an AI a question).
- Period filter (7 days, 30 days, 3 months, year, all time), per-bot table, donut charts and the top pages visited by bots.
AI Health check
Checks your live site for the basics AI engines rely on: HTTPS, robots.txt (and whether it blocks AI bots), XML sitemap, search-engine visibility setting, llms.txt, Schema JSON-LD and canonical tag. Each check is shown as a traffic-light card with a short explanation.
Pro add-on (separate, optional)
A separate Pro add-on adds an AI-readable content layer (Quick Facts, FAQ, schema), FAQ drafting with your own AI API key, Google Analytics 4 AI referrals and a readiness score. It is a different plugin, licensed personally for now. This plugin works fully without it and contains none of its code.
Hebrew first
The plugin is fully translatable (Hebrew translation is available through translate.wordpress.org) and uses logical CSS so it looks right in both RTL and LTR admin screens.
External services
This plugin does not send data to any external service. The AI Health check only makes HTTP requests to your own site (home page, robots.txt, sitemap and llms.txt). Links shown next to check results (for example to Google’s documentation) are plain links that open only when you click them.
Privacy
The plugin stores only a daily counter per bot and page (date, bot name, post ID, number of visits). It does not store IP addresses or full user-agent strings, and it does not log logged-in users.
Bots are recognised by the name in their User-Agent header, which any client can fake, so treat the numbers as indicative.
Third-party libraries
- Chart.js 4.5.1 (MIT License), bundled locally in
assets/vendor/. Source: https://www.chartjs.org
Installation
- Upload the plugin to
/wp-content/plugins/or install it from the Plugins screen. - Activate it.
- Open Msite AI Crawler Monitor in the admin menu. Statistics start collecting from activation.
FAQ
-
Why do I see no data yet?
-
Bots visit at their own pace. Statistics start from activation. If your site is served from a full-page cache, a visit answered by the cache never reaches WordPress and cannot be counted.
-
Does a “real-time query” mean someone clicked my link?
-
No. It means the AI engine fetched your page to build an answer. It does not prove a link was shown or clicked.
-
Does it slow my site down?
-
Logging runs only for requests from known AI bots and is a single small database write.
-
I used the earlier “airc” build.
-
Deactivate it first. The existing statistics table is reused, so your history is kept.
-
Is my data deleted when I delete the plugin?
-
No. Statistics are kept by default. To remove everything on uninstall, add
define( 'AIRC_REMOVE_DATA_ON_UNINSTALL', true );to wp-config.php before deleting the plugin.
Reviews
There are no reviews for this plugin.
Contributors & Developers
“Msite AI Crawler Monitor” is open source software. The following people have contributed to this plugin.
Contributors
Translate “Msite AI Crawler Monitor” into your language.
Interested in development?
Browse the code, check out the SVN repository, or subscribe to the development log by RSS.
Changelog
0.5.5
- Uninstall keeps your statistics unless AIRC_REMOVE_DATA_ON_UNINSTALL is defined.
- The statistics table is recreated automatically if it is missing.
0.5.4
- Plugin header: removed duplicate Plugin URI.
0.5.3
- Readme: contributor username.
0.5.2
- Code style fix in AI Health.
0.5.1
- Readme: updated “Tested up to”.
0.5.0
- First public release: bot statistics and AI Health check. The Pro features moved to a separate add-on.