Title: Bravo Crawl Hunter – Block AI Crawlers, Spam Bots & Protect Content Author: Jumedeen khan Published: September 11, 2026 Last modified: September 11, 2026 --- Search plugins ![](https://ps.w.org/bravo-crawl-hunter/assets/banner-772x250.png?rev=3691513) ![](https://ps.w.org/bravo-crawl-hunter/assets/icon-256x256.png?rev=3691513) # Bravo Crawl Hunter – Block AI Crawlers, Spam Bots & Protect Content By [Jumedeen khan](https://profiles.wordpress.org/jumedeenkhan/) [Download](https://downloads.wordpress.org/plugin/bravo-crawl-hunter.1.0.0.zip) * [Details](https://wordpress.org/plugins/bravo-crawl-hunter/#description) * [Reviews](https://wordpress.org/plugins/bravo-crawl-hunter/#reviews) * [Installation](https://wordpress.org/plugins/bravo-crawl-hunter/#installation) * [Development](https://wordpress.org/plugins/bravo-crawl-hunter/#developers) [Support](https://wordpress.org/support/plugin/bravo-crawl-hunter/) ## Description Bravo Crawl Hunter helps you **block AI crawlers**, **AI scrapers**, **spam bots**,** unwanted bots**, and other **automated crawlers** from your WordPress site. Choose which known bots to allow or block, and decide whether they are asked politely through robots.txt or denied outright with an HTTP 403 response. You can also **monitor and review crawler activity** from the **Bravo Crawl Hunter >> Dashboard** menu in your WordPress dashboard. The plugin provides detailed crawler activity, including **total requests, blocked requests, top crawlers, most targeted pages, and crawler categories**. Every crawler the plugin knows about comes from a curated registry organized by purpose, so you can understand what a bot is used for before deciding how to handle it. #### 🤖 Block AI crawlers and scrapers Bravo Crawl Hunter includes a curated registry of AI crawlers, scrapers, AI assistants, and AI search bots from major AI companies and services. AI Crawler bots are blocked by default, while AI assistants and AI search bots can be selected individually. You can block selected bots using robots.txt rules, or HTTP 403 hard blocking. You can also add custom User-Agent strings when a bot or scraper is not included in the built-in registry. #### 🐺 A curated crawler registry More than 75 known crawlers ship with the plugin, grouped into seven categories: * **AI Crawler** – Crawlers that collect content for AI-related purposes, including GPTBot, CCBot, ClaudeBot, and Bytespider. * **AI Assistant** – On-demand fetchers behind assistants and chat features, such as ChatGPT-User and Claude-User. * **AI Search** – Crawlers used by AI-powered search and answer services. * **Search Engine Crawler** – Traditional search engine crawlers such as Googlebot, Bingbot, and DuckDuckBot. * **SEO Tool** – Crawlers used by third-party SEO analysis and ranking tools, including AhrefsBot and SemrushBot. * **Archiver** – Crawlers used by web archiving services. * **Other Crawler** – Other recognized automated traffic, such as monitoring services and link-preview bots. Only the AI Crawler category is blocked out of the box. Search engines, SEO tools, archivers, and other crawlers stay untouched until you opt in, so search visibility never changes without your explicit choice. #### 🛡️ Two ways to control access * **robots.txt rules** – Publishes Disallow rules for the crawlers you select. Well-behaved bots honor them, though not every bot does. * **Hard block (403)** – Returns an HTTP 403 response when a selected crawler reaches WordPress, whether or not it follows robots.txt. The two methods are independent. Use either one, or both together, from **Settings General Settings**. #### 🔗 Covers WordPress content endpoints Hard blocking applies to front-end requests as well as WordPress REST API and XML- RPC requests, helping prevent selected crawlers from accessing your content through alternate WordPress endpoints. #### ⚙️ Custom User-Agents Bots and scrapers that are not in the registry can be blocked by adding their User- Agent string under **Settings General Settings**. Up to 50 entries are supported, each matched anywhere in the incoming User-Agent header and case-insensitively, and enforced with the same protection methods as the registry. #### 🚀 Works with caching and CDNs Server-side detection runs when a request reaches WordPress. A page served entirely from a server cache, caching plugin, or CDN may never reach WordPress, so it cannot be classified that way. For those requests, the optional **JavaScript Detection** feature records known crawlers that load a cached page containing the plugin’s lightweight detection script. It is disabled by default and can be enabled from **Settings General Settings**. #### 📊 Dashboard The dashboard summarizes crawler activity over the date range you pick: * Total, blocked, allowed, and unknown requests, plus the number of crawlers seen. * Activity trends across the selected range. * A breakdown by individual crawler and by crawler category. * The pages receiving the most blocked crawler requests. * Recent crawler activity. #### 📋 Crawler Logs The Crawler Logs screen is a searchable, filterable, paginated history of classified requests. Each entry records the time, crawler, path, action, and user agent. Logging is on by default and can be switched off under **Settings General Settings**; dashboard totals and charts keep updating either way. Log retention is capped by a maximum entry count under **Settings Advanced**, and the oldest entries are removed first. #### 💾 Export, import, and data on uninstall Settings can be exported to a JSON file and imported back, to keep a backup or move a configuration to another site, from **Settings Advanced**. The same screen lets you reset everything to the recommended defaults, and choose whether settings, logs, and stats are kept or removed if the plugin is deleted. ## Screenshots [⌊Dashboard — crawler request totals, trends, activity, and crawler breakdown.⌉⌊ Dashboard — crawler request totals, trends, activity, and crawler breakdown.⌉[ Dashboard — crawler request totals, trends, activity, and crawler breakdown. [⌊Settings, General Settings — protection methods, JavaScript Detection, logging, and custom User-Agents.⌉⌊Settings, General Settings — protection methods, JavaScript Detection, logging, and custom User-Agents.⌉[ Settings, General Settings — protection methods, JavaScript Detection, logging, and custom User-Agents. [⌊Settings, AI Bots Protection — the crawler registry with per-bot selection.⌉⌊Settings, AI Bots Protection — the crawler registry with per-bot selection.⌉[ Settings, AI Bots Protection — the crawler registry with per-bot selection. [⌊Settings, Search Engines, SEO tools, archiver and other crawlers.⌉⌊Settings, Search Engines, SEO tools, archiver and other crawlers.⌉[ Settings, Search Engines, SEO tools, archiver and other crawlers. [⌊Crawler Logs — searchable and filterable crawler request history.⌉⌊Crawler Logs— searchable and filterable crawler request history.⌉[ Crawler Logs — searchable and filterable crawler request history. ## Installation 1. Upload the `bravo-crawl-hunter` folder to `/wp-content/plugins/`, or install the plugin through the WordPress plugins screen. 2. Activate the plugin. 3. Open **Bravo Crawl Hunter** from the WordPress admin menu. 4. Review the crawler settings and choose which bots to block or allow. ## FAQ ### Does robots.txt block every bot? No. robots.txt only provides instructions, and a crawler is free to ignore them. Enable **Hard block (403)** under **Settings General Settings** for a response that is enforced when a selected crawler reaches WordPress. ### Will this block search engines like Googlebot or Bingbot? Not by default. Search engine crawlers and archivers are part of the registry but are never blocked unless you select them yourself under **Settings Search Engines& Others**. ### I use a caching plugin, server cache, or CDN. Will the plugin still work? Server-side detection works whenever a request reaches WordPress. Because a fully cached page may not reach WordPress at all, you can enable **JavaScript Detection** under **Settings General Settings** to record known crawlers that load cached pages containing the detection script. ### Where can I see crawler activity? The Dashboard gives you the overview, and **Crawler Logs** lets you search and filter individual classified requests. ### Does logging affect performance or database size over time? Logs are pruned automatically against the maximum entry count you set, so stored log data stays within that limit. Logging can also be turned off entirely while keeping dashboard totals. ### Does the plugin send any data to an external service? No. Crawler settings, logs, and statistics are stored in your own WordPress database, and the plugin makes no outbound requests to third-party services. ### Can I block AI crawlers and AI scrapers? Yes. Bravo Crawl Hunter includes a curated registry of AI crawlers and scrapers. You can select the crawlers you want to block and use robots.txt rules, HTTP 403 hard blocking, or both. ### Can I block a bot that is not in the crawler registry? Yes. You can add a custom User-Agent string under Settings General Settings. Custom User-Agents can be blocked using the same protection methods as the built-in crawler registry. ## Reviews There are no reviews for this plugin. ## Contributors & Developers “Bravo Crawl Hunter – Block AI Crawlers, Spam Bots & Protect Content” is open source software. The following people have contributed to this plugin. Contributors * [ Jumedeen khan ](https://profiles.wordpress.org/jumedeenkhan/) [Translate “Bravo Crawl Hunter – Block AI Crawlers, Spam Bots & Protect Content” into your language.](https://translate.wordpress.org/projects/wp-plugins/bravo-crawl-hunter) ### Interested in development? [Browse the code](https://plugins.trac.wordpress.org/browser/bravo-crawl-hunter/), check out the [SVN repository](https://plugins.svn.wordpress.org/bravo-crawl-hunter/), or subscribe to the [development log](https://plugins.trac.wordpress.org/log/bravo-crawl-hunter/) by [RSS](https://plugins.trac.wordpress.org/log/bravo-crawl-hunter/?limit=100&mode=stop_on_copy&format=rss). ## Changelog #### 1.0.0 * Initial release. ## Meta * Version **1.0.0** * Last updated **16 hours ago** * Active installations **Fewer than 10** * WordPress version ** 6.8 or higher ** * Tested up to **7.1** * PHP version ** 7.4 or higher ** * Tags * [AI](https://wordpress.org/plugins/tags/ai/)[ai bots](https://wordpress.org/plugins/tags/ai-bots/) [ai-crawler](https://wordpress.org/plugins/tags/ai-crawler/)[block bots](https://wordpress.org/plugins/tags/block-bots/) [spam-bots](https://wordpress.org/plugins/tags/spam-bots/) * [Advanced View](https://wordpress.org/plugins/bravo-crawl-hunter/advanced/) ## Ratings No reviews have been submitted yet. [Your review](https://wordpress.org/support/plugin/bravo-crawl-hunter/reviews/#new-post) [See all reviews](https://wordpress.org/support/plugin/bravo-crawl-hunter/reviews/) ## Contributors * [ Jumedeen khan ](https://profiles.wordpress.org/jumedeenkhan/) ## Support Got something to say? Need help? [View support forum](https://wordpress.org/support/plugin/bravo-crawl-hunter/) ## Donate Would you like to support the advancement of this plugin? [ Donate to this plugin ](https://buymeacoffee.com/jumedeenkhan)