New name (All-IN Crawler & AI Agent Manager); your settings and data are kept. Removes the optional mu-plugin early loader (and deletes a leftover copy). Sanitization hardening. No database changes.<\/p>","1.1.1":"
Bundled bot list, no default remote feed, readme updates. No database changes.<\/p>","1.1.0":"
Adds IP-list verification for AI bots, server rules, email reports, llms.txt and Hebrew. No database changes.<\/p>","1.0.0":"
First release.<\/p>"},"ratings":[],"assets_icons":{"icon-128x128.png":{"filename":"icon-128x128.png","revision":3787299,"resolution":"128x128","location":"assets","locale":"","width":128,"height":128},"icon-256x256.png":{"filename":"icon-256x256.png","revision":3787299,"resolution":"256x256","location":"assets","locale":"","width":256,"height":256},"icon.svg":{"filename":"icon.svg","revision":3787299,"resolution":false,"location":"assets","locale":false}},"assets_banners":{"banner-1544x500-rtl.png":{"filename":"banner-1544x500-rtl.png","revision":3787299,"resolution":"1544x500","location":"assets","locale":"","width":1544,"height":500},"banner-1544x500.png":{"filename":"banner-1544x500.png","revision":3787299,"resolution":"1544x500","location":"assets","locale":"","width":1544,"height":500},"banner-772x250-rtl.png":{"filename":"banner-772x250-rtl.png","revision":3787299,"resolution":"772x250","location":"assets","locale":"","width":772,"height":250},"banner-772x250.png":{"filename":"banner-772x250.png","revision":3787299,"resolution":"772x250","location":"assets","locale":"","width":772,"height":250}},"assets_blueprints":{},"all_blocks":[],"tagged_versions":["1.2.0"],"block_files":[],"assets_screenshots":{"screenshot-1.png":{"filename":"screenshot-1.png","revision":3787299,"resolution":"1","location":"assets","locale":"","width":1440,"height":1340},"screenshot-2.png":{"filename":"screenshot-2.png","revision":3787299,"resolution":"2","location":"assets","locale":"","width":1440,"height":1500},"screenshot-3.png":{"filename":"screenshot-3.png","revision":3787299,"resolution":"3","location":"assets","locale":"","width":1440,"height":1298},"screenshot-4.png":{"filename":"screenshot-4.png","revision":3787299,"resolution":"4","location":"assets","locale":"","width":1440,"height":903},"screenshot-5.png":{"filename":"screenshot-5.png","revision":3787299,"resolution":"5","location":"assets","locale":"","width":1440,"height":1119}},"screenshots":{"1":"Dashboard with statistics per category and bot, server load and top denied IPs.","2":"Bot rules with one-click presets, category defaults and per-bot overrides.","3":"Protection settings: monitor or enforce mode, fake search-engine protection and server-load shedding.","4":"User-Agent tester and settings export \/ import.","5":"robots.txt management with a live preview of the added lines."}},"plugin_section":[],"plugin_tags":[232780,4866,9837,171765,12753],"plugin_category":[],"plugin_contributors":[291059],"plugin_business_model":[],"class_list":["post-398892","plugin","type-plugin","status-publish","hentry","plugin_tags-ai-crawler","plugin_tags-bots","plugin_tags-crawler","plugin_tags-rate-limit","plugin_tags-robots-txt","plugin_contributors-elis85","plugin_committers-elis85"],"banners":{"banner":"https:\/\/ps.w.org\/all-in-crawler-ai-agent-manager\/assets\/banner-772x250.png?rev=3787299","banner_2x":"https:\/\/ps.w.org\/all-in-crawler-ai-agent-manager\/assets\/banner-1544x500.png?rev=3787299","banner_rtl":false,"banner_2x_rtl":false},"icons":{"svg":"https:\/\/ps.w.org\/all-in-crawler-ai-agent-manager\/assets\/icon.svg?rev=3787299","icon":"https:\/\/ps.w.org\/all-in-crawler-ai-agent-manager\/assets\/icon.svg?rev=3787299","icon_2x":false,"generated":false},"screenshots":[{"src":"https:\/\/ps.w.org\/all-in-crawler-ai-agent-manager\/assets\/screenshot-1.png?rev=3787299","caption":"Dashboard with statistics per category and bot, server load and top denied IPs."},{"src":"https:\/\/ps.w.org\/all-in-crawler-ai-agent-manager\/assets\/screenshot-2.png?rev=3787299","caption":"Bot rules with one-click presets, category defaults and per-bot overrides."},{"src":"https:\/\/ps.w.org\/all-in-crawler-ai-agent-manager\/assets\/screenshot-3.png?rev=3787299","caption":"Protection settings: monitor or enforce mode, fake search-engine protection and server-load shedding."},{"src":"https:\/\/ps.w.org\/all-in-crawler-ai-agent-manager\/assets\/screenshot-4.png?rev=3787299","caption":"User-Agent tester and settings export \/ import."},{"src":"https:\/\/ps.w.org\/all-in-crawler-ai-agent-manager\/assets\/screenshot-5.png?rev=3787299","caption":"robots.txt management with a live preview of the added lines."}],"raw_content":"\n
Much of your traffic is bots. Some bring you customers: Google, Bing, ChatGPT search, social previews. Others only cost you server resources: aggressive AI training crawlers, SEO tools, scrapers and vulnerability scanners. All-IN Crawler & AI Agent Manager lets you decide, per category or per bot, who gets in and how fast, without hiding your site from search engines or AI assistants.<\/p>\n\n
Full documentation: see This plugin is complete on its own: no licence key, no locked features. Premium plugins, add-ons and support from the same developer are available at a-in.co.il<\/a>.<\/p>\n\n All-IN Crawler & AI Agent Manager works without any external service. These features contact third parties:<\/p>\n\n No, with the default configuration. Search engines are allowed and DNS-verified, and throttling uses 429\/503 with Retry-After, which search engines treat as \"come back later\".<\/p><\/dd>\n Yes. Apply the \"Protect content from AI training\" preset. AI search and assistant agents stay allowed.<\/p><\/dd>\n Not without blocking Google Search. AI Overviews use regular Googlebot. Google-Extended only controls Gemini training\/grounding use.<\/p><\/dd>\n No. It complements them. Large DDoS attacks must be stopped before they reach PHP.<\/p><\/dd>\n No. Out of the box it makes no outgoing requests: search engine bots are verified with DNS lookups through your own server's resolver. Two features can download data, and both are off until you turn them on in the Bot Lists tab: the official crawler IP lists (from Google, Bing, Apple, OpenAI and Perplexity) and a bot-list feed URL of your own. See \"External services\" below for exactly what is requested.<\/p><\/dd>\n OpenAI and Perplexity bots have no reverse DNS, so without their published IP lists All-IN Crawler & AI Agent Manager can't tell a real GPTBot or PerplexityBot from a scraper using the same name; they stay \"unverified\". With the lists on, a request claiming to be one of those bots from an unlisted IP is treated as an impostor. A list is only used while it is fresh (under 7 days old), so a failed download never blocks a genuine bot.<\/p><\/dd>\n Pages served from a full-page cache don't run WordPress, so All-IN Crawler & AI Agent Manager doesn't see them. Those requests are cheap anyway. Denials are sent with docs\/USER-MANUAL.md<\/code> (site owners) and docs\/DEVELOPER.md<\/code> (hooks & architecture).<\/p>\n\nMore from A-in<\/h4>\n\n
External services<\/h3>\n\n
\n
all-in-crawler-ai-agent-manager\/<version><\/code> User-Agent, so the publisher only sees your server's IP address. Untick the box to stop the downloads at any time. Sources:\n\n\n
https:\/\/developers.google.com\/static\/search\/apis\/ipranges\/<\/code> (Terms<\/a>, Privacy<\/a>)<\/li>\nhttps:\/\/www.bing.com\/toolbox\/bingbot.json<\/code> (Terms<\/a>, Privacy<\/a>)<\/li>\nhttps:\/\/search.developer.apple.com\/applebot.json<\/code> (Terms<\/a>, Privacy<\/a>)<\/li>\nhttps:\/\/openai.com\/gptbot.json<\/code>, searchbot.json<\/code>, chatgpt-user.json<\/code> (Terms<\/a>, Privacy<\/a>)<\/li>\nhttps:\/\/www.perplexity.com\/perplexitybot.json<\/code>, perplexity-user.json<\/code> (Terms<\/a>, Privacy<\/a>)<\/li>\n<\/ul><\/li>\ndata\/bots.json<\/code> and needs no download. If you enter a feed URL of your own (for example your agency's feed), the site requests that URL once a day, sending your site URL in the User-Agent and, if you set one, your access key as a Bearer token. There is no default remote feed.<\/li>\n\n
\n
Will this hurt my SEO?<\/h3><\/dt>\n
Can I block AI training but stay in ChatGPT \/ Claude \/ Perplexity answers?<\/h3><\/dt>\n
Can I block Google's AI Overviews?<\/h3><\/dt>\n
Does it replace Cloudflare or a server firewall?<\/h3><\/dt>\n
Does All-IN Crawler & AI Agent Manager contact any outside service by default?<\/h3><\/dt>\n
Why would I turn on the official crawler IP lists?<\/h3><\/dt>\n
Does a page cache bypass it?<\/h3><\/dt>\n
Cache-Control: no-store<\/code> and are never cached.<\/p><\/dd>\n\n<\/dl>\n\n\n1.2.0<\/h4>\n\n
\n
1.1.1<\/h4>\n\n
\n
data\/bots.json<\/code>) are bundled and always used; no network request is needed for them.<\/li>\n1.1.0<\/h4>\n\n
\n
1.0.0<\/h4>\n\n
\n