Title: Search Results for “website crawler” | WordPress.org --- Search 350 plugins * [All](https://wordpress.org/plugins/search/website+crawler/) * [Community](https://wordpress.org/plugins/search/website+crawler/?plugin_business_model=community) * [Commercial](https://wordpress.org/plugins/search/website+crawler/?plugin_business_model=commercial) # Search results for: “website crawler” * ![](https://ps.w.org/website-llms-txt/assets/icon-256x256.png?rev=3322182) * ### 󠀁[Website LLMs.txt](https://wordpress.org/plugins/website-llms-txt/)󠁿 * (12 total ratings) * Automatically generate and manage LLMS.txt files for LLM/AI content understanding, with full Yoast SEO, Rank Math, SEOPress, and AIOSEO integration. * Ryan Howard 30,000+ active installations Tested with 6.9.4 * ![](https://ps.w.org/litespeed-cache/assets/icon-256x256.png?rev=2554181) * ### 󠀁[LiteSpeed Cache](https://wordpress.org/plugins/litespeed-cache/)󠁿 * (2,749 total ratings) * All-in-one unbeatable acceleration & PageSpeed improvement: caching, image/CSS/ JS optimization… * LiteSpeed Technologies 7+ million active installations Tested with 6.9.4 * ![](https://ps.w.org/wordpress-seo/assets/icon-256x256.gif?rev=3419908) * ### 󠀁[Yoast SEO – Advanced SEO with real-time guidance and built-in AI](https://wordpress.org/plugins/wordpress-seo/)󠁿 * (27,809 total ratings) * Improve your SEO with real-time feedback, schema, and clear guidance. Upgrade for AI tools, Google Docs integration, and 24/7 support, no hidden fees. * Yoast 10+ million active installations Tested with 7.0 * ![](https://ps.w.org/really-simple-ssl/assets/icon-256x256.png?rev=2839720) * ### 󠀁[Really Simple Security – Simple and Performant Security (formerly Really Simple SSL)](https://wordpress.org/plugins/really-simple-ssl/)󠁿 * (8,835 total ratings) * Easily improve site security with WordPress Hardening, Two-Factor Authentication( 2FA), Login Protection, Vulnerability Detection and SSL certificate. * Really Simple Plugins 3+ million active installations Tested with 7.0 * ![](https://ps.w.org/cleantalk-spam-protect/assets/icon-256x256.png?rev=1637702) * ### 󠀁[Anti Spam for Contact Forms, Comments & Online Stores – CleanTalk](https://wordpress.org/plugins/cleantalk-spam-protect/)󠁿 * (3,181 total ratings) * Top-rated anti spam protection for WordPress, eCommerce. Blocks spam on forms, comments and registrations automatically. No CAPTCHA. * CleanTalk Inc 200,000+ active installations Tested with 7.0 * ![](https://ps.w.org/crawler-record/assets/icon-256x256.png?rev=3362637) * ### 󠀁[Crawler Record](https://wordpress.org/plugins/crawler-record/)󠁿 * (1 total ratings) * Crawler Record tells you the last time each of the most common search/chat bots visited (Google, ChatGPT, etc)- and the pages at which they looked. * dizzysoft 70+ active installations Tested with 6.9.4 * ![](https://ps.w.org/website-monetization-by-magenet/assets/icon-256x256.jpg? rev=1630832) * ### 󠀁[Website Monetization by MageNet](https://wordpress.org/plugins/website-monetization-by-magenet/)󠁿 * (7 total ratings) * Get additional income from your website or blog by placing text ads automatically. * MageNet 20,000+ active installations Tested with 6.8.5 * ![](https://ps.w.org/wordfence/assets/icon.svg?rev=2070865) * ### 󠀁[Wordfence Security – Firewall, Malware Scan, and Login Security](https://wordpress.org/plugins/wordfence/)󠁿 * (4,907 total ratings) * Firewall, Malware Scanner, Two Factor Auth, and Comprehensive Security Features, powered by our 24-hour team. Make security a priority with Wordfence. * Mark Maunder 5+ million active installations Tested with 7.0 * ![](https://ps.w.org/gptranslate/assets/icon-128x128.gif?rev=3462052) * ### 󠀁[GPTranslate – Multilingual AI Translation for WordPress: Automatically Translate Websites](https://wordpress.org/plugins/gptranslate/)󠁿 * (25 total ratings) * Featured by WPTuts. Next-generation AI translation plugin to automatically translate WordPress websites in minutes with multilingual SEO AI Agents. * JExtensions Store 400+ active installations Tested with 7.0 * ![](https://ps.w.org/dark-visitors/assets/icon.svg?rev=3468118) * ### 󠀁[Known Agents – Track AI Bots and Crawlers, Block Scrapers, Analyze LLM Referral Traffic](https://wordpress.org/plugins/dark-visitors/)󠁿 * (6 total ratings) * Track crawlers, scrapers, LLM assistants, and AI agents on your website. Generate a robots.txt that blocks AI bots. Formerly Dark Visitors. * Known Agents 1,000+ active installations Tested with 6.9.4 * ![](https://ps.w.org/llm-bot-tracker-by-hueston/assets/icon-256x256.png?rev=3366013) * ### 󠀁[LLM Bot Tracker – AI Crawler Detection & Analytics](https://wordpress.org/plugins/llm-bot-tracker-by-hueston/)󠁿 * (1 total ratings) * Automatically track ChatGPT, Claude, Perplexity & 56 AI bots crawling your WordPress site. Monitor AI search engine visits, detect AI web scrapers … * Hueston 600+ active installations Tested with 6.8.5 * ![](https://ps.w.org/bot-traffic-shield/assets/icon-256x256.png?rev=3384323) * ### 󠀁[Bot Traffic Shield – Block Bad Bots and Stop AI Bots Crawlers](https://wordpress.org/plugins/bot-traffic-shield/)󠁿 * (2 total ratings) * A powerful and user-friendly plugin to block AI crawlers and malicious data scraper bots, protecting your content and server resources. * Delower Hossain 400+ active installations Tested with 6.8.5 * ![](https://ps.w.org/wp-seopress/assets/icon-128x128.gif?rev=3158903) * ### 󠀁[SEOPress – AI SEO Plugin & On-site SEO](https://wordpress.org/plugins/wp-seopress/)󠁿 * (1,229 total ratings) * WordPress SEO plugin with AI SEO metadata, schema, XML sitemap, redirections & Search Console. Privacy-first, white-label SEO. Now AI-ready. * Benjamin Denis 300,000+ active installations Tested with 6.9.4 * ![](https://ps.w.org/advanced-ads/assets/icon-256x256.gif?rev=2773443) * ### 󠀁[Advanced Ads – Ad Manager & AdSense](https://wordpress.org/plugins/advanced-ads/)󠁿 * (1,461 total ratings) * The only complete toolkit for all ad types. Grow your revenue with AdSense, Amazon— or any affiliate network. Get pinpoint targeting and best support! * monetizemore 100,000+ active installations Tested with 6.9.4 * ![](https://ps.w.org/autodescription/assets/icon.svg?rev=3000376) * ### 󠀁[The SEO Framework – Fast, Automated, Effortless.](https://wordpress.org/plugins/autodescription/)󠁿 * (376 total ratings) * The fastest feature-complete SEO plugin for professional WordPress websites. Secure, fast, unbranded, and automated SEO. Do less; get better results. * Sybre Waaijer 200,000+ active installations Tested with 6.9.4 * ![](https://ps.w.org/better-robots-txt/assets/icon-256x256.png?rev=1941286) * ### 󠀁[Better Robots.txt – AI-Ready Crawl Control & Bot Governance](https://wordpress.org/plugins/better-robots-txt/)󠁿 * (102 total ratings) * Replace the default WordPress robots.txt workflow with a smarter, structured version you can preview before publishing, with Free, Pro, and Premium ed … * Pagup 6,000+ active installations Tested with 6.9.4 * ![](https://ps.w.org/wordpress-protection/assets/icon-256x256.png?rev=1006111) * ### 󠀁[eDarpan: Website Protection](https://wordpress.org/plugins/wordpress-protection/)󠁿 * (5 total ratings) * The most complete website protection plugin for WordPress. Block IPs, disable right-click, prevent copy-paste, block countries, stop spam comments, an … * Chris Hudson 200+ active installations Tested with 6.9.4 * ![](https://ps.w.org/independent-analytics/assets/icon.svg?rev=3504049) * ### 󠀁[Independent Analytics – WordPress Analytics Plugin](https://wordpress.org/plugins/independent-analytics/)󠁿 * (161 total ratings) * A simple, yet powerful WordPress analytics plugin that gives you privacy-friendly stats to grow your website. A Google Analytics alternative. * Ben Sibley 100,000+ active installations Tested with 7.0 * ![](https://ps.w.org/vigia/assets/icon-256x256.png?rev=3431036) * ### 󠀁[VigIA – AI Visibility, Analytics & Control](https://wordpress.org/plugins/vigia/)󠁿 * (13 total ratings) * Monitor 55+ AI crawlers, control access via robots.txt, and boost your AI visibility with llms.txt, JSON-LD, Markdown for Agents & Visibility Score. * Fernando Tellado 1,000+ active installations Tested with 7.0 * ![](https://ps.w.org/adrotate/assets/icon-256x256.gif?rev=3117289) * ### 󠀁[AdRotate Banner Manager](https://wordpress.org/plugins/adrotate/)󠁿 * (651 total ratings) * Easily manage, and schedule ads on your WordPress site with AdRotate. Support for Google AdSense, Amazon, and custom banners. Start monetizing today! * Arnan 20,000+ active installations Tested with 7.0 ## Posts pagination 1 [2](https://wordpress.org/plugins/search/website+crawler/page/2/?output_format=md)… [18](https://wordpress.org/plugins/search/website+crawler/page/18/?output_format=md) [Next](https://wordpress.org/plugins/search/website+crawler/page/2/?output_format=md)