WordPress.org
Get WordPress
WordPress.org

Plugin Directory

Plugin Tag: crawler

Plugin Tag: crawler

  • Trackbase Analytics

    (0 total ratings)

    Official Trackbase Analytics plugin for WordPress. Add your tracking ID and enable server-side crawler analytics in minutes.

    trackbase 10+ active installations Tested with 7.0.4

  • GlobeSign Content Markdown Mirror

    (0 total ratings)

    Makes your WordPress site AI-friendly: generates llms.txt and clean, structured Markdown mirrors of every page and post.

    globesign 10+ active installations Tested with 7.0.4

  • Boring Cache Warmup Lite

    (2 total ratings)

    A lightweight, privacy-friendly WordPress cache warmup tool. No external services, no drama.

    chriskubisch 10+ active installations Tested with 7.1

  • GoBookMart Robots Editor

    (1 total ratings)

    A lightweight plugin to edit or create robots.txt directly from your WordPress dashboard. Developed by GoBookMart.

    Gobookmart 10+ active installations Tested with 6.9.7

  • JaspreetChahal’s wordpress bot detector lite

    (1 total ratings)

    This plugin detects a few bots (e.g. Google, Google ads, Alta vista etc) and sends an email based on interval set by you. you can choose what format e …

    Jaspreet Chahal 10+ active installations Tested with 4.2.39

  • SEObot Monitor for Googlebot, Bingbot and search engine spiders

    (0 total ratings)

    With SEObot Monitor for Googlebot you will be able to dump the server logs to Google Analytics, easily and automatically. This will allow you to dete …

    Santiago Alonso 10+ active installations Tested with 5.8.15

  • Page Modified

    (1 total ratings)

    Display the results of your Page Modified crawls right within your WordPress Admin.

    Chris Klosowski 10+ active installations Tested with 4.9.31

  • Robots.txt Extender

    (0 total ratings)

    Dynamic robots.txt for Multisite! Change parameters, or don't, for each site of your network without losing the defaults from WordPress Includes.

    bettoadami 10+ active installations Tested with 5.0.27

  • AI Kansoku Lab Tracker

    (0 total ratings)

    Track AI crawler visits such as GPTBot, ClaudeBot, and PerplexityBot server-side and visualize them in WordPress.

    AI Kansoku Lab Fewer than 10 active installations Tested with 7.0.4

  • AI Bot Monitor

    (0 total ratings)

    Tracks and logs AI, Search and Social bots including ChatGPT, Perplexity, Googlebot, Bing and Meta crawlers.

    straightdigital Fewer than 10 active installations Tested with 6.7.7

  • Spuncin

    (0 total ratings)

    Blocks AI crawlers that collect your content to train models. Search engines and link previews are never touched.

    spuncin Fewer than 10 active installations Tested with 7.0.4

  • GoVISIBLE AI Bot Tracker

    (0 total ratings)

    Track visits from AI bots like ChatGPT, GPTBot, Claude, Gemini, and Perplexity.

    GoVISIBLE Fewer than 10 active installations Tested with 7.0.4

  • ADG Markdown for AI Crawlers

    (0 total ratings)

    Serve AI crawlers clean Markdown of your content on the same URL, and auto-generate a virtual llms.txt / llms-full.txt. No external services.

    andyodua Fewer than 10 active installations Tested with 7.1

  • Zicy AI Access Monitor

    (0 total ratings)

    Monitor known AI crawlers and AI assistant fetches, with daily rollups, CSV exports, weekly summaries, and page briefs.

    zicygp Fewer than 10 active installations Tested with 7.0.4

  • AI Visibility Control – Dynamic llms.txt & robots.txt Crawler Control

    (0 total ratings)

    Manage AI crawler access. Block GPTBot, Claude & AI bots in robots.txt, generate dynamic llms.txt files, and track referral visits locally.

    Techbysh Fewer than 10 active installations Tested with 7.0.4

  • AI Crawler Guard

    (0 total ratings)

    Detect and control AI crawler access with local logging and history.

    aicrawlerguard.com Fewer than 10 active installations Tested with 6.9.7

  • BotObservatory – Live Bot Tracker & Anti-Scraper

    (1 total ratings)

    Observe human and machine traffic, identify suspicious automation, and optionally quarantine aggressive scrapers.

    traveliaq Fewer than 10 active installations Tested with 7.1

  • Virtual LLMS.TXT Generator

    (0 total ratings)

    Safely creates a virtual llms.txt dynamically. Features interactive bot targeting, map auto-syncing, and decoupled custom instructions.

    Alex Oreshkin Fewer than 10 active installations Tested with 7.0.4

  • URLs Most Wanted for LiteSpeed LScache

    (0 total ratings)

    A demand-driven sitemap for LiteSpeed Cache warmup. Record the URLs visitors actually use and warm only what people need.

    imedes Fewer than 10 active installations Tested with 7.1

  • Foundash AI Access Check

    (0 total ratings)

    Find out whether ChatGPT, Claude, Perplexity and Google's AI can actually read your website. Takes about ten seconds.

    boiledpotat0 Fewer than 10 active installations Tested with 7.1