WordPress.org
Get WordPress
WordPress.org

Plugin Directory

Search results for: “website crawler”

350 plugins

Search results for: “website crawler”

  • NinjaFirewall (WP Edition) – Advanced Security Plugin and Firewall

    (219 total ratings)

    A true Web Application Firewall to protect and secure WordPress.

    nintechnet 100,000+ active installations Tested with 7.0

  • Age Gate

    (64 total ratings)

    A plugin to check the age of a visitor before view site or specified content

    Phil 40,000+ active installations Tested with 6.8.5

  • IP2Location Country Blocker

    (124 total ratings)

    Blocks unwanted visitors from accessing your frontend (blog pages) or backend (admin area) by countries or proxy servers.

    IP2Location 30,000+ active installations Tested with 6.9.4

  • LexonRank: AI Link Building, Free Backlinks & SEO Automation

    (31 total ratings)

    Automate your SEO with contextual backlinks from 3M+ articles. Boost rankings and grow organic traffic with this automated link building tool.

    bundgaard 1,000+ active installations Tested with 7.0.0

  • Pressidium Cookie Consent

    (38 total ratings)

    Lightweight, user-friendly and customizable cookie consent banner to help you comply with the EU GDPR cookie law and CCPA regulations.

    pressidium 10,000+ active installations Tested with 6.9.4

  • No-Bot Registration

    (27 total ratings)

    Prevent bots from creating accounts by blacklisting domains and usernames and present people with a human friendly security question.

    Arnan 2,000+ active installations Tested with 6.9.4

  • BotBlocker Security – Firewall & Bot Protection

    (9 total ratings)

    Protect your WordPress site: firewall, bot & brute-force protection, anti-spam, multi-layer CAPTCHA, optional cloud threat intel.

    Yevhen Leonidov 3,000+ active installations Tested with 6.9.4

  • LovedByAI – Generative Engine Optimization, AI Search, GEO, AEO

    (6 total ratings)

    Drive more traffic from AI search and LLMs like ChatGPT and Gemini. Optimize your WordPress site for AI crawlers without changing content or code.

    LovedByAI 500+ active installations Tested with 7.0

  • Sitemap by BestWebSoft – WordPress XML Site Map Page Generator Plugin

    (115 total ratings)

    Generate and add XML sitemap to WordPress website. Help search engines index your blog.

    bestwebsoft 20,000+ active installations Tested with 7.0

  • AI Content Signals

    (3 total ratings)

    Control how AI crawlers use your content with Cloudflare Content Signals in robots.txt. Includes EU Directive 2019/790 rights reservation.

    Fernando Tellado 500+ active installations Tested with 7.0

  • IP Location Block

    (33 total ratings)

    Easily block visitors by country, state or ISP provider. Also, protects your site from spam, login attempts, malicious access & more.

    Darko G. 10,000+ active installations Tested with 7.0

  • Block Archive.org via WordPress robots.txt

    (0 total ratings)

    Blocks the archive.org bots through the WordPress virtual robots.txt file.

    apasionados 500+ active installations Tested with 6.9.4

  • Bisteinoff SEO Robots.txt

    (4 total ratings)

    An easy-to-use plugin that generates and configures a proper robots.txt file, essential for effective search engine optimization (SEO).

    Denis Bisteinov 500+ active installations Tested with 6.9.4

  • WP Scraper

    (23 total ratings)

    This Wordpress Scraper allows you to move a non-Wordpress website into a Wordpress site.

    Rico Macchi 2,000+ active installations Tested with 6.9.4

  • Admin and Site Enhancements (ASE)

    (412 total ratings)

    Duplicate post, post order, image resize, email via SMTP, admin menu editor, custom css / code, disable gutenberg and much more in a single plugin.

    Bowo 200,000+ active installations Tested with 6.9.4

  • SEO Repair Kit – Meta Manager, Schema Manager, SEO Content Monitoring, GSC Integration, Keyword & Rank Tracking

    (2 total ratings)

    The ultimate WordPress plugin for SEO automation – from link fixing to AI-powered schema generation and chatbot support.

    TorontoDigits 2,000+ active installations Tested with 6.9.4

  • consentmanager Cookie Banner

    (10 total ratings)

    The consentmanager Cookie Banner and Cookie Notice allows you to easily collect cookie consent from your website visitors, ensuring GDPR compliance.

    consentmanager Cookie Banner 5,000+ active installations Tested with 6.9.4