WordPress.org
Get WordPress
WordPress.org

Plugin Directory

Search results for: “site crawler”

751 plugins

Search results for: “site crawler”

  • Robots.txt Extender

    (0 total ratings)

    Dynamic robots.txt for Multisite! Change parameters, or don't, for each site of your network without losing the defaults from WordPress Includes.

    bettoadami 10+ active installations Tested with 5.0.25

  • Site visitor Information

    (1 total ratings)

    Block Visitor to Access the Website and Redirects visitors to a predefined URL using IP address.

    usmanaltafwp Fewer than 10 active installations Tested with 4.9.29

  • SEO Defend

    (3 total ratings)

    Ongoing protection and monitoring of your Wordpress website and domain against negative SEO, black hat SEO techniques and bad SEOs.

    SEO Defend 30+ active installations Tested with 5.5.18

  • AnyComment

    (156 total ratings)

    AnyComment is blazing-fast commenting plugin based on React for WordPress.

    Alexander 5,000+ active installations Tested with 5.9.13

  • Log-Hero.com Plugin

    (1 total ratings)

    Analyze how search engines and other bots crawl and understand your web page. The official PHP Wordpress plugin for log-hero.com.

    Log Hero 20+ active installations Tested with 4.9.29

  • Purge BlackHat SEO

    (0 total ratings)

    This plugin will scan through all your posts and pages purging any malicious black-hat SEO infection

    EazyServer 10+ active installations

  • Robots.txt rewrite

    (2 total ratings)

    Provide the easy managment of your robots.txt from admin side. It propose you the advanced then standard robots.txt content too.

    Eugen Bobrowski 1,000+ active installations Tested with 4.7.33

  • IP Ban

    (9 total ratings)

    Simple IP Ban is a lightweight ip / user agent ban plugin.

    Sandor Kovacs 2,000+ active installations Tested with 4.7.33

  • Meta News & Standout tag

    (1 total ratings)

    This tags are necessary if your blog or news website has been included to Google News.

    Condence 20+ active installations Tested with 4.7.33

  • Stats for WP

    (0 total ratings)

    When users view your site, we will log user ID, view pages, referrers URL, user IP, user agent, … and so on, to admin you understand how users worki …

    statsforwp Fewer than 10 active installations Tested with 4.9.29

  • Turn on Blog Privacy

    (0 total ratings)

    Globally alters the site visibility settings to "Ask search engines not to index this site" when enabled. Upon deactivation it selects &quot …

    Ben Lobaugh (blobaugh) 10+ active installations Tested with 4.8.28

  • LH Add Headers

    (0 total ratings)

    Adds the ETag, Last-Modified, and if appropriate 304 headers to HTTP responses generated by WordPress for more efficient caching.

    shawfactor 10+ active installations Tested with 4.8.28

  • Robots Meta Whiz

    (0 total ratings)

    Easy way to discourage search engines from indexing only specific pages / posts with custom meta tags.

    Marat Nepomnyashy 100+ active installations Tested with 4.7.33

  • WP-SPA

    (0 total ratings)

    Enables animations between page transitions.

    khalidhoffman Fewer than 10 active installations Tested with 4.7.33

  • Offline Pages

    (0 total ratings)

    This plugin allows you to download and cache entire WordPress site locally on Mac or iOS device, then browse the local site while offline.

    offlinepages 20+ active installations Tested with 4.4.34

  • BuddyPress Sitemap Generator

    (0 total ratings)

    This plugin will generate a sitemapindex and various component sitemap xml files for search engines and indexing of BuddyPress

    rich! @ etiviti 20+ active installations

  • LTI SEO

    (3 total ratings)

    In an effort to remain as lightweight as possible, LTI SEO will only add metadata information to the html header of your pages (the data won't be …

    LTI 40+ active installations Tested with 4.4.34

  • XML Sitemap for Stella

    (1 total ratings)

    Generates a XML Sitemap on your WordPress multi-language website when powered by Stella multi-language plugin.

    luistinygod 10+ active installations Tested with 4.0.38

  • JaspreetChahal’s wordpress bot detector lite

    (1 total ratings)

    This plugin detects a few bots (e.g. Google, Google ads, Alta vista etc) and sends an email based on interval set by you. you can choose what format e …

    Jaspreet Chahal 10+ active installations Tested with 4.2.39