Disable filter links for crawlers

Detailed Review: “Disable filter links for crawlers” – A Game-Changer for Crawl Budget & SEO Efficiency

I wanted to leave a detailed breakdown of the new “Disable filter links for crawlers” feature, as it addresses one of the most critical structural problems for large WooCommerce stores and high-facet catalogs.

1. The Problem It Solves
   In typical WooCommerce stores using faceted navigation, every filter combination generates a distinct URL. Even if these pages have dynamic noindex tags, or lack active SEO rules, standard crawlers (Googlebot, Bingbot, and modern AI bots/crawlers) still see physical links on every page.

They follow every AND / OR combination endlessly. In my case, this created an inflation of 700,000+ garbage URLs queued for crawling. While these pages offered zero SEO value, crawlers spent massive amounts of resources scanning them, draining the site’s overall crawl budget and putting unnecessary stress on the database.

2. How This Feature Works
   When enabled, the plugin intelligently alters how filter elements are presented to search bots and AI crawlers versus real users:

For real visitors: Seamless UX remains identical. Navigation, AJAX loading, and filtering work without any compromise.

For search crawlers:

Only URLs with active, custom SEO rules (index, follow) remain as crawlable standard HTML links ().

Deep junction links (AND/OR logic) and index-restricted pages without SEO rules no longer contain crawlable href targets for bots.

3. Key Benefits & Real-World Impact
   Crawl Budget Optimization: Googlebot stops wasting request quotas on low-value/no-index filter pages.

Faster Indexation of Key Pages: Search engines divert 100% of their scanning capacity toward high-value landing pages, active SEO filter pages, and main product categories.

Database & Server Load Reduction: Prevents continuous background execution of heavy SQL queries triggered whenever bots hit complex non-indexed filter URLs.

Clean Search Engine Diagnostics: Prevents Google Search Console from bloating with hundreds of thousands of URLs under the “Excluded by ‘noindex’ tag” report, keeping your indexing reports clear, actionable, and manageable.

Summary
This feature turns Filter Everything from a basic AJAX filtering tool into an enterprise-grade SEO platform for WooCommerce. If you manage a site with hundreds or thousands of products and attributes, enabling “Disable filter links for crawlers” is an absolute must. Highly recommended!