Hello @fesupportteam and @sybydesign
I am writing here to enlighten and to give my 5 cents on the issue, as I have had the same problem.
I have had the similiar experience with attacks/bots/crawlers. I have been trying to figure out what the issue has been for a long time. I suspected early, by the URL request, that it might have had something to do with the filter. Long story short, it was.
My CPU was constantly at 100% and the server had a hard time to cope with all the incomming hits on the various different URL filter searches. The bots/crawlers tried every combination that the filter had as options. The more filter options you had, the longer the URL. The bot/crawler kept calling them over and over.
Here is an example of two of the URLs:
“and/or” is the key here, it tries everything. Every combination of category, subcategory and brand,
- /butikk/k-fiber-special-care-or-hest-or-hover-tilskudd/me-trm/
- /butikk/k-diverse-and-elektrolytter-and-fiber-special-care-and-luftveier-and-pelspleie-and-strigleutstyr-and-tilskudd/
My first solution was to deactivate Filter Everything – waited a few days and checked back on the server. Problem still existed because the server now had to handle the 404.
My second solution was to block all the IPs at the server level. That’s a process worth nothing in the long run. New IPs pop up with small adjustments at the end of the IP.
Here is an overview over 404 status codes the last 24h:
Status Code: 404
Request Count: 102256
That’s quite many hits on 404. Not every hit is related to the filter, but 99% is.
To fight off the incomming requests I added a rewrite rule in the .htaccess:
There are more rules, but I exclusevely just pasted the one for this topic. The rule is placed as high as possible in .htaccess.
<IfModule mod_rewrite.c>
RewriteEngine On
RewriteRule ^butikk/k- - [R=404,L]
</IfModule>
This stops every URL-request that has “butikk/k-” before it hits wordpress and thus keeping the CPU idle for actuall work. Yes, it also stops real users to use the exact filter. This must be adjusted over time to make sure it doesn’t affect real users.
My CPU is now down at 14%.
Hope this insight helps.