Bots scanning multiple category combinations, slowing server
-
Our server access logs show that bots/LLM, etc.. are hitting our server hard and scanning combinations of [many] categories together, i.e.
GET /browse/filter_tags-fowl-or-lactation-or-national-veterinary-benevolent-and-mutual-benevolent-defence-society-or-scab-or-specimen/
This is not typical of a normal user interaction for our site, resulting in potentially millions of combinations of results pages. Many of the combinations are nonsensical for a typical user.
Is there any way to limit the number of concurrent category/tag combinations in Filter Everything Pro? I believe that implementing a limit would relieve the load on our server.
Many thanks,
Anthony
The topic ‘Bots scanning multiple category combinations, slowing server’ is closed to new replies.