Hello @wppraesenz,
Thank you for contacting Rank Math support.
In Rank Math 404 Monitor, you can exclude paths generated by bots in the settings.
To do that, head over to Rank Math > General Settings > 404 Monitor > Exclude Paths.
Here’s a link for more information:
https://rankmath.com/kb/general-settings/#exclude-paths
Hope that helps.
Thread Starter
wpprup
(@wppraesenz)
Thanks, I will use this. Lazily, I hoped for a general simple option to tick to exclude them… 😉
Best wishes
Hello @wppraesenz,
Unfortunately, we don’t have those options to exclude the entries only from the bots. The exclusion is done exclusively from the place we mentioned.
Thank you.
Thread Starter
wpprup
(@wppraesenz)
Thanks for your reply, I understand that.
Now I tried to exclude them manually. I used “contains” and the terms “bot, crawler, bots, crawl, spider, YandexBot, IonCrawl, Googlebot, bingbot, robot” and none of them were excluded the next day.
I certainly emptied the website cache after excluding them.
Is this not enough to exclude them? What should I do?
Thanks again.
Hello @wppraesenz,
The exclusions only apply to URLs and not the type of user agents accessing the said URLs. You need to find what URLs are being accessed by bots and exclude those if you want.
Thank you.
Thread Starter
wpprup
(@wppraesenz)
Thanks. In my comprehension of the term “contains” it is enough to name containing parts of something, of URLs or everything else. A bit strange.
Hello @wppraesenz,
The “contains” feature currently only works for URLs, not user agents hence the option called Exclude Paths. You can check this guide to know how it works with URLs only: https://rankmath.com/kb/general-settings/#exclude-paths
Hope that helps.
