Adding exclusions to reduce false positive 404s

  • Resolved ozzymuppet

    (@ozzymuppet)


    7 years, 10 months ago

    Hi Aaron

    I hope you are doing well. Just an idea… can you consider adding the ability to exclude particular urls? Today I got 400+ “Captured 404s”, around 50% which are not legit 404s they’re internal processes and plugins such as Autoptimize, and PHP functions of mine that pieces the content together.

    Screenshot attached.

    If there was a box when I could enter URLs which can always be ignored (no action or log taken), that would be great. Eg. “https://www.mydomain.com/specialfunctions/” would block any log or action where that folder is involved, so I would’nt get a log such as “https://www.mydomain.com/specialfunctions/137450d0-d6e7-4d47-9e07-ad53d218cb54-2/”

    Also, a simple option to ignore (not log or action) requests from the actual host itself would be good (I frequently see the wordpress hosts own IP listed as originator)

    Thanks!

Viewing 9 replies - 1 through 9 (of 9 total)
  • Thread Starter ozzymuppet

    (@ozzymuppet)

    7 years, 10 months ago

    Screenshot here 🙂

    View post on imgur.com

    Thread Starter ozzymuppet

    (@ozzymuppet)

    7 years, 10 months ago

    Also, should it be logging a ‘Captured 404’ for something I’ve already created a redirect for in the past? Shown here: http://imgur.com/a/kL9KK

    I hope I’m not bothering you too much! 🙂 Thanks mate.

    EDIT: I noticed there was a difference (trailing slash/ on one url), fixed.

    • This reply was modified 7 years, 10 months ago by ozzymuppet.
    Plugin Author Aaron

    (@aaron13100)

    7 years, 10 months ago

    Hey ozzymuppet! Thanks for the suggestion.

    It sounds like ignoring requests from the host itself would solve all of your problems (please confirm). What does this look like in the logs? 127.0.0.1? ::1? localhost? Can you include a log line so I can see what it looks like?

    thanks!

    Thread Starter ozzymuppet

    (@ozzymuppet)

    7 years, 10 months ago

    Argh, the IP address I was looking at was’nt my host, the last 3 digits were different.

    Looking closer the IP I need to block is my client machine which updates the website.

    So I guess the general solution would be an option of entering IP addresses to ignore. This would also be very handy for ignoring the flood of Google/Yahoo/MSN checking old non-existant URLs.

    Plugin Author Aaron

    (@aaron13100)

    7 years, 10 months ago

    How about ignoring a list of user agents then? IP addresses seems rather clunky as IP addresses will change. The most popular bots could be added by default (listed here https://www.keycdn.com/blog/web-crawlers/).

    For your own scripts it would mean you’d have to set the user agent (ozzymuppetbot?).

    Thread Starter ozzymuppet

    (@ozzymuppet)

    7 years, 10 months ago

    Yes! That sounds perfect. Let me know if you need any help testing.

    Plugin Author Aaron

    (@aaron13100)

    7 years, 10 months ago

    Hey ozzymuppet. A beta version 1.8 is available at https://wordpress.org/plugins/404-solution/advanced/ (then scroll down, click download, then upload it to wordpress manually through “plugins” -> “add new” -> “upload plugin”).

    Otherwise I’ll probably release it officially in a little while. I like to leave the new releases running on my own site for a while before I release them to everyone. If you try it out let me know how it goes.
    thanks

    Thread Starter ozzymuppet

    (@ozzymuppet)

    7 years, 10 months ago

    Done. Thank you sir, I’ll let you know if I see any issues (of course!) 🙂

    Thread Starter ozzymuppet

    (@ozzymuppet)

    7 years, 10 months ago

    Minor: version in plugins screen still says “Version 1.7.4”, but correct 1.8.0 elsewhere.

    I love the options you’ve added, good stuff.

Viewing 9 replies - 1 through 9 (of 9 total)
  • The topic ‘Adding exclusions to reduce false positive 404s’ is closed to new replies.