Support » Plugin: Wordfence Security - Firewall, Malware Scan, and Login Security » Why is Amazon crawling my site? Should I permanently block?

  • Resolved jms1017

    (@jms1017)


    Version 6.0.25 I have throttling set such that if there are more than 1 request every 4 seconds, then block:
    and II get a few messages like this every day: (same IP always)
    Wordfence has blocked IP address 52.3.146.92.
    The reason is: “Exceeded the maximum global requests per minute for crawlers or humans.”.
    User IP: 52.3.146.92
    User hostname: ec2-52-3-146-92.compute-1.amazonaws.com
    User location: Seattle, United States

    Why is amazon hitting my site? Should I permanently block it?
    my site is jkswebdesign.com

    https://wordpress.org/plugins/wordfence/

Viewing 6 replies - 1 through 6 (of 6 total)
  • I’m assuming you’re seeing the word “amazon” and thinking that “Amazon” as a company is crawling your site? Nope, that’s a bad crawler using AWS, Amazon Web Services. Block the IP if you’re feeling the urge, it’s on a couple of block lists already.

    What you really want to do is set things up so you’re not often manually blocking stuff. That’s whack-a-mole and can be a real time waster.

    Sounds like you’re doing DIY security and you’re at the beginning of the learning curve. Enjoy (grin).

    MTN

    Its simple and free to fire up a basic server instance on AWS. We get this a lot. We also use AWS for hosting everything for our company.

    If I feel up to it I also report the IP and send a sample log to AWS. They respond pretty fast and turn it off.

    https://aws.amazon.com/forms/report-abuse

    sometimes just emailing abuse@company-name-here.com will go to the right place ..

    I agree with mountainguy2, that it seems as though you’re at the beginning of the learning curve – though I disagree that everything from AWS is bad. You might want to allow Wordfence to do what it does best and not get overly concerned with bots unless they’re scraping your site, or bottle necking your bandwidth or traffic.

    Sorry to imply that everything from AWS is bad (did I do that?). Plenty of legit hosting and stuff done with AWS, and it’s also used by probably hundreds of thousands of hackers from here to Ukraine. MTN

    Might have been the way that I read “a bad crawler using AWS” mountainguy – not sure. Either way, was just trying to tell jms1017, that WF works pretty well “out of the box” and watching it has the potential to drive you crazy and take away years off of your life lol

    Thread Starter jms1017

    (@jms1017)

    Thanks for all the suggestions, yes I am on the front of the security learning curve….I have lots of things “set” automatically, but I have notifications sent to me for just about everything, as I find this helps me learn…
    So to recap, this is not amazon at all, but some bot hosted on AWS that is the culprit? Yes, I plan to both report and block it.

Viewing 6 replies - 1 through 6 (of 6 total)
  • The topic ‘Why is Amazon crawling my site? Should I permanently block?’ is closed to new replies.