• Resolved Maike

    (@maikeos)


    Wordfence is blocking google proxy after 4 requests that I set to block web crawlers but not googles

    here are my Wordfence settings for rate-limiting http://prnt.sc/w3d2np

    on my settings, I’m allowing google crawlers for unlimited requests, so please how to fix this?

    for example, THIS GOOGLE’S Hostname is blocked rate-limited-proxy-66-249-89-205.google.com

Viewing 3 replies - 1 through 3 (of 3 total)
  • Thread Starter Maike

    (@maikeos)

    this forum is dead? no one can answer my question or HELp, that’s too bad

    Plugin Support wfpeter

    (@wfpeter)

    Hi @maikeos, thanks for getting in touch with us over the issue you’re seeing.

    We take helping you and other members of our free community as seriously as we do our premium customers, but are not available 24/7 so there will sometimes be pauses outside of our working hours.

    We performed a forward and reverse DNS verification check and it is a genuine Google crawler so may have been caught by another blocking condition elsewhere.

    We can check this by taking a look in Wordfence > Tools > Live Traffic, the traffic can be filtered by checking Advanced Filters, then selecting IP from the dropdown to see what the block reason is. If you could let me know what is being reported we can investigate whether there is a setting catching this particular crawler.

    Thanks again,

    Peter.

    Hi People,

    I’m taking the liberty of talking a little about Wordfence’s RateLimit.

    For my context, I set the limitation per article to 2 pageviews, and I noticed that the option [Verified Google crawlers will note be rate-limited] generates a false positive, I gave
    to release any access as User-Agent Goolge [Anyone claiming to be Google will not be rate-limited].

    Here is the list of blocks on the official Google network (https://imgur.com/a/k5MOWef), and here is the Cloudflare WAF KnowBots recording the 2 pageviews (https://imgur.com/a/miFSpSE) .
    Well with the plugin that way, I will leave this task of official robot checking with Cloudflare.

    I hope to be helping to promote the development of the plugin. If possible it would be interesting to use Cloudflare KnowBots to check the IP in some way or to talk to Google
    about the VLANs of the official network.

    I’m from Brazil, sorry for the terrible English.

    FAQ about KnowBots: https://developers.cloudflare.com/firewall/known-issues-and-faq#how-does-firewall-rules-handle-traffic-from-known-bots

    Pessoal,
    
    Estou tomando a liberdade de falar um pouco sobre o RateLimit do Wordfence.
    
    Para o meu contexto, configurei para 2 pageviews a limitação por artigo, e percebi que a opção [Verified Google crawlers will note be rate-limited] gera falso positivo, dei 
    para liberar qualquer acesso como User-Agent Goolge [Anyone claiming to be Google will not be rate-limited].
    
    Aqui esta a lista de bloqueios na rede oficial do Google (https://imgur.com/a/k5MOWef), e aqui esta o KnowBots WAF da Cloudflare registrando os 2 pageviews (https://imgur.com/a/miFSpSE). 
    Bom com o plugin dessa forma, vou deixar essa tarefa de checagem oficial de robô com a Cloudflare. 
    
    Espero estar ajudando a fomentar o desenvolvimento do plugin. Se possível seria interessante usarem a Cloudflare KnowBots para checar o IP de alguma forma ou falar com o Google
    sobre as VLANs da rede oficial.
    
    Eu sou do Brasil, perdão pelo péssimo inglês.

    FAQ sobre KnowBots: https://developers.cloudflare.com/firewall/known-issues-and-faq#how-does-firewall-rules-handle-traffic-from-known-bots

Viewing 3 replies - 1 through 3 (of 3 total)
  • The topic ‘Wordfence is blocking google proxy bots’ is closed to new replies.