• Resolved penseelibre

    (@penseelibre)


    hi,
    i have only this info in my 404 errors :
    Mozilla/5.0 (Linux; Android 7.0;) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; PetalBot;+https://webmaster.petalsearch.com/site/petalbot)
    i have put as blacklist
    PetalBot
    petalbot
    petalsearch
    petalsearch.com
    webmaster.petalsearch.com

    nothing change, what can i do ?
    Tks

Viewing 8 replies - 1 through 8 (of 8 total)
  • Plugin Support vupdraft

    (@vupdraft)

    Hi,

    You can try adding this to your .htaccess

    ErrorDocument 503 “Site temporarily disabled for crawling” RewriteEngine On RewriteCond %{HTTP_USER_AGENT} ^.*(bot|crawl|spider).*$ [NC] RewriteCond %{REQUEST_URI} !^/robots.txt$ RewriteRule .* – [R=503,L]

    Typically you don’t want to leave a 503 block in place for longer than 2 days. Otherwise Google might start to interpret this as an extended server outage and could begin to remove your URLs from their index.

    Thread Starter penseelibre

    (@penseelibre)

    what you speak about ?
    i never ask for one sort of general 503
    i ask for stop one bot going to my site for do the most 404 !
    this specific bot is one only one, not all bot :

    PETALBOT

    Plugin Support vupdraft

    (@vupdraft)

    Hi,
    Can you add the following to your .htaccess
    RewriteCond %{HTTP_USER_AGENT} ^PetalBot [NC,OR]

    Thread Starter penseelibre

    (@penseelibre)

    hi
    and i can leave that permanently ?

    tks

    Plugin Support vupdraft

    (@vupdraft)

    Yes, this rule should only forbid PetalBots, it won’t affect things GoogleBots

    Thread Starter penseelibre

    (@penseelibre)

    tks
    i close

    Thread Starter penseelibre

    (@penseelibre)

    it works very well this forbid

    Plugin Contributor Prashant Baldha

    (@pmbaldha)

    Hi @penseelibre
    If you find All in One WP Security useful, then please give us a positive review, here: https://wordpress.org/support/plugin/all-in-one-wp-security-and-firewall/reviews/#new-post

    (If we’re not yet worth 5 stars, then please don’t review, but instead reply here to let us know why not – reviews less than 5 stars bring our average down!).

    Best wishes,
    Prashant

Viewing 8 replies - 1 through 8 (of 8 total)
  • The topic ‘forbid PetalBot’ is closed to new replies.