Support » Plugin: Stop Web Crawlers » Blacklist of User agent

  • Resolved TheDream18


    Hi. Is the plugin block crawler, same as block usergent? Sorry silly question, i’m not surely what is difference crawler vs user-agent, just be sure before working on it.
    I used code bellow in .htaccess. If your plugin work same function as user-agent. Can i delete these code and started working on your plugin? By the way “add new/each user-gent” to “Web Crawler List”

    # Start Blacklist
    RewriteEngine on
    RewriteCond %{HTTP_USER_AGENT} “^Mozilla.*Indy” [NC,OR]
    RewriteCond %{HTTP_USER_AGENT} “^Mozilla.*NEWT” [NC,OR]
    RewriteCond %{HTTP_USER_AGENT} “^$” [NC,OR]
    RewriteCond %{HTTP_USER_AGENT} “^Maxthon$” [NC,OR]

Viewing 4 replies - 1 through 4 (of 4 total)
  • No, user-agent and crawlers/Referer’s are different beasts.

    Once you’ve installed this plugin,
    see Stop Web Crawlers menu on left -> “List”
    and note the entries are website addresses, aka, Referer’s.

    If you wish to block user-agents like those you’ve listed above, you would add those lines to the top of your .htaccess file.

    Thank you so much for explain.

    Plugin Author threenine


    @hackrepair thank you so much for your help answering the question!
    much appreciated!

    My pleasure folks. 🙂

Viewing 4 replies - 1 through 4 (of 4 total)
  • The topic ‘ Blacklist of User agent’ is closed to new replies.