Need to whitelist the following crawler IP’s
-
Hello,
I want to add those all IP’s on .htaccess file as allow. I don’t know how to do it. Anyone please send me link for that, Or write code for me so I will copy and paste on to the .htaccess file.Crawler IP’s
74.201.198.64/27 [74.201.198.64 -> 74.201.198.95]
74.217.148.96/27 [74.217.148.96 -> 74.217.148.127]
4.71.33.160/27 [4.71.33.160 -> 4.71.33.191]
50.31.185.32/27 [50.31.185.32 -> 50.31.185.63]
64.74.232.32/27 [64.74.232.32 -> 64.74.232.63]
64.202.112.0/27 [64.202.112.0 -> 64.202.112.31]
66.225.223.0/27 [66.225.223.0 -> 66.225.223.31]User-Agent
“Mozilla/5.0 (Java) outbrain”
and also our user-agent: “Mozilla/5.0 (Java) outbrain”
Note:Sorry for my Bad English
- The topic ‘Need to whitelist the following crawler IP’s’ is closed to new replies.