Title: wordpressmike's Replies | WordPress.org

---

# wordpressmike

  [  ](https://wordpress.org/support/users/wordpressmike/)

 *   [Profile](https://wordpress.org/support/users/wordpressmike/)
 *   [Topics Started](https://wordpress.org/support/users/wordpressmike/topics/)
 *   [Replies Created](https://wordpress.org/support/users/wordpressmike/replies/)
 *   [Reviews Written](https://wordpress.org/support/users/wordpressmike/reviews/)
 *   [Topics Replied To](https://wordpress.org/support/users/wordpressmike/replied-to/)
 *   [Engagements](https://wordpress.org/support/users/wordpressmike/engagements/)
 *   [Favorites](https://wordpress.org/support/users/wordpressmike/favorites/)

 Search replies:

## Forum Replies Created

Viewing 15 replies - 1 through 15 (of 17 total)

1 [2](https://wordpress.org/support/users/wordpressmike/replies/page/2/?output_format=md)
[→](https://wordpress.org/support/users/wordpressmike/replies/page/2/?output_format=md)

 *   Forum: [Plugins](https://wordpress.org/support/forum/plugins-and-hacks/)
    In
   reply to: [[All in One SEO – Powerful SEO Plugin to Boost SEO Rankings & Increase Traffic] No Index For Search Page](https://wordpress.org/support/topic/no-index-for-search-page/)
 *  [wordpressmike](https://wordpress.org/support/users/wordpressmike/)
 * (@wordpressmike)
 * [3 years, 5 months ago](https://wordpress.org/support/topic/no-index-for-search-page/#post-16384490)
 * [@arnaudbroes](https://wordpress.org/support/users/arnaudbroes/) I appreciate
   your attention to this.
 * FYI: I searched Google for web sites that are part of the spam ( goo/678 DOT 
   com and tbr/11 DOT com- delete the slashes and add .com).
 * It appears there are a number of prominent web sites using All in One SEO that
   are the targets of these spam attacks, though at least one site was using a different
   SEO tool.
 *   Forum: [Plugins](https://wordpress.org/support/forum/plugins-and-hacks/)
    In
   reply to: [[All in One SEO – Powerful SEO Plugin to Boost SEO Rankings & Increase Traffic] No Index For Search Page](https://wordpress.org/support/topic/no-index-for-search-page/)
 *  [wordpressmike](https://wordpress.org/support/users/wordpressmike/)
 * (@wordpressmike)
 * [3 years, 5 months ago](https://wordpress.org/support/topic/no-index-for-search-page/#post-16383292)
 * Thanks [@andrew1977](https://wordpress.org/support/users/andrew1977/). I was 
   able to comment out the code I added to the functions.php and check the “no” 
   box for “show in search results” under search appearance –> Search Page.
 * That resulted in the following: meta tag for. So adding code doesn’t seem necessary.
 *     ```wp-block-code
       <meta name="robots" content="noindex, max-snippet:-1, max-image-preview:large, max-video-preview:-1" />
       ```
   
 * Also, I noticed that clicking “Use Default Settings” under the “Advanced” tab
   reverts the setting back to “yes”.
 * Another thing is that the above meta robots tag lacks “follow” and there doesn’t
   appear to be a way to add it. I’m unsure if the “follow” is necessary or not.
 * Google’s documentation [says](https://developers.google.com/search/blog/2007/03/using-robots-meta-tag):
 * > By default, Googlebot will index a page and follow links to it. So there’s 
   > no need to tag pages with content values of `index` or `follow`.
    -  This reply was modified 3 years, 5 months ago by [wordpressmike](https://wordpress.org/support/users/wordpressmike/).
    -  This reply was modified 3 years, 5 months ago by [wordpressmike](https://wordpress.org/support/users/wordpressmike/).
    -  This reply was modified 3 years, 5 months ago by [wordpressmike](https://wordpress.org/support/users/wordpressmike/).
 *   Forum: [Plugins](https://wordpress.org/support/forum/plugins-and-hacks/)
    In
   reply to: [[All in One SEO – Powerful SEO Plugin to Boost SEO Rankings & Increase Traffic] No Index For Search Page](https://wordpress.org/support/topic/no-index-for-search-page/)
 *  [wordpressmike](https://wordpress.org/support/users/wordpressmike/)
 * (@wordpressmike)
 * [3 years, 5 months ago](https://wordpress.org/support/topic/no-index-for-search-page/#post-16383201)
 * [@andrew1977](https://wordpress.org/support/users/andrew1977/), I basically combined
   the code from the original [wordpress core work](https://core.trac.wordpress.org/ticket/52457)
   with the All in One SEO [documentation](https://aioseo.com/docs/aioseo_robots_meta/).
 * You’ll see that it only sets noindex if `is_search()` is true. So yes, it’s only
   for search. (see is_search() [documentation](https://developer.wordpress.org/reference/functions/is_search/))
 * I couldn’t figure out [@arnaudbroes](https://wordpress.org/support/users/arnaudbroes/)’
   s instructions.
 *   Forum: [Plugins](https://wordpress.org/support/forum/plugins-and-hacks/)
    In
   reply to: [[All in One SEO – Powerful SEO Plugin to Boost SEO Rankings & Increase Traffic] No Index For Search Page](https://wordpress.org/support/topic/no-index-for-search-page/)
 *  [wordpressmike](https://wordpress.org/support/users/wordpressmike/)
 * (@wordpressmike)
 * [3 years, 5 months ago](https://wordpress.org/support/topic/no-index-for-search-page/#post-16383110)
 * Apparently this spam vulnerability was [fixed long ago](https://core.trac.wordpress.org/ticket/52457)
   in WordPress core but All in One SEO plugin is reverting the desired behavior.
 * I noticed I’m getting the spam today, for the first time. So maybe this is a 
   new bug.
 * Using the All in One SEO [documentation](https://aioseo.com/docs/aioseo_robots_meta/),
   I was able to add the following to my functions.php file, which I think should
   solve the problem until it can be fixed in the main plugin:
 *     ```wp-block-code
       add_filter( 'aioseo_robots_meta', 'aioseo_filter_robots_meta' );
   
       function aioseo_filter_robots_meta( $attributes ) {
          if ( is_search() ) {
             $attributes['noindex']  = 'noindex';
             $attributes['nofollow'] = 'follow';
          }
          return $attributes;
       }
       ```
   
 *   Forum: [Plugins](https://wordpress.org/support/forum/plugins-and-hacks/)
    In
   reply to: [[BulletProof Security] Linkchecker and other legit bots are broken](https://wordpress.org/support/topic/linkchecker-and-other-legit-bots-are-broken/)
 *  Thread Starter [wordpressmike](https://wordpress.org/support/users/wordpressmike/)
 * (@wordpressmike)
 * [13 years, 4 months ago](https://wordpress.org/support/topic/linkchecker-and-other-legit-bots-are-broken/page/3/#post-3447813)
 * Wow that is an amazing analysis.
 *   Forum: [Plugins](https://wordpress.org/support/forum/plugins-and-hacks/)
    In
   reply to: [[BulletProof Security] Linkchecker and other legit bots are broken](https://wordpress.org/support/topic/linkchecker-and-other-legit-bots-are-broken/)
 *  Thread Starter [wordpressmike](https://wordpress.org/support/users/wordpressmike/)
 * (@wordpressmike)
 * [13 years, 4 months ago](https://wordpress.org/support/topic/linkchecker-and-other-legit-bots-are-broken/page/3/#post-3447811)
 * I don’t think the solution should be to continue to block Facebook but not log
   the blocking. That sounds like a recipe for trouble.
 *   Forum: [Plugins](https://wordpress.org/support/forum/plugins-and-hacks/)
    In
   reply to: [[BulletProof Security] Linkchecker and other legit bots are broken](https://wordpress.org/support/topic/linkchecker-and-other-legit-bots-are-broken/)
 *  Thread Starter [wordpressmike](https://wordpress.org/support/users/wordpressmike/)
 * (@wordpressmike)
 * [13 years, 4 months ago](https://wordpress.org/support/topic/linkchecker-and-other-legit-bots-are-broken/page/3/#post-3447789)
 * My development install that I can do rewrite logging on doesn’t have traffic 
   from facebook, so I can’t help with logs.
 *   Forum: [Plugins](https://wordpress.org/support/forum/plugins-and-hacks/)
    In
   reply to: [[BulletProof Security] Linkchecker and other legit bots are broken](https://wordpress.org/support/topic/linkchecker-and-other-legit-bots-are-broken/)
 *  Thread Starter [wordpressmike](https://wordpress.org/support/users/wordpressmike/)
 * (@wordpressmike)
 * [13 years, 4 months ago](https://wordpress.org/support/topic/linkchecker-and-other-legit-bots-are-broken/page/3/#post-3447698)
 * From the rewrite log, do you know which line of the htaccess file is causing 
   the 403 redirect?
 *   Forum: [Plugins](https://wordpress.org/support/forum/plugins-and-hacks/)
    In
   reply to: [[BulletProof Security] Linkchecker and other legit bots are broken](https://wordpress.org/support/topic/linkchecker-and-other-legit-bots-are-broken/)
 *  Thread Starter [wordpressmike](https://wordpress.org/support/users/wordpressmike/)
 * (@wordpressmike)
 * [13 years, 4 months ago](https://wordpress.org/support/topic/linkchecker-and-other-legit-bots-are-broken/page/2/#post-3447687)
 * Are you familiar with rewrite logging? I can try to get you a rewrite log this
   weekend.
 *   Forum: [Plugins](https://wordpress.org/support/forum/plugins-and-hacks/)
    In
   reply to: [[BulletProof Security] Linkchecker and other legit bots are broken](https://wordpress.org/support/topic/linkchecker-and-other-legit-bots-are-broken/)
 *  Thread Starter [wordpressmike](https://wordpress.org/support/users/wordpressmike/)
 * (@wordpressmike)
 * [13 years, 4 months ago](https://wordpress.org/support/topic/linkchecker-and-other-legit-bots-are-broken/page/2/#post-3447677)
 * Ok I’ve run my other site for about 12 hours with Bulletproof turned on, except
   for HEAD removed.
 * I’m still encountering the Facebook problem and am also seeing that it looks 
   like wordpress has been blocking itself- See the following, which has been anonymized.
 * Any progress?
 * >>>>>>>>>>> 403 Error Logged – February 7, 2013 – 11:05 pm <<<<<<<<<<<
    REMOTE_ADDR:
   123.123.123.123 Host Name: myserver.myhost.com HTTP_CLIENT_IP: HTTP_FORWARDED:
   HTTP_X_FORWARDED_FOR: HTTP_X_CLUSTER_CLIENT_IP: REQUEST_METHOD: GET HTTP_REFERER:
   REQUEST_URI: /wp-admin/post-new.php QUERY_STRING: HTTP_USER_AGENT: WordPress/
   3.5.1; [http://www.mydomain.com](http://www.mydomain.com)
 * Facebook problem:
 * >>>>>>>>>>> 403 Error Logged – February 8, 2013 – 12:05 pm <<<<<<<<<<<
    REMOTE_ADDR:
   173.252.110.112 Host Name: 173.252.110.112 HTTP_CLIENT_IP: HTTP_FORWARDED: HTTP_X_FORWARDED_FOR:
   HTTP_X_CLUSTER_CLIENT_IP: REQUEST_METHOD: GET HTTP_REFERER: REQUEST_URI: /wp-
   content/uploads/2011/08/icon.gif QUERY_STRING: HTTP_USER_AGENT: facebookexternalhit/
   1.1 (+http://www.facebook.com/externalhit_uatext.php)
 *   Forum: [Plugins](https://wordpress.org/support/forum/plugins-and-hacks/)
    In
   reply to: [[BulletProof Security] Linkchecker and other legit bots are broken](https://wordpress.org/support/topic/linkchecker-and-other-legit-bots-are-broken/)
 *  Thread Starter [wordpressmike](https://wordpress.org/support/users/wordpressmike/)
 * (@wordpressmike)
 * [13 years, 4 months ago](https://wordpress.org/support/topic/linkchecker-and-other-legit-bots-are-broken/page/2/#post-3447593)
 * I wonder if facebook falls back to GET if HEAD fails- Thus we’d record a block
   but also one would be passed through.
 *   Forum: [Plugins](https://wordpress.org/support/forum/plugins-and-hacks/)
    In
   reply to: [[BulletProof Security] Linkchecker and other legit bots are broken](https://wordpress.org/support/topic/linkchecker-and-other-legit-bots-are-broken/)
 *  Thread Starter [wordpressmike](https://wordpress.org/support/users/wordpressmike/)
 * (@wordpressmike)
 * [13 years, 4 months ago](https://wordpress.org/support/topic/linkchecker-and-other-legit-bots-are-broken/page/2/#post-3447586)
 * I’d be curious to know if the facebook problem stops if HEAD is removed- I will
   hopefully be testing this later tonight.
 *   Forum: [Plugins](https://wordpress.org/support/forum/plugins-and-hacks/)
    In
   reply to: [[BulletProof Security] Linkchecker and other legit bots are broken](https://wordpress.org/support/topic/linkchecker-and-other-legit-bots-are-broken/)
 *  Thread Starter [wordpressmike](https://wordpress.org/support/users/wordpressmike/)
 * (@wordpressmike)
 * [13 years, 4 months ago](https://wordpress.org/support/topic/linkchecker-and-other-legit-bots-are-broken/#post-3447561)
 * Side note re caching plugins- I’d love to use one but I had problems with certain
   dynamic content.
 *   Forum: [Plugins](https://wordpress.org/support/forum/plugins-and-hacks/)
    In
   reply to: [[BulletProof Security] Linkchecker and other legit bots are broken](https://wordpress.org/support/topic/linkchecker-and-other-legit-bots-are-broken/)
 *  Thread Starter [wordpressmike](https://wordpress.org/support/users/wordpressmike/)
 * (@wordpressmike)
 * [13 years, 4 months ago](https://wordpress.org/support/topic/linkchecker-and-other-legit-bots-are-broken/#post-3447559)
 * It looks like the broken link checker plugin is indeed using HEAD requests- I
   haven’t had a 403 error since removing HEAD checking-
 * If the log incorrectly characterizes a HEAD as a GET, then that’s a problem- 
   Really was a head scratcher.
 * this is from broken-link-checker/modules/checkers/http.php
 *     ```
       if ( $nobody ){
                       //If possible, use HEAD requests for speed.
                               curl_setopt($ch, CURLOPT_NOBODY, true);
                       } else {
                               //If we must use GET at least limit the amount of downloaded data.
                               curl_setopt($ch, CURLOPT_HTTPHEADER, array('Range: bytes=0-2048')); //2 KB
                       }
       ```
   
 *   Forum: [Plugins](https://wordpress.org/support/forum/plugins-and-hacks/)
    In
   reply to: [[BulletProof Security] Linkchecker and other legit bots are broken](https://wordpress.org/support/topic/linkchecker-and-other-legit-bots-are-broken/)
 *  Thread Starter [wordpressmike](https://wordpress.org/support/users/wordpressmike/)
 * (@wordpressmike)
 * [13 years, 4 months ago](https://wordpress.org/support/topic/linkchecker-and-other-legit-bots-are-broken/#post-3447546)
 * No caching plugins.

Viewing 15 replies - 1 through 15 (of 17 total)

1 [2](https://wordpress.org/support/users/wordpressmike/replies/page/2/?output_format=md)
[→](https://wordpress.org/support/users/wordpressmike/replies/page/2/?output_format=md)