WordPress.org

Support

Support » How-To and Troubleshooting » Virtual robots.txt blocks site from google

Virtual robots.txt blocks site from google

  • fortes – illustration

    @fortes-illustration

    Hi!

    Somehow a virtual robots.txt is blocking the site http://www.domda.se from google search.

    The site is open for search engines in the Integrity settings (of course 😉

    I have tried:

      Turning the privacy setting/search engine allowance off and on again.
      Turning all the plugins off.
      Adding a totally allowing robots.txt to the root directory.
      Using a robot plugin to write what should be in robots.txt

    Now I wonder if someone can help me. The robot doing code in wp-includes/functions.php says:

    function do_robots() {
    	header( 'Content-Type: text/plain; charset=utf-8' );
    
    	do_action( 'do_robotstxt' );
    
    	$output = "User-agent: *\n";
    	$public = get_option( 'blog_public' );
    	if ( '0' == $public ) {
    		$output .= "Disallow: /\n";
    	} else {
    		$site_url = parse_url( site_url() );
    		$path = ( !empty( $site_url['path'] ) ) ? $site_url['path'] : '';
    		$output .= "Disallow: $path/wp-admin/\n";
    		$output .= "Disallow: $path/wp-includes/\n";
    	}
    
    	echo apply_filters('robots_txt', $output, $public);
    }

    I hope someone can help.

Viewing 10 replies - 1 through 10 (of 10 total)
  • esmi

    @esmi

    Forum Moderator

    Somehow a virtual robots.txt is blocking the site http://www.domda.se from google search.

    Why do you think that? I cannot find anything on your site that is blocking bots.

    fortes – illustration

    @fortes-illustration

    When I search for domda.se in google it says that a robots.txt is blocking the info

    fortes – illustration

    @fortes-illustration

    More correctly google says that the robots.txt file is blocking the description of the site.

    esmi

    @esmi

    Forum Moderator

    This isn’t a core WordPress issue. Have you tried:

    – deactivating all plugins to see if this resolves the problem. If this works, re-activate the plugins one by one until you find the problematic plugin(s).

    – switching to the Twenty Eleven theme to rule out any theme-specific problems.

    resetting the plugins folder by FTP or PhpMyAdmin. Sometimes, an apparently inactive plugin can still cause problems.

    fortes – illustration

    @fortes-illustration

    I’ve tried everything on your list and the problem is still there.

    esmi

    @esmi

    Forum Moderator

    Do you have a Google Webmaster account?

    fortes – illustration

    @fortes-illustration

    Yes

    esmi

    @esmi

    Forum Moderator

    Have you checked in there for any clues? Have you asked Google to re-index the site? are you submitting a Google sitemap. Bear in mind that it can take up to 90 days for Google to re-index a site naturally.

    Optimist1

    @optimist1

    Hello Mam
    How Are You Today Please I Really Want To Start Programing,I Know Noting Of It Please Can You Put Me True A Bit? Please? I Beg You In The Name Of GOD Almighty ? Please? Not More Than This For Now And I Await Your Enthusiastic Response Imminently.
    Regards
    Optimist1

    esmi

    @esmi

    Forum Moderator

    @ptimist1: It is impolite to interrupt another poster’s ongoing thread with a question of your own and it causes significant problems for the forum’s volunteers. Please post your own topic.

Viewing 10 replies - 1 through 10 (of 10 total)
  • The topic ‘Virtual robots.txt blocks site from google’ is closed to new replies.
Skip to toolbar