Support » Fixing WordPress » Virtual robots.txt blocks site from google

  • Hi!

    Somehow a virtual robots.txt is blocking the site http://www.domda.se from google search.

    The site is open for search engines in the Integrity settings (of course 😉

    I have tried:

      Turning the privacy setting/search engine allowance off and on again.
      Turning all the plugins off.
      Adding a totally allowing robots.txt to the root directory.
      Using a robot plugin to write what should be in robots.txt

    Now I wonder if someone can help me. The robot doing code in wp-includes/functions.php says:

    function do_robots() {
    	header( 'Content-Type: text/plain; charset=utf-8' );
    
    	do_action( 'do_robotstxt' );
    
    	$output = "User-agent: *\n";
    	$public = get_option( 'blog_public' );
    	if ( '0' == $public ) {
    		$output .= "Disallow: /\n";
    	} else {
    		$site_url = parse_url( site_url() );
    		$path = ( !empty( $site_url['path'] ) ) ? $site_url['path'] : '';
    		$output .= "Disallow: $path/wp-admin/\n";
    		$output .= "Disallow: $path/wp-includes/\n";
    	}
    
    	echo apply_filters('robots_txt', $output, $public);
    }

    I hope someone can help.

Viewing 10 replies - 1 through 10 (of 10 total)
  • esmi

    (@esmi)

    Forum Moderator

    Somehow a virtual robots.txt is blocking the site http://www.domda.se from google search.

    Why do you think that? I cannot find anything on your site that is blocking bots.

    When I search for domda.se in google it says that a robots.txt is blocking the info

    More correctly google says that the robots.txt file is blocking the description of the site.

    esmi

    (@esmi)

    Forum Moderator

    This isn’t a core WordPress issue. Have you tried:

    – deactivating all plugins to see if this resolves the problem. If this works, re-activate the plugins one by one until you find the problematic plugin(s).

    – switching to the Twenty Eleven theme to rule out any theme-specific problems.

    resetting the plugins folder by FTP or PhpMyAdmin. Sometimes, an apparently inactive plugin can still cause problems.

    I’ve tried everything on your list and the problem is still there.

    esmi

    (@esmi)

    Forum Moderator

    Do you have a Google Webmaster account?

    Yes

    esmi

    (@esmi)

    Forum Moderator

    Have you checked in there for any clues? Have you asked Google to re-index the site? are you submitting a Google sitemap. Bear in mind that it can take up to 90 days for Google to re-index a site naturally.

    Hello Mam
    How Are You Today Please I Really Want To Start Programing,I Know Noting Of It Please Can You Put Me True A Bit? Please? I Beg You In The Name Of GOD Almighty ? Please? Not More Than This For Now And I Await Your Enthusiastic Response Imminently.
    Regards
    Optimist1

    esmi

    (@esmi)

    Forum Moderator

    @ptimist1: It is impolite to interrupt another poster’s ongoing thread with a question of your own and it causes significant problems for the forum’s volunteers. Please post your own topic.

Viewing 10 replies - 1 through 10 (of 10 total)
  • The topic ‘Virtual robots.txt blocks site from google’ is closed to new replies.