WordPress.org

Ready to get started?Download WordPress

Forums

Virtual robots.txt blocks site from google (11 posts)

  1. fortes - illustration
    Member
    Posted 1 year ago #

    Hi!

    Somehow a virtual robots.txt is blocking the site http://www.domda.se from google search.

    The site is open for search engines in the Integrity settings (of course ;)

    I have tried:

      Turning the privacy setting/search engine allowance off and on again.
      Turning all the plugins off.
      Adding a totally allowing robots.txt to the root directory.
      Using a robot plugin to write what should be in robots.txt

    Now I wonder if someone can help me. The robot doing code in wp-includes/functions.php says:

    function do_robots() {
    	header( 'Content-Type: text/plain; charset=utf-8' );
    
    	do_action( 'do_robotstxt' );
    
    	$output = "User-agent: *\n";
    	$public = get_option( 'blog_public' );
    	if ( '0' == $public ) {
    		$output .= "Disallow: /\n";
    	} else {
    		$site_url = parse_url( site_url() );
    		$path = ( !empty( $site_url['path'] ) ) ? $site_url['path'] : '';
    		$output .= "Disallow: $path/wp-admin/\n";
    		$output .= "Disallow: $path/wp-includes/\n";
    	}
    
    	echo apply_filters('robots_txt', $output, $public);
    }

    I hope someone can help.

  2. esmi
    Forum Moderator
    Posted 1 year ago #

    Somehow a virtual robots.txt is blocking the site http://www.domda.se from google search.

    Why do you think that? I cannot find anything on your site that is blocking bots.

  3. fortes - illustration
    Member
    Posted 1 year ago #

    When I search for domda.se in google it says that a robots.txt is blocking the info

  4. fortes - illustration
    Member
    Posted 1 year ago #

    More correctly google says that the robots.txt file is blocking the description of the site.

  5. esmi
    Forum Moderator
    Posted 1 year ago #

    This isn't a core WordPress issue. Have you tried:

    - deactivating all plugins to see if this resolves the problem. If this works, re-activate the plugins one by one until you find the problematic plugin(s).

    - switching to the Twenty Eleven theme to rule out any theme-specific problems.

    - resetting the plugins folder by FTP or PhpMyAdmin. Sometimes, an apparently inactive plugin can still cause problems.

  6. fortes - illustration
    Member
    Posted 1 year ago #

    I've tried everything on your list and the problem is still there.

  7. esmi
    Forum Moderator
    Posted 1 year ago #

    Do you have a Google Webmaster account?

  8. fortes - illustration
    Member
    Posted 1 year ago #

    Yes

  9. esmi
    Forum Moderator
    Posted 1 year ago #

    Have you checked in there for any clues? Have you asked Google to re-index the site? are you submitting a Google sitemap. Bear in mind that it can take up to 90 days for Google to re-index a site naturally.

  10. Optimist1
    Member
    Posted 1 year ago #

    Hello Mam
    How Are You Today Please I Really Want To Start Programing,I Know Noting Of It Please Can You Put Me True A Bit? Please? I Beg You In The Name Of GOD Almighty ? Please? Not More Than This For Now And I Await Your Enthusiastic Response Imminently.
    Regards
    Optimist1

  11. esmi
    Forum Moderator
    Posted 1 year ago #

    @ptimist1: It is impolite to interrupt another poster's ongoing thread with a question of your own and it causes significant problems for the forum's volunteers. Please post your own topic.

Topic Closed

This topic has been closed to new replies.

About this Topic