WordPress.org

Ready to get started?Download WordPress

Forums

[Plugin: XML Sitemap Feed] WPMU various robots.txt for various blogs (2 posts)

  1. Petros.Polonos
    Member
    Posted 3 years ago #

    I have run the plugin on multisite installation. Against my expectations, the content of robots.txt is various:
    http://cro.skulski.pl/robots.txt and most other blogs:

    Sitemap: http://cro.skulski.pl/feed/sitemap/
    
    User-agent: *
    Disallow:

    but http://sdc_com.skulski.pl/robots.txt:

    Sitemap: http://sdc_com.skulski.pl/feed/sitemap/
    
    User-agent: *
    Disallow: /

    wchich makes Google blocked.
    This is WPMU installation, subdomain based. Nothing fancy, regarding sdc_com blog.

    What am I doing wrong?

  2. RavanH
    Member
    Posted 3 years ago #

    Hmmm... the XML Sitemap Feed plugin does not change the Disallow rule, it just adds the Sitemap reference to each robots.txt

    Please check the settings on Settings > Privacy for the sdc_com site. It's there that the Disallow rule is controlled.

Topic Closed

This topic has been closed to new replies.

About this Topic