Robots.txt in Multi-site

  • abhim12

    (@abhim12)


    13 years, 7 months ago

    So I have enabled multi-site successfully on my blog, forced it to use sub-directories and created 2 new sites. I had a robots.txt for the main blog, and was using the robots meta plugin to manage it.

    I network activated the robots meta plugin and it resulted in the creation of the same robots.txt file under the sub-directory (or the site). I am not sure if this is the right thing to do. I think there should be only one robots.txt located at main-site/robots.txt, instead of separate robots.txt files like main-site/sub-site/robots.txt ..am I right? If yes, should I go ahead and deactivate the robots meta plugin for the sub-site and remove the other robots.txt it created?

Viewing 4 replies - 1 through 4 (of 4 total)
  • Moderator Ipstenu (Mika Epstein)

    (@ipstenu)

    🏳️‍🌈 Advisor and Activist

    13 years, 7 months ago

    I network activated the robots meta plugin and it resulted in the creation of the same robots.txt file under the sub-directory (or the site).

    You mean it made a subfolder and spawned the robots.txt file?

    I dunno, I think you could just handle it via one robots.txt in the main root of your install (same level as wp-config.php basically).

    Can you link to the plugin you’re using?

    Thread Starter abhim12

    (@abhim12)

    13 years, 7 months ago

    Well, I am not sure if it created another robots.txt file because when I went to blogs.dir->sub-directory->files… I couldn’t see any robots.txt. But when I point my browser to main-site/sub-site/robots.txt, it does show it up (it’s actually the same one as it’s for the main site)

    Here’s the plugin link – Link 1 and Link 2

    Moderator Ipstenu (Mika Epstein)

    (@ipstenu)

    🏳️‍🌈 Advisor and Activist

    13 years, 7 months ago

    Oh okay 🙂 It’s a virtual file. That’s fine.

    It doesn’t do any harm, I don’t think.

    Thread Starter abhim12

    (@abhim12)

    13 years, 7 months ago

    Ohk, cool…I’ll leave the current setting as it is then. Thanks. 🙂

Viewing 4 replies - 1 through 4 (of 4 total)
  • The topic ‘Robots.txt in Multi-site’ is closed to new replies.