Forums

some subdirectory's robot.txt is missing (4 posts)

  1. brokensite
    Member
    Posted 1 year ago #

    Hi , I am running a multi site with subdirectories, (I have used domain mapping for domain redirection), the problem is that some instances of my multusite have a valid robots.txt (like http://energie.les-guides-agir.com/robots.txt)but some subdirectories don't (like http://eau-chaude-sanitaire.les-guides-agir.com/robots.txt), and those domains with no robots.txt are not being indexed at all or the index rate is so low, can any one resolve this mystery please?

  2. Andrea_r
    team pirate
    Posted 1 year ago #

    but some subdirectories don't (like http://eau-chaude-sanitaire.les-guides-agir.com/robots.txt), and those domains with no robots.txt are not being indexed at all or the index rate is so low,

    That URL has 41,000 results in Google. If that's low, then I dunno what to tell ya. ;)

  3. brokensite
    Member
    Posted 1 year ago #

  4. brokensite
    Member
    Posted 1 year ago #

    why the robots.txt is missing anyway?(thank you for ur time)

Topic Closed

This topic has been closed to new replies.

About this Topic