robot.txt 404 error for multi site directories | WordPress.org

Resolved brokensite
(@brokensite)

13 years, 1 month ago

The may be strange but the fact is I have made a multisite with subdirectories which are redirected to subdomains by domain mapping.

the problem is that for the main site I have a valid robot text showing but the subdirectories (which are pointed to subdomains) do not have robot text (containing information about individual sitmaps)=error 404 for google robots … what should I do? should I address all subdomain site maps in the same robot text or write individual robot text and redirect 404 to them?

Viewing 11 replies - 1 through 11 (of 11 total)

Thread Starter brokensite
(@brokensite)

13 years, 1 month ago

here is the main site : http://www.les-guides-agir.com/
and here is one subdomain : http://energie.les-guides-agir.com/

http://www.les-guides-agir.com/robots.txt
http://energie.les-guides-agir.com/robots.txt

Moderator Ipstenu (Mika Epstein)
(@ipstenu)

🏳️‍🌈 Advisor and Activist

13 years, 1 month ago

The may be strange but the fact is I have made a multisite with subdirectories which are redirected to subdomains by domain mapping.

Why? MultiSite can run subdomains.

Andrea Rennick
(@andrea_r)

13 years, 1 month ago

but the subdirectories (which are pointed to subdomains) do not have robot text (containing information about individual sitmaps)=error 404 for google robots … what should I do?

You should forget about the robots.txt file and use a sitemap plugin that works in multisite.

like http://wordpress.org/extend/plugins/xml-sitemap-feed/

Why? MultiSite can run subdomains.

Some people domain map the subdomains on hosts that do not have wildcard subs.

Moderator Ipstenu (Mika Epstein)
(@ipstenu)

🏳️‍🌈 Advisor and Activist

13 years, 1 month ago

And they won’t let you point subdomains, manually generated, to anything BUT public_html/subfolder? Okay, I can see that (though it strikes me as silly).

You can also use http://wordpress.org/extend/plugins/pc-robotstxt/ to handle per-site robots.txt, but the http://wordpress.org/extend/plugins/xml-sitemap-feed/ should work fine (I don’t know if it’ll put your links as subfolders or subdirectories in that situation though….)

Thread Starter brokensite
(@brokensite)

13 years, 1 month ago

Why? MultiSite can run subdomains.

yeah I know , I started the site with subdirectories and then we have changed strategy but it was so late

Thread Starter brokensite
(@brokensite)

13 years, 1 month ago

You should forget about the robots.txt file and use a sitemap plugin that works in multisite.

I have indu=ividual sitemaps for all subdomains , they are all integrated with google webmaster, every subdomain has independent rss feed burner feeds also,

Thread Starter brokensite
(@brokensite)

13 years, 1 month ago

You can also use http://wordpress.org/extend/plugins/pc-robotstxt/ to handle ….

thank you , I will try them out, I have worked for hours on this site and now these 404 errors are freaking me out, this is my first multisite,

Thread Starter brokensite
(@brokensite)

13 years, 1 month ago

Some people domain map the subdomains on hosts that do not have wildcard subs.

yeah it makes it so much easier , I hope this won’t make regret one day since apparently subdirectories are so much different

Andrea Rennick
(@andrea_r)

13 years, 1 month ago

I have indu=ividual sitemaps for all subdomains , they are all integrated with google webmaster, every subdomain has independent rss feed burner feeds also,

And?

, I hope this won’t make regret one day since apparently subdirectories are so much different

No, not really.

Kapeltsov
(@kapeltsov)

12 years, 6 months ago

The problem isn’t solved.
I have made a multisite with domain mapping to different domain.
Part of the domain contains robots.txt and some returns 404.
What should I do?

Moderator Ipstenu (Mika Epstein)
(@ipstenu)

🏳️‍🌈 Advisor and Activist

12 years, 6 months ago

Kapeltsov – If a post is resolved and you have a similar problem, make a NEW topic all for yourself, eh?

Viewing 11 replies - 1 through 11 (of 11 total)

The topic ‘robot.txt 404 error for multi site directories’ is closed to new replies.

Tags

In: Networking WordPress
11 replies
4 participants
Last reply from: Ipstenu (Mika Epstein)
Last activity: 12 years, 6 months ago
Status: resolved

Topics

Topics with no replies

Non-support topics

Resolved topics

Unresolved topics

All topics