2 simple questions: RSS feeds / Spider indexing

Viewing 2 replies - 1 through 2 (of 2 total)
  • lkraav

    (@lkraav)

    10 years, 7 months ago

    I am also wondering about #2, /robots.txt handling, to be specific.

    My multisite installation has production and staging sites mixed, which means I don’t think I can shoot a regular robots.txt file into WP root – it would kill products sites indexing.

    But right now (5.0.1) robots.txt queries get redirected to WP login screen, which is a bit too messy to my liking. Bunch of plugins get loaded, logs get spammed and other useless work stuff happens.

    It’s feeling like the plugin could use a new settings field for specifying a custom robots.txt per subsite.

    Any thoughts here, Jake?

    roirizla

    (@roirizla)

    10 years, 7 months ago

    Suddenly my feeds do not validate. I tried using the example under FAQ’s but this created conflicts with other plugins.

    How would one allow Feeds to go through unrestricted if you IP filter the site?

    Thanks!

Viewing 2 replies - 1 through 2 (of 2 total)
  • The topic ‘2 simple questions: RSS feeds / Spider indexing’ is closed to new replies.