Forums

robots.txt and privacy (2 posts)

  1. byronyasgur
    Member
    Posted 2 years ago #

    when i uploaded my site i changed the privacy settings to "I would like my blog to be visible to everyone" but the (virtual) robots.txt did not change to allow robots as i would have expected. I was able to get around this by writing a physical robots.txt file into the root dir; but does anyone know why wordpress would still be giving me the wrong robots.txt - i made the priviacy change several days ago - i am not including a url as it would be pointless because it just dispays the file that i wrote .. the testing method i am using is : going to the robots page in the browser to view the robotos page contents and then changing the name of the physical file via ftp and refreshing the page to reveal the wordpress generated page; and this is disalowing robots

    ( the reason i want to change it back to the physical page is that i dont want google to pick up on the disalow page that wordpress is generating )

  2. byronyasgur
    Member
    Posted 2 years ago #

    probably just a bug somewhere in wordpress - has anyone else seen it

Topic Closed

This topic has been closed to new replies.

About this Topic

Tags

No tags yet.