[Plugin: Google XML Sitemaps] How to change virtual.txt

  • do77

    (@do77)


    15 years, 3 months ago

    Hi everyone,

    I successfully created the sitemap for my page with this plugin but I am having some troubles with my robots.txt file. In my plugin panel it says

    The virtual robots.txt generated by WordPress is used. A real robots.txt file must NOT exist in the blog directory!

    So I didn’t create another robots.txt in my root. But when I go to my webmaster-tools account google says that Googlebot was blocked by my url and couldn’t crawl my content. My virtual robots.txt blocks google completely.

    Where can I change this virtual robots.txt or how can I disable the file thus I can upload a regular one. Hope someone has an advice,

    Thanks!
    dk

Viewing 4 replies - 16 through 19 (of 19 total)
1 2
  • twmeggs

    (@twmeggs)

    14 years, 5 months ago

    Possibly resolved this. Think it might be down to my WordPress settings having previously been set to PRIVATE on the last time Google crawled the site. Now that setting has been updated, I think that once they crawl again and see the new robots.txt file, the problem should disappear.

    Will post again if this is the case.
    Thanks

    Arne

    (@arnee)

    14 years, 5 months ago

    Since this was the problem many times, the sitemaps plugin will warn you in the administration page if the privacy setting of WP is enabled since version 3.1.8 🙂

    parisvega

    (@parisvega)

    14 years, 5 months ago

    To solve my problem I simply created a file named robot.txt and placed it in my root directory with the following text inside of it:

    User-agent: *
    Allow: /

    That’s it. Problem solved.

    pbgswd

    (@pbgswd)

    14 years, 3 months ago

    Hi,
    this is a problem that is very trivial but also very stupid. Why why why is my robots.txt file getting overwritten? Does WordPress core think it should do this because I dont want anybody to visit my website?

    I have had to go into the file and update it more than once.

    Upon the robots.txt file, I have changed permissions:
    chmod 744 robots.txt
    (Only I can edit, everyone else can read only).

    I have to keep watching this now to make sure it isnt still happening.

Viewing 4 replies - 16 through 19 (of 19 total)
1 2
  • The topic ‘[Plugin: Google XML Sitemaps] How to change virtual.txt’ is closed to new replies.