WordPress.org

Ready to get started?Download WordPress

Forums

Google XML Sitemaps
Google XML Sitemaps with my own robots.txt (4 posts)

  1. xa2
    Member
    Posted 1 year ago #

    Hello!

    i have installed this plugin, and i really like the generated plugins.

    But I do not like the generated robots.txt so i was wondering if I could use this plugin while using my own robots.txt.

    The plugin states: "The virtual robots.txt generated by WordPress is used. A real robots.txt file must NOT exist in the blog directory!"

    Would it be any problem if I use my own robots.txt?

    Thanks

    http://wordpress.org/extend/plugins/google-sitemap-generator/

    [ Please do not bump, it's not permitted here. ]

  2. bottlecapnapkin
    Member
    Posted 1 year ago #

    Yes - I don't like the robots.txt either. I would like it to exclude tags, categories and pages, but I don't see a way to modify it through the plugin. I placed a robots.txt file in the blog directory and Google Webmaster Tools is picking that up rather than the virtual file. So far, so good. Now to remove the urls through Webmaster Tools.

  3. vgvetter
    Member
    Posted 1 year ago #

    It's my understanding that WP generates a virtual robots text file if you have prevented indexing during site construction.

    When you finally tie the site into Webmaster Tools, this virtual robots file prevents indexing until you rework the robots.txt file.

    Did so on our site, and indexing on 40 pages began immediately but did not finish for about two weeks.

    [Text moderated]

  4. xa2
    Member
    Posted 1 year ago #

    Same happened to me, thanks!

Topic Closed

This topic has been closed to new replies.

About this Plugin

About this Topic

Tags