Support » Plugin: XML Sitemap Generator for Google » Robots.txt Disallow folder and subfolders?

  • Resolved chinwag


    Hi, what is the Robots.txt configuration that I need to Disallow access to a certain Folder and subsequent sub-folders please?


    User-agent: XmlSitemapGenerator
    Disallow: /property/*

    but still doesnt stop the folder being accessed.


Viewing 2 replies - 1 through 2 (of 2 total)
  • Plugin Author XmlSitemapGenerator



    sorry for the delay.

    The robots file simply tells search engines what it should / shouldn’t access.
    It does not set any permissions or control access.
    you should consider them hints rather than instructions.

    Plugin Author XmlSitemapGenerator


    Forgot to mark as resolved.

Viewing 2 replies - 1 through 2 (of 2 total)
  • The topic ‘Robots.txt Disallow folder and subfolders?’ is closed to new replies.