WordPress.org

Ready to get started?Download WordPress

Forums

Robots.txt File Question (1 post)

  1. geoffreygonzalez
    Member
    Posted 6 years ago #

    Can you assist me with correctly writing a robots.txt file

    My robots.txt file will be loaded on the root http://www.abogados.us/robots.txt

    Our programs Joomla and WordPress will be loaded on seperate folders.

    1) How can I communicate via the robots.txt file that my disallow items will be located in respective folders

    2) I have several sites, Can the robots.txt file be written in a way that can cover the folder names with a wildcard effect?

    Sincerely,

    Geoffrey Gonzalez
    Tel: 203-746-7589

    User-agent: * (THESE ARE WORDPRESS ITEMS)
    User-agent: *
    Disallow: /*/email/$
    Disallow: /*/print/$
    Disallow: /*/feed/$
    Disallow: /*/feed/rss/$
    Disallow: /*/trackback/$
    Disallow: /wp-
    Disallow: /search
    Disallow: /feed
    Disallow: /comments/feed
    Disallow: /feed/$
    Disallow: /*/feed/$
    Disallow: /*/feed/rss/$
    Disallow: /*/trackback/$
    Disallow: /*/*/feed/$
    Disallow: /*/*/feed/rss/$
    Disallow: /*/*/trackback/$
    Disallow: /*/*/*/feed/$
    Disallow: /*/*/*/feed/rss/$
    Disallow: /*/*/*/trackback/$

Topic Closed

This topic has been closed to new replies.

About this Topic

  • RSS feed for this topic
  • Started 6 years ago by geoffreygonzalez
  • This topic is not resolved
  • WordPress version: 2.3