The Support Forums will be in read-only mode for a scheduled maintenance window on 01 September 2016 14:00 UTC - 20:00 UTC. More information.

How do I disallow bots from my WordPress year Archive Folders (4 posts)

  1. drumat5280
    Posted 9 years ago #

    How do I disallow robots from spidering my archive folders in WordPress?

    Here is how my URL's are structured:


    I tried testing this in Webmaster Central, but it returned back with an allow status:

    User-agent: *
    Disallow: /*/2007/$

  2. kalico
    Posted 9 years ago #

    I have never seen the $ used in a robots.txt file -- but I am no expert either.

    Try this website on creating good robots.txt files:


    If you find the right combo, post it here!

    HTH :)

  3. whooami
    Posted 9 years ago #

    User-agent: *
    Disallow: /blog/2007

    will work just fine.

  4. drumat5280
    Posted 9 years ago #

    How do I test it to make sure I have done it right?

Topic Closed

This topic has been closed to new replies.

About this Topic