WordPress.org

Ready to get started?Download WordPress

Forums

robots.txt with WordPress (5 posts)

  1. mightydna
    Member
    Posted 7 years ago #

    i am trying to figure out just what i should disallow in the robots.txt file in my WordPress directory.. i want my site and it's content indexed so i want to make sure i do now disallow andything i shouldn't..

    thx

  2. mightydna
    Member
    Posted 7 years ago #

    are there any files or directories i should be disallowing?

  3. maerk
    Member
    Posted 7 years ago #

    You might disallow the wp-admin and wp-includes directory?

    There's no right answer, it's up to you entirely. If there's anything you don't want the search engine going to, disallow it. It doesn't hurt to be safe :)

  4. mightydna
    Member
    Posted 7 years ago #

    appreciate it! that is exactly what i was going to do. i wasn't sure if there was anything in those directories i would want spidered. thanks for the help.

  5. maerk
    Member
    Posted 7 years ago #

    To be honest, those directories probably wouldn't get spidered anyway, there are no links to them from anywhere, unless you count the stylesheet link -- but then that's to wp-content anyway.

    But it's your call, it won't damamge the performance of your site or anything.

Topic Closed

This topic has been closed to new replies.

About this Topic