WordPress.org

Ready to get started?Download WordPress

Forums

robots.txt need help (3 posts)

  1. memforum
    Member
    Posted 1 year ago #

    My website is
    http://bit.ly/ZqzMth
    and this is my robots.txt
    http://bit.ly/10Hyrgr

    i have a problem indexing the questions on the second page for example
    http://bit.ly/119Am98 this question.

    Also i need to index the blog posts that are on the blog page,but do not want to index the main page of the blog,just want to index the blog posts by themselves.
    I'm checking what is going to be indexed with
    http://www.xml-sitemaps.com/
    Any help would be great, thanks !!

  2. Pioneer Valley Web Design
    Member
    Posted 1 year ago #

    please use actual URL's - you will find few knowledgeable folks here who will follow a bit.ly url.

  3. memforum
    Member
    Posted 1 year ago #

    Thanks, the reason i use bit.ly is to prevent my sites url being indexed by wordpress.org.
    Last thing i want is that people who search my site finds this question about my site.

Topic Closed

This topic has been closed to new replies.

About this Topic