robots.txt need help (3 posts)

  1. memforum
    Posted 2 years ago #

    My website is
    and this is my robots.txt

    i have a problem indexing the questions on the second page for example
    http://bit.ly/119Am98 this question.

    Also i need to index the blog posts that are on the blog page,but do not want to index the main page of the blog,just want to index the blog posts by themselves.
    I'm checking what is going to be indexed with
    Any help would be great, thanks !!

  2. Pioneer Web Design
    Posted 2 years ago #

    please use actual URL's - you will find few knowledgeable folks here who will follow a bit.ly url.

  3. memforum
    Posted 2 years ago #

    Thanks, the reason i use bit.ly is to prevent my sites url being indexed by wordpress.org.
    Last thing i want is that people who search my site finds this question about my site.

Topic Closed

This topic has been closed to new replies.

About this Topic