robots.txt to just allow the homepage?

  • columboman

    (@columboman)


    14 years, 5 months ago

    Howdy,

    I’m after the correct robots.txt code that will allow just the indexing of the wordpress blog homepage and exclude everything else.

    (It’s for a school website so I’m not that bothered about SEO, I really only want the homepage to appear in google)

    So far I’ve come up with:

    Sitemap: http://www.mysite.com/sitemap.xml

User-agent: *

Disallow: /wp-content/
Disallow: /wp-icludes/
Disallow: /trackback/
Disallow: /wp-admin/
Disallow: /admin/
Disallow: /archives/
Disallow: /category/
Disallow: /chiefblog/
Disallow: /edjourneys/
Disallow: /friends/
Disallow: /tag/*
Disallow: /tag/
Disallow: /tmp/
Disallow: /wp-*
Disallow: /login/
Disallow: /*.js$
Disallow: /*.inc$
Disallow: /*.css$
Disallow: /*.php$
Disallow: /*.ico$

User-agent: All
Allow: /

User-agent: Googlebot-Image
Disallow: /

User-agent: ia_archiver
Disallow: /

User-agent: duggmirror
Disallow: /

    Cheers in advance, C.

Viewing 2 replies - 1 through 2 (of 2 total)
  • Thread Starter columboman

    (@columboman)

    14 years, 3 months ago

    bumpety bump.

    tephil

    (@tephil)

    14 years, 2 months ago

    I’m trying to do the same thing….
    bump
    I’m using google webmaster tools and I submitted a site map with just my homepage on it but I don’t know how to write a correct robot.txt file

Viewing 2 replies - 1 through 2 (of 2 total)
  • The topic ‘robots.txt to just allow the homepage?’ is closed to new replies.