Keeping media private from spiders?

  • sekersley

    (@sekersley)


    13 years, 11 months ago

    I get google alerts for my name and today what I got was a link to an e-book which I don’t want people to have access to unless they fill in a form. How can I keep media private?

Viewing 2 replies - 1 through 2 (of 2 total)
  • weirdnews

    (@weirdnews)

    13 years, 11 months ago

    create robots.txt file upload to your public_html containing user-agent dissallow /specific files you dont want crawled 😉

    weirdnews

    (@weirdnews)

    13 years, 11 months ago

    example
    User-agent: *
    Allow: /
    Disallow: /wp-admin/.
    Disallow: /wp-admin

    ———————
    above tells bots is ok to index site but stay out of admin backend

Viewing 2 replies - 1 through 2 (of 2 total)
  • The topic ‘Keeping media private from spiders?’ is closed to new replies.