Prevent Google Indexing

  • Resolved ap2025

    (@ap2025)


    1 week, 2 days ago

    I’ve noticed that, somehow, Google (and other search engines) are ‘indexing’ the ‘sdc’ download link. I don’t have the sdc download link publicly available…it’s only after a purchase, so it’s behind a wall that the search engine/robots should not be accessing.

    Is there a way to prevent the sdc links from being collected by search engines and/or on a sitemap (although I didn’t see it on the sitemap, but might be missing it). Thank you!

Viewing 2 replies - 1 through 2 (of 2 total)
  • Plugin Author Jeff Starr

    (@specialk)

    1 week, 1 day ago

    Glad to help.

    Search engines pretty much do whatever they want. Some of the big ones (e.g., Google) do pretty well in obeying robots.txt rules. So probably will help to add this to your site’s robots.txt file:

    User-agent: *
    Disallow: /sdc_download/

    Save changes and wait a while for Google et al to notice, should take a day or two on average, depending on the site, setup, etc. The result is that all compliant search engines will no longer crawl/follow any of the SDC download links. Non-compliant search engines, not so much.

    Thread Starter ap2025

    (@ap2025)

    1 week ago

    Thank you!

Viewing 2 replies - 1 through 2 (of 2 total)

You must be logged in to reply to this topic.

  • 2 replies
  • 2 participants
  • Last reply from: ap2025
  • Last activity: 1 week ago
  • Status: resolved