Forum Replies Created

Viewing 3 replies - 1 through 3 (of 3 total)
  • Thread Starter mzzrrt

    (@mzzrrt)

    The problem is that google indexed these pages anyway, even if the robots.txt was blocking them.
    What could I do?

    that’s my robots.txt
    User-agent: *
    Disallow: /wp-admin/
    Disallow: /wp-includes/
    Disallow: /wp-content/themes/
    Disallow: /wp-content/plugins/

    and it should deindex all the pages that I don’t want to be on google.

    Thank you both

    Thread Starter mzzrrt

    (@mzzrrt)

    Hello, thanks for your reply.

    I’ve just noticed I actually prevent these folders to be crawled, but they still show up when I look for site:url

    I use this, which is enough:
    User-agent: *
    Disallow: /wp-admin/
    Disallow: /wp-includes/

    The point is:
    – I’ve to click on “show omitted results” to see them
    – on google web tools, these results (/wp-admin/) are not indexed, but they’re blocked, not crawled.
    – Basically, they show up when I search site:url, clicking on omitted results. But they seem to be correctly blocked and not considered

    What might this be?
    thanks

    Thread Starter mzzrrt

    (@mzzrrt)

    I still need to insert an HTML code in a post so that visitors can see and copy the plain HTML text… is there a way to do this?
    thanks!

Viewing 3 replies - 1 through 3 (of 3 total)