WordPress.org

Ready to get started?Download WordPress

Forums

Why i have all url blocked by robots.txt (12 posts)

  1. ob86
    Member
    Posted 1 year ago #

    Hi,
    i've just published my website younewyork.it. I submit the sitemap.xml to google webmaster tools but it finds 328 problems (cos all urls are blocked by robots.txt).

    This is my robots:

    User-agent: *
    Disallow: /wp-
    Disallow: /cgi-bin/
    Disallow: /wp-admin/
    Disallow: /wp-includes/
    Disallow: /wp-content/
    Disallow: /filter/
    Disallow: /portfolio/
    Disallow: /box/
    Disallow: /trackback/
    Disallow: /feed/
    Disallow: /comments/
    Disallow: */trackback/
    Disallow: */feed/
    Disallow: */comments/
    Disallow: /tag/
    Disallow: /z/j/
    Disallow: /z/c/
    Disallow: /stats/
    Disallow: /dh_
    Disallow: /wp-content/b
    Disallow: /wp-content/p
    Disallow: /trackback/
    Disallow: /*?*
    Disallow: */trackback/
    Disallow: /*?
    Allow: /wp-content/uploads/
    Disallow: /category/
    Disallow: /testimonial/
    Disallow: /message-boxes/
    Disallow: /gallery/
    Disallow: /contattaci/
    Disallow: /wp-login.php
    Disallow: /senza-categoria/
    Disallow: */page/*
    Disallow: /tag/
    Disallow: */#

    Thanks

  2. Odai Athamneh
    Member
    Posted 1 year ago #

    Go to Settings > Reading, and find the section that says Search Engine Visibility. Is the box checked? If so, that's the problem.

  3. ob86
    Member
    Posted 1 year ago #

    The box was checked but not now!

  4. ob86
    Member
    Posted 1 year ago #

    maybe Google needs some times to read the robots?

  5. Odai Athamneh
    Member
    Posted 1 year ago #

    Yeah, Google only checks your website once in a while (no idea how often that is, probably not often if they think you've blocked them).

    Try manually submitting your site to Google.

  6. ob86
    Member
    Posted 1 year ago #

    Thanks Odai, i'll wait for G!

  7. Odai Athamneh
    Member
    Posted 1 year ago #

    Wait, are you saying that your robots.txt is still blocking all of those folders, even though you unchecked the box? Could you double-check and see what the robots.txt says right now?

  8. ob86
    Member
    Posted 1 year ago #

    what do you mean with "Could you double-check and see what the robots.txt says right now?"

  9. Odai Athamneh
    Member
    Posted 1 year ago #

    Are you able to access the files on your server? If so, find the robots.txt file, which should be in the same place you installed WordPress. Open it up and see what it says.

    You want to make sure that the robots.txt file is actually fixed before submitting your site to Google.

  10. ob86
    Member
    Posted 1 year ago #

    it seems right

    http:// www. younewyork.it /robots.txt

  11. Odai Athamneh
    Member
    Posted 1 year ago #

    Yeah, I agree. You're good to go.

  12. ob86
    Member
    Posted 1 year ago #

    Thank you very much!

Topic Closed

This topic has been closed to new replies.

About this Topic

Tags

No tags yet.