WordPress.org

Forums

Robots.txt is blocking my URLs (2 posts)

  1. eazy4me
    Member
    Posted 1 year ago #

    Hi,

    I got a problem. My website is not getting indexed. It says my robots.txt blocks 85 URLS. In google i checked: site:http://www.hautemagazine.nl but it seems it indexed my website in the beginning when building the website. The privacy settings are okay. This is my robots.txt

    User-agent: *
    Disallow: /feed/
    Disallow: /trackback/
    Disallow: /wp-admin/
    Disallow: /wp-content/
    Disallow: /wp-includes/
    Disallow: /xmlrpc.php
    Sitemap: http://www.hautemagazine.nl/sitemap.xml

    I tried to find a solution on the web but couldn't find one. I am really searching for any help.

  2. shandiz
    Member
    Posted 1 year ago #

    hi
    you must Allow root domain :

    User-agent: *
    Disallow: /feed/
    Disallow: /trackback/
    Disallow: /wp-admin/
    Disallow: /wp-content/
    Disallow: /wp-includes/
    Disallow: /xmlrpc.php
    Sitemap: http://www.hautemagazine.nl/sitemap.xml
    Allow: /

Topic Closed

This topic has been closed to new replies.

About this Topic