How to edit my robots.txt file (5 posts)

  1. Jakecrpntr7
    Posted 4 years ago #

    I am having all kinds of trouble with my robots.txt file blocking google adsense as well as searches. I called Godaddy (my hosting provider) and they said the problem was not on the hosting side (After about an hour on the phone and having to connect with their advanced hosting people), I have looked through my FTP and cannot find the file anywhere to delete it. My site is Lifetimestocks.com and the robots file can be viewed at lifetimestocks.com/robots.txt and the problem is evident that bots are being disallowed (Maybe by link alias generator thing?) but i cannot figure out how to change it. My privacy setting is set to visible for search engines and i use SEO ultimate, but do not think that generated it. I would assume it came out of my site map generated which started out through the plugin BWP Google XML Sitemaps by khang minh but that plugin was deleted and i replaced it with google xml site maps by Arnie Brachhold

  2. Darin Kotter
    Posted 4 years ago #

    I believe WordPress itself creates the robots.txt file and it is a virtual file, meaning there won't be a hard copy on your server for you to edit. You could create one yourself and upload it to your server and I think search engines will use that one instead, or you can use a plugin like this one, that will let you edit your robots.txt file from the WordPress admin.

  3. Nailed it in one, dkotter :)

    If you need some help with your robots.txt, check out http://perishablepress.com/wordpress-robots-rules/ for some advice.

  4. Shasha
    Posted 3 years ago #

    Or you can simply take advice from :
    How to edit robots.txt in wordpress

  5. ebooker21
    Posted 3 years ago #

    Hi their

    Just install this plugin WP Robots Txt

    Goto settings/privacy settings

    Then add this to your robot txt file

    User-agent: Googlebot
    Allow: /

    Thats it.


Topic Closed

This topic has been closed to new replies.

About this Topic