Title: Formatting Problem robots.txt problem Last modified: August 19, 2016 --- # Formatting Problem robots.txt problem * [Sarah_Harvey](https://wordpress.org/support/users/sarah_harvey/) * (@sarah_harvey) * [17 years, 8 months ago](https://wordpress.org/support/topic/formatting-problem-robotstxt-problem/) * Okay, I installed 2.6.1 the other day and have been working on it. Since then I have had this unusual problem where I cannot save a break besides one normal one. * So what would happen is that if I create a table, I would normal, hit return so that there is a space between the table and a new paragraph. Unfortunately it refuses to save it. I then eventually tried to manually enter the space in the HTML format, and its still unsuccessful. * Here is the post where I failed miserably and I don’t know how to handle it. Even next to the picture I cannot get a good spacing. So if anyone can help me here I would appreciate it. * [http://www.topgolfmembership.com/2008/09/tpc-twin-cities-membership/](http://www.topgolfmembership.com/2008/09/tpc-twin-cities-membership/) * I mean I can leave it as it is, but it just doesn’t look right. * I would love to be able to save more than 2 spaces in between some text at times and it refuses. * Now the other problem I encountered was last night with Google Webmaster Tools. I wanted to add a sitemap to the google webmaster tools, but couldn’t upload it since it keeps saying the robots.txt is preventing it. I went through the files and cannot find a robots.txt file anywhere…. so is it hidden within wordpress itself? I need to create a sitemap to get it listed and at present I can’t even get a nice description in the search engine listed under my url. Something is very wrong. >< Viewing 6 replies - 1 through 6 (of 6 total) * [whooami](https://wordpress.org/support/users/whooami/) * (@whooami) * [17 years, 8 months ago](https://wordpress.org/support/topic/formatting-problem-robotstxt-problem/#post-868920) * #2 : well, wherever you looked you arent looking in the right place. Google is rarely wrong. * [http://www.topgolfmembership.com/robots.txt](http://www.topgolfmembership.com/robots.txt) * ``` User-agent: * Disallow: ``` * Thread Starter [Sarah_Harvey](https://wordpress.org/support/users/sarah_harvey/) * (@sarah_harvey) * [17 years, 8 months ago](https://wordpress.org/support/topic/formatting-problem-robotstxt-problem/#post-869144) * Believe me when I say it isn’t in the root directory of topgolfmembership. * I used the quick install from godaddy for wordpress and I cannot find this robots. text anywhere. I am looking through it now as I am typing it… again. * Anyway, I will sort the robots.text…I would still love to find out how to deal with the formatting problem. Can anyone help with that? * Thanks for letting me know there is a robots.text though…I thought I was going mad. * Moderator [Samuel Wood (Otto)](https://wordpress.org/support/users/otto42/) * (@otto42) * WordPress.org Admin * [17 years, 8 months ago](https://wordpress.org/support/topic/formatting-problem-robotstxt-problem/#post-869145) * That robots.txt is generated by WordPress. Also, that robots.txt does not actually disallow anything. That’s the normal robots.txt for “everything open”. * See here: [http://www.robotstxt.org/](http://www.robotstxt.org/) * Thread Starter [Sarah_Harvey](https://wordpress.org/support/users/sarah_harvey/) * (@sarah_harvey) * [17 years, 8 months ago](https://wordpress.org/support/topic/formatting-problem-robotstxt-problem/#post-869146) * Yes, thanks…I actually found a thread on the net somewhere else that explains it perfectly and just uploaded my robots.txt file and it over-wrote this phantom robots.text file. Believe me when I say it wasn’t present in my installation directory or anywhere in the sub directories. I had a damn good look. I can only assume its the rewrite rule as they stated. * Read it all here: * [http://www.squareoak.com/blog/godaddy-phantom-robotstxt-files/](http://www.squareoak.com/blog/godaddy-phantom-robotstxt-files/) * Thread Starter [Sarah_Harvey](https://wordpress.org/support/users/sarah_harvey/) * (@sarah_harvey) * [17 years, 8 months ago](https://wordpress.org/support/topic/formatting-problem-robotstxt-problem/#post-869147) * Actually just a bit further down I saw this post: * # Otto Says: June 20th, 2008 at 3:39 pm * I’m Otto, a moderator on the WordPress.org support forums. * The latest versions of WordPress DO generate robots.txt files via rewrites, if there is no robots.txt file already present in the main WordPress directory. * If you go to the Settings->Privacy menu option in WordPress, then you’ll see an option there that changes WordPress to block or allow search engines to index the site. If you switch this, then you’ll notice the “pretend” robots.txt file changes. * So yes, WordPress is absolutely generating this fake file. GoDaddy hosting is NOT at fault here. * —————— * I actually switched the option in wordpress to allow all things almost two days ago, unless it takes a while to happen? * Moderator [Samuel Wood (Otto)](https://wordpress.org/support/users/otto42/) * (@otto42) * WordPress.org Admin * [17 years, 8 months ago](https://wordpress.org/support/topic/formatting-problem-robotstxt-problem/#post-869163) * I’m really not sure what you’re talking about. This robots.txt file: * ``` User-agent: * Disallow: ``` * is an “allow everybody” file. It blocks nothing at all. That’s what the Disallow: with nothing after it means. Nothing is disallowed. * So when you switched the option, then this is what you got. It’s already taken effect. What’s the problem? Viewing 6 replies - 1 through 6 (of 6 total) The topic ‘Formatting Problem robots.txt problem’ is closed to new replies. ## Tags * [formatting](https://wordpress.org/support/topic-tag/formatting/) * [robots.txt](https://wordpress.org/support/topic-tag/robots-txt/) * [sitemap](https://wordpress.org/support/topic-tag/sitemap/) * In: [Fixing WordPress](https://wordpress.org/support/forum/how-to-and-troubleshooting/) * 6 replies * 3 participants * Last reply from: [Samuel Wood (Otto)](https://wordpress.org/support/users/otto42/) * Last activity: [17 years, 8 months ago](https://wordpress.org/support/topic/formatting-problem-robotstxt-problem/#post-869163) * Status: not resolved ## Topics ### Topics with no replies ### Non-support topics ### Resolved topics ### Unresolved topics ### All topics