WordPress.org

Forums

WordPress › Support » robots.txt

Tag: robots.txt Add New »

Topic Posts Last Poster Freshness
[Plugin: W3 Total Cache] Resolved: Google Bot not able to get Cloud Front content 1 snagnever 9 hours
[Plugin: Multipart robots.txt editor] The default Robots.txt is still showing up 2 Viktor Sz├ępe 2 weeks
My Robots txt is not editing 4 James Huff (MacManX) 4 weeks
The meta description does not show up on yahoo and bing, 4 Peter Cralen 1 month
[resolved] WWW site Cannot Fetch Robotx.txt 6 Tui Lei Hai 1 month
Google can't crawl my website 5 Hosting Kingdom 2 months
A description for this result is not available because of this site's robots.txt 2 C W 2 months
googlebot is unable to access my website 2 toshi345 2 months
[resolved] Help with robots.txt and media SEO issue. 7 jarmerson 2 months
[resolved] I have 2 robots.txt !? 2 hellomimimimi 3 months
Robots.txt, WordPress and Google Webmaster Tools 5 Tara 3 months
[Plugin: WordPress SEO by Yoast] Editing robots.txt file through Yoast on multisite 3 Hatchman33 3 months
[resolved] Where to put robots.txt file - subdirectory or root? 4 DareDevil73 3 months
Blocking Robots 4 Justin Greer 3 months
[Plugin: WordPress SEO by Yoast] Recommended settings for robots.txt 1 wilflare 4 months
WordPress ROBOTS.txt not working / google not crawling 2 sfwebsitedesgin 4 months
[Plugin: Google XML Sitemaps] Question on "Add Sitemap to Virtual Robots.txt" file 2 einstem 5 months
Multisite caused two major problems for my blog 4 Ipstenu (Mika Epstein) 5 months
WP's Default robots.txt bad for google? 3 joshbauguss 5 months
[Plugin: WordPress SEO by Yoast] Non-existent 'robots.txt' blocking category url's 1 Bob0221 5 months
Search Engine Visibility Encourage search engines to index this site 11 stock134 6 months
Majestic SEO - Returning 406 Error 6 Viktor Nagornyy 6 months
[Plugin: SiteTree] Excluded pages in XML 1 phillip.roberts 6 months
Fix robots.txt 3 YassJohn 6 months
W3 Total Cache and robots.txt 1 pipsqueak87 6 months
All in one SEO 1 redneckokie 6 months
robots.txt thank you page should not be indexed by search engine 2 James Huff (MacManX) 6 months
[resolved] [Plugin: WP Super Cache] Conflict with Google Webmasters robots.txt 2 ElPapay 6 months
[Plugin: WordPress SEO by Yoast] Sitemap: /sitemap_index.xml is wrong? 2 FroggyQc 7 months
[resolved] Default wordpress robots.txt? 6 iwd1 7 months

Add New Topic

You must log in to post.