WordPress.org

Forums

WordPress › Support » robots.txt

Tag: robots.txt Add New »

Topic Posts Last Poster Freshness
How to manage Robots.txt in Multisite 1 yuva1990 1 day
Spiders Ignore Addon Domain Robots.txt 2 James Huff (MacManX) 1 week
[Plugin: W3 Total Cache] Resolved: Google Bot not able to get Cloud Front content 1 snagnever 2 weeks
[Plugin: Multipart robots.txt editor] The default Robots.txt is still showing up 2 Viktor Sz├ępe 1 month
My Robots txt is not editing 4 James Huff (MacManX) 1 month
The meta description does not show up on yahoo and bing, 4 Peter Cralen 2 months
[resolved] WWW site Cannot Fetch Robotx.txt 6 Tui Lei Hai 2 months
Google can't crawl my website 5 Hosting Kingdom 2 months
A description for this result is not available because of this site's robots.txt 2 C W 2 months
googlebot is unable to access my website 2 toshi345 3 months
[resolved] Help with robots.txt and media SEO issue. 7 jarmerson 3 months
[resolved] I have 2 robots.txt !? 2 hellomimimimi 4 months
Robots.txt, WordPress and Google Webmaster Tools 5 Tara 4 months
[Plugin: WordPress SEO by Yoast] Editing robots.txt file through Yoast on multisite 3 Hatchman33 4 months
[resolved] Where to put robots.txt file - subdirectory or root? 4 DareDevil73 4 months
Blocking Robots 4 Justin Greer 4 months
[Plugin: WordPress SEO by Yoast] Recommended settings for robots.txt 1 wilflare 4 months
WordPress ROBOTS.txt not working / google not crawling 2 sfwebsitedesgin 5 months
[Plugin: Google XML Sitemaps] Question on "Add Sitemap to Virtual Robots.txt" file 2 einstem 5 months
Multisite caused two major problems for my blog 4 Ipstenu (Mika Epstein) 5 months
WP's Default robots.txt bad for google? 3 joshbauguss 6 months
[Plugin: WordPress SEO by Yoast] Non-existent 'robots.txt' blocking category url's 1 Bob0221 6 months
Search Engine Visibility Encourage search engines to index this site 11 stock134 6 months
Majestic SEO - Returning 406 Error 6 Viktor Nagornyy 6 months
[Plugin: SiteTree] Excluded pages in XML 1 phillip.roberts 7 months
Fix robots.txt 3 YassJohn 7 months
W3 Total Cache and robots.txt 1 pipsqueak87 7 months
All in one SEO 1 redneckokie 7 months
robots.txt thank you page should not be indexed by search engine 2 James Huff (MacManX) 7 months
[resolved] [Plugin: WP Super Cache] Conflict with Google Webmasters robots.txt 2 ElPapay 7 months

Add New Topic

You must log in to post.