WordPress › Support » robots.txt

Tag: robots.txt Add New »

Topic Posts Last Poster Freshness
The meta description does not show up on yahoo and bing, 4 Peter Cralen 8 months
[resolved] WWW site Cannot Fetch Robotx.txt 6 Tui Lei Hai 8 months
Google can't crawl my website 5 Hosting Kingdom 8 months
A description for this result is not available because of this site's robots.txt 2 C W 8 months
googlebot is unable to access my website 2 toshi345 9 months
[resolved] Help with robots.txt and media SEO issue. 7 jarmerson 9 months
[resolved] I have 2 robots.txt !? 2 hellomimimimi 9 months
Robots.txt, WordPress and Google Webmaster Tools 5 Tara 9 months
[resolved] Where to put robots.txt file - subdirectory or root? 4 DareDevil73 10 months
Blocking Robots 4 Justin Greer 10 months
[Plugin: Yoast SEO] Recommended settings for robots.txt 1 wilflare 10 months
WordPress ROBOTS.txt not working / google not crawling 2 sfwebsitedesgin 11 months
[Plugin: Google XML Sitemaps] Question on "Add Sitemap to Virtual Robots.txt" file 2 einstem 11 months
Multisite caused two major problems for my blog 4 Ipstenu (Mika Epstein) 11 months
WP's Default robots.txt bad for google? 3 joshbauguss 12 months
[Plugin: Yoast SEO] Non-existent 'robots.txt' blocking category url's 1 Bob0221 1 year
Search Engine Visibility Encourage search engines to index this site 11 stock134 1 year
Majestic SEO - Returning 406 Error 6 Viktor Nagornyy 1 year
[Plugin: SiteTree] Excluded pages in XML 1 phillip.roberts 1 year
Fix robots.txt 3 YassJohn 1 year
W3 Total Cache and robots.txt 1 pipsqueak87 1 year
All in one SEO 1 redneckokie 1 year
robots.txt thank you page should not be indexed by search engine 2 James Huff 1 year
[resolved] [Plugin: WP Super Cache] Conflict with Google Webmasters robots.txt 2 ElPapay 1 year
[Plugin: Yoast SEO] Sitemap: /sitemap_index.xml is wrong? 2 FroggyQc 1 year
[resolved] Default wordpress robots.txt? 6 iwd1 1 year
robots.txt redux 6 jbeaumont1 1 year
[Plugin: Yoast SEO] Robots.txt causing Crawl problems on Google Webmasters 1 mramsey 1 year
[Plugin: Yoast SEO] After installing SEO plugin, Google can't access Robots.txt 12 cybermed 1 year
Googlebot is blocked by robots.txt 1 sreng vichhay 1 year

Add New Topic

You must log in to post.