Forums

WordPress › Support » robots.txt

Tag: robots.txt Add New »

Topic Posts Last Poster Freshness
Categories and Tags - Crawl or Not to Crawl 1 robertallen 5 months
Hiding from google 2 PositivelyRandy 5 months
How WordPress generates robots.txt 1 not1_name 5 months
Virtual robots.txt blocks site from google 11 esmi 6 months
[Plugin: Google XML Sitemaps] How can I exclude directories if I cant have a robots.txt file? 1 bcr8tive 6 months
Is my Robots.txt file correct? 5 TheGift73 6 months
How to edit my robots.txt file 5 ebooker21 6 months
How to configure a robots.txt file for WordPress? 2 ebooker21 6 months
[Plugin: WordPress SEO by Yoast] How to prevent a page of being crawled by search engines? 2 Toshi Yoshida 7 months
[resolved] [Plugin: BulletProof Security] robots.txt and Bulletproof Security 2 AITpro 7 months
Robots.txt error 3 Shasha 7 months
[Plugin: WordPress SEO by Yoast] Google Webmaster Tools cannot parse sitemap.xml 20 Austin Marketing Dude 7 months
[Plugin: WordPress SEO by Yoast] website blocked by robots.txt 1 emilio147 7 months
[Plugin: Google XML Sitemaps] How do I add /disallow/ lines to the virtual robots.txt ? 1 mluther 8 months
question about robots.txt 4 fxjudy 8 months
Robots.txt ISSUE 4 santy143all 8 months
Google XML Sitemaps with my own robots.txt 4 xa2 8 months
[resolved] robots.txt and google 13 tashb 8 months
[resolved] Googlebot is blocked by robots.txt 12 tashb 8 months
robots.txt 7 KYSean 8 months
robots.txt 9 graham85 8 months
google is blocked by robots.txt 1 assassinsat 8 months
Robots.txt fetch on google webmaster 9 Gaurav Raghav 9 months
robots.txt question 3 DNBrawler 9 months
/search/ directory getting indexed. How to best deal with it! 1 ghacks 9 months
[Plugin: WordPress SEO by Yoast] How to edit robots.txt in Yoast SEO; googlebot conflict? 1 suehutton 9 months
Weird robots.txt 404 problem on multisite 13 Ipstenu (Mika Epstein) 10 months
Robots.txt problem Need help 9 noumanniazi 10 months
[resolved] [Plugin: All-in-One Event Calendar] trouble with robots.txt when adding event to google calendar 4 Richard 10 months
How to disable the automatically generated robots.txt? 2 bloup 10 months

Add New Topic

You must log in to post.