WordPress.org

Ready to get started?Download WordPress

Forums

WordPress › Support » robots.txt

Tag: robots.txt Add New »

Topic Posts Last Poster Freshness
[Plugin: WordPress SEO by Yoast] How to edit robots.txt file? 2 Andy Fragen 2 years
[Plugin: WordPress SEO by Yoast] robots.txt and sitemap entry 2 rocker65 2 years
robots.txt and woocommerce 3 EnergyFreak 2 years
Disallowing Permalink'd page in robots.txt 4 tomontoast 2 years
Categories and Tags - Crawl or Not to Crawl 1 robertallen 2 years
Hiding from google 2 PositivelyRandy 2 years
How WordPress generates robots.txt 1 not1_name 2 years
Virtual robots.txt blocks site from google 11 esmi 2 years
[Plugin: Google XML Sitemaps] How can I exclude directories if I cant have a robots.txt file? 1 bcr8tive 2 years
Is my Robots.txt file correct? 5 TheGift73 2 years
How to edit my robots.txt file 5 ebooker21 2 years
[resolved] How to configure a robots.txt file for WordPress? 2 ebooker21 2 years
[Plugin: WordPress SEO by Yoast] How to prevent a page of being crawled by search engines? 2 Toshi Yoshida 2 years
[resolved] [Plugin: BulletProof Security] robots.txt and Bulletproof Security 2 AITpro 2 years
Robots.txt error 3 Shasha 2 years
[Plugin: WordPress SEO by Yoast] Google Webmaster Tools cannot parse sitemap.xml 20 Mike Imken 2 years
[Plugin: WordPress SEO by Yoast] website blocked by robots.txt 1 emilio147 2 years
[Plugin: Google XML Sitemaps] How do I add /disallow/ lines to the virtual robots.txt ? 1 mluther 2 years
question about robots.txt 4 fxjudy 2 years
Robots.txt ISSUE 4 santy143all 2 years
Google XML Sitemaps with my own robots.txt 4 xa2 2 years
[resolved] robots.txt and google 13 tashb 2 years
[resolved] Googlebot is blocked by robots.txt 12 tashb 2 years
robots.txt 7 KYSean 2 years
robots.txt 9 graham85 2 years
google is blocked by robots.txt 1 assassinsat 2 years
Robots.txt fetch on google webmaster 9 Gaurav Raghav 2 years
robots.txt question 3 DNBrawler 2 years
/search/ directory getting indexed. How to best deal with it! 1 ghacks 2 years
[Plugin: WordPress SEO by Yoast] How to edit robots.txt in Yoast SEO; googlebot conflict? 1 suehutton 2 years

Add New Topic

You must log in to post.