Robots.txt for WordPress, what to allow and disallow?
I have some questions about building a robots.txt for my wordpress site. I am not sure what I need to allow and disallow. I Googled and found some articles and used what some suggested, but I believe my site still isn’t being crawled successfully. Here is a link to my robots.txt if you want to see, http://www.attorneyvidbox.com/robots.txt
Is there a general robots.txt that wordpress provides? I just want Google to crawl my posts on my site.
- The topic ‘Robots.txt for WordPress, what to allow and disallow?’ is closed to new replies.