Issue with robot.txt
So I have been trying to plug the holes on my wordpress site to get rid of duel content and have had pretty good luck with my robot.txt file it has blocked a lot of unwanted stuff BUT this morning checked my site in google and some things are still leaking out :
Below is my robot.txt code:
Do I just add Disallow: /blog/category/*/* and Disallow:/blog/tag/*
- The topic ‘Issue with robot.txt’ is closed to new replies.