I'm trying to figure out if there's a way to update the virtual robots.txt. Can I somehow modify that? Or do I just upload my own and it goes away?
I couldn't find this in the docs at all.
I'm trying to figure out if there's a way to update the virtual robots.txt. Can I somehow modify that? Or do I just upload my own and it goes away?
I couldn't find this in the docs at all.
Try uploading a robots.txt to the root level of your domain (this is where this file goes).
I know how to create one. What I wasn't sure on was if I could modify the output of the virtual robots.txt that WP uses.
Check your dashboard privacy settings and try an actual robots.txt, which have priority over any "virtual" one.
@iridiax thanks! It was the privacy settings preventing google from crawling my website... Cheers
This topic has been closed to new replies.