Support » Fixing WordPress » Restrict to only registered users but allow search engines to crawl the site

Viewing 1 replies (of 1 total)
  • thats going to ne a tough one to implement- and there is one primary reason why.

    Trying to track search engine spiders by IPs alone would be a monumental task

    Its nearly impossible to identify search engine spiders without using their user agent. And user agents can be spoofed — very easily.

    I would say, off the top of my head, that if you intend to have a strict members only blog, than you’re going to have to suffer the consequences of losing out to search engines.

Viewing 1 replies (of 1 total)
  • The topic ‘Restrict to only registered users but allow search engines to crawl the site’ is closed to new replies.