WordPress.org

Ready to get started?Download WordPress

Forums

Wordfence Security
[resolved] How should we treat Google's crawlers ? (3 posts)

  1. CentralTrans
    Member
    Posted 1 year ago #

    there is an option to give unlimited access to verified google crawlers. Is there a list of verified crawlers that get unlimited access?

    http://wordpress.org/extend/plugins/wordfence/

  2. Wordfence
    Member
    Plugin Author

    Posted 1 year ago #

    Hi,

    No. We verify google crawlers by doing a DNS PTR lookup as per Google's official recommendations.

    Regards,

    Mark.

  3. CentralTrans
    Member
    Posted 1 year ago #

    what about bing, yahoo, etc... ?

Topic Closed

This topic has been closed to new replies.

About this Plugin

About this Topic

Tags

No tags yet.