Google Crawler or Scraper?

  • Angie23

    (@newbie101)


    7 years, 10 months ago

    Hi,

    Getting daily crawls from this bot and wonder if that is a google bot or someone trying to scrape my feed?

    Absecon, United States left http://mydomain.com/feed/ and visited https://mydomain.com/feed/
    6/23/2016 8:31:42 AM (48 minutes ago) IP: 104.237.146.95 [unblock] Hostname: li834-95.members.linode.com
    Browser: undefined
    Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

    Should I block them?

    Thanks

  • The topic ‘Google Crawler or Scraper?’ is closed to new replies.

Tags