What is difference between block and throttle?

Viewing 4 replies - 1 through 4 (of 4 total)
  • WFSupport

    (@wfsupport)

    9 years, 6 months ago

    Throttle slows down the requests so that if you are being hit by say a msn bing bot gone wrong, or some chinese scraper site, then hits don’t affect your site as badly.

    Does that help?

    tim

    Thread Starter hchoate

    (@hchoate)

    9 years, 6 months ago

    ‘Throttle’ does indeed mean ‘slow down’. I was hoping for deeper understanding. For example, setting

    ‘If crawler’s page views excede:’

    to, say,

    ‘960 per minute (16 per second)’

    implies that the crawler is blocked for the remainder of a minute once its page views for that minute total 960, but is that in fact the case?

    WFSupport

    (@wfsupport)

    9 years, 6 months ago

    Confirmed this is exactly how it works. you have site throttled at 960 times a minute. On the 961st time it receives a 503 error (temp unavailable) for that visit and every subsequent visit during that minute.

    tim

    Thread Starter hchoate

    (@hchoate)

    9 years, 6 months ago

    Cool. Very good. Thanks.

Viewing 4 replies - 1 through 4 (of 4 total)
  • The topic ‘What is difference between block and throttle?’ is closed to new replies.