Is it a header that tells W3 to cache?

  • alchemistGM

    (@alchemistgm)


    15 years ago

    I just noticed this – if I visit a page on my site with a browser it will cache the page. But I can visit it over and over with a tool like http://www.feedthebot.com/tools/spider/index.php and W3TC does not cache the page.

    Does anyone know what has to happen for W3TC to cache a page beyond just hitting the URL?

    Thanks!

Viewing 2 replies - 1 through 2 (of 2 total)
  • MegaZone

    (@megazone)

    15 years ago

    There is a default list of excluded User Agents, and I believe ‘bot’ is on that list. You generally don’t want spiders to get a cached copy, you want them to pull the newest version to index. So most caching systems are setup to try to recognize any bots and bypass the cache.

    Plugin Contributor Frederick Townes

    (@fredericktownes)

    14 years, 11 months ago

    Also, some tools ignore headers in order for them to work.

Viewing 2 replies - 1 through 2 (of 2 total)

The topic ‘Is it a header that tells W3 to cache?’ is closed to new replies.