wp-fastest-cache and robots.txt

  • pavelpluz

    (@pavelpluz)


    8 years, 9 months ago

    hello dear author,
    I would like to know your suggestion.
    currently I use in my robots.txt

    Disallow: /wp-content/cache
    Allow: /wp-content/cache/*.js*
    Allow: /wp-content/cache/*.css*

    how do you think? is it right to block cache folder? or we need fully allow cache folder? because I dont know how it will react to index posts.

    thank you

Viewing 3 replies - 1 through 3 (of 3 total)
  • Plugin Author Emre Vona

    (@emrevona)

    8 years, 9 months ago

    You should not disallow like that. why do you need that?

    Thread Starter pavelpluz

    (@pavelpluz)

    8 years, 9 months ago

    “Disallow: /wp-content/cache”

    About 64,100 results in google search ))

    I added disallow to cache folder because did not want cached files to be crawled and indexed, but allowed css and js files to be indexed, because Google has started penalizing websites that block the crawling of js and css files.

    As I understand you recommend not to block from bots(disallow) at all cache folder.

    thanks for your reply and advice!

    Plugin Author Emre Vona

    (@emrevona)

    8 years, 9 months ago

    so strange issue. please contact me via email: http://www.wpfastestcache.com/contact-us/

Viewing 3 replies - 1 through 3 (of 3 total)

The topic ‘wp-fastest-cache and robots.txt’ is closed to new replies.