wget -r on a wordpress blog won't recursively download all files (2 posts)

  1. bwong64
    Posted 6 years ago #

    To try to download a static version of my wordpress blog for read-only purposes, I tried using wget to do it. However, with the -r option, it's still not doing it recursively and download all the files. I've tried many other options and it's not doing it.

    The strange thing is that this is only failing for wordpress blogs. If I use the same command to hit a non-wordpress site, it works.

    Any idea?


  2. bwong64
    Posted 6 years ago #

    Never mind. Turns out it was some kinda robot.txt restrictions by Apache. The -erobot.txt=off parameter for wget gets around that.

Topic Closed

This topic has been closed to new replies.

About this Topic