I’m starting a blog over at http://www.djp.ch/blog/
Display is perfect in regular browser.
When I get this url with lynx or wget, I’m being redirected to http://www.robotstxt.org/
Can someone explain what’s happening? (This does not happen with other pages on the same website, and there is nothing special in robots.txt)
Here is a transcript from the wget command:
gl@malvoisie:~/tmp2$ wget http://www.djp.ch/blog
Resolving www.djp.ch... 220.127.116.11
Connecting to www.djp.ch|18.104.22.168|:80... connected.
HTTP request sent, awaiting response... 302 Found
Location: http://www.robotstxt.org/ [following]
Resolving http://www.robotstxt.org... 22.214.171.124
Connecting to http://www.robotstxt.org|126.96.36.199|:80… connected.
HTTP request sent, awaiting response… 200 OK
Length: 1,659 (1.6K) [text/html]
100%[====================================>] 1,659 –.–K/s
18:49:26 (25.11 MB/s) – `index.html’ saved [1659/1659]
- The topic ‘lynx and wget are redirected from blog to robotstxt.org’ is closed to new replies.