wget -r

$ curl -s http://localhost/index.html
<a href="/about">about</a>
$ curl -s http://localhost/about/index.html
Hello!

$ wget -r http://localhost/index.html
--2010-09-06 00:00:27--  http://localhost/index.html
Resolving localhost... 127.0.0.1
Connecting to localhost|127.0.0.1|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 27 [text/html]
Saving to: “localhost/index.html”

100%[======================================>] 27          --.-K/s   in 0s      

2010-09-06 00:00:27 (1018 KB/s) - “localhost/index.html” saved [27/27]

Loading robots.txt; please ignore errors.
--2010-09-06 00:00:27--  http://localhost/robots.txt
Reusing existing connection to localhost:80.
HTTP request sent, awaiting response... 404 Not Found
2010-09-06 00:00:27 ERROR 404: Not Found.

--2010-09-06 00:00:27--  http://localhost/about
Reusing existing connection to localhost:80.
HTTP request sent, awaiting response... 301 Moved Permanently
Location: http://localhost/about/ [following]
--2010-09-06 00:00:27--  http://localhost/about/
Reusing existing connection to localhost:80.
HTTP request sent, awaiting response... 200 OK
Length: 7 [text/html]
Saving to: “localhost/about/index.html”

100%[======================================>] 7           --.-K/s   in 0s      

2010-09-06 00:00:27 (326 KB/s) - “localhost/about/index.html” saved [7/7]

FINISHED --2010-09-06 00:00:27--
Downloaded: 2 files, 34 in 0s (709 KB/s)

$ cd localhost/
$ find .
.
./index.html
./about
./about/index.html