[ale] wget

Christopher Bergeron christopher at bergeron.com
Mon Jan 7 20:16:58 EST 2002


wget -r -l0 http://url.com/

be careful though, this will traverse _every_ link.  Including ad's and all
thier links.  You've been warned, but hopefully this will help.  I'm certain
the -l flag is what you want, and you can put different levels on it's
"recursivity" (if that's a word).  Check the man page for details, but look
for " -l "

-CB

-----Original Message-----
From: esoteric at 3times25.net [mailto:esoteric at 3times25.net]
To: ale at ale.org
Sent: Monday, January 07, 2002 7:58 PM
To: ALE
Subject: [ale] wget


I'm attempting to recursively retrieve a web site using wget.  My
expectation is that it would travel down all the directories trees and
get every file.  I've tried various options, but none seem to do what I
would like.  Clues would be helpful.

For example if I execute the following:
wget -m www.foo.net/user-dir/



I was expecting everything under user-dir (directories and there
contents) would be retrieved.  As the -m option includes '-l inf' my
expectation was that it would traverse
www.foo.net/user-dir/dir0/...../dirN/

Suggestions?

--
Until later: Geoffrey		esoteric at 3times25.net

"...the system (Microsoft passport) carries significant risks to users
that
are not made adequately clear in the technical documentation available."
- David P. Kormann and Aviel D. Rubin, AT&T Labs - Research
- http://www.avirubin.com/passport.html

---
This message has been sent through the ALE general discussion list.
See http://www.ale.org/mailing-lists.shtml for more info. Problems should be
sent to listmaster at ale dot org.



---
This message has been sent through the ALE general discussion list.
See http://www.ale.org/mailing-lists.shtml for more info. Problems should be 
sent to listmaster at ale dot org.






More information about the Ale mailing list