How do I copy files to a Netgear DG834G router without using wget? [more inside]
posted by alby on Oct 10, 2009 - 11 answers

The equivalent of ping for http connections? [more inside]
posted by zippy on May 3, 2009 - 14 answers

Alternatives to lynx, wget and get from the unix command line? [more inside]
posted by Null Pointer and the Exceptions on Jul 11, 2007 - 11 answers

I am trying to transfer a couple of websites from 1and1 beginner accounts to dreamhost. I usually do this by zipping or tarring the source site and then ftp. The rub is that the 1and beginner package does not allow shell access (although the target does). I'm looking at wget but I don't see a way to make it copy hidden files, which could bite me later if there are some config files buried in there somewhere. Probably missing something real obvious here. Any ideas?
posted by Manjusri on Apr 18, 2007 - 16 answers

How do I download google's entire cache of a website that has 137,000 hits? [more inside]
posted by bigmusic on Jun 14, 2006 - 11 answers

I'd like to use wget to make a local copy of a web page at mlb.com (specifically this one) but all my attempts have resulted in an incomplete page. What arguments should I be giving wget to make it work?
posted by event on Aug 27, 2005 - 4 answers

I need to mass download a chunk of a website. It's about 15000 pages, with identical urls except for one portion with a sequential numerical indicator for each page. I don't need to spider any links, I just need it to work through the list of pages. I know there's got to be an easy script-y way of doing this, but you know, I'm a lawyer. Please help!
posted by monju_bosatsu on Jun 10, 2004 - 10 answers

Website Mirroring Tools: I usually use wget, but find that it seems to have at least one nasty flaw: it doesn't fetch stylesheets, or images named in stylesheets (it may also have other flaws I'm not aware of). Is there something better out there that I can just give a homepage URL and have it suck down an entire site?
posted by namespan on Mar 28, 2004 - 7 answers