Comments on: I can haz sitemap?

Question: I can haz sitemap?

fvox13 — Thu, 01 May 2008 07:59:40 -0800

How can I print the directory structure of my website?

I've seen this question, and mine is similar, except I would like to do it over an FTP connection, if possible.

I work on the web team for a small, liberal-arts college. Our site has gotten unmanageably large, and we would like to create an *actual* sitemap (we have a sitemap, but the actual server has much much more than it technically should). I've considered just FTPing the whole site to a local machine, and running the dos TREE command, but it doesn't sort alphabetically, and we're talking about FTPing a LOT of stuff (like, it would take a day or so to do the transfer).

The site is running on IIS6 on a Win2K3 box (I know, I know...) so I can't really take advantage of some of the unix commands designed to do specifically what I want. And I don't believe TREE ships with Win2K3 (and even if it did, I can't use it, since it doesn't sort alphabetically).

What are my options here?

By: le morte de bea arthur

le morte de bea arthur — Thu, 01 May 2008 08:09:40 -0800

One simple option (non-FTP) would be to use a little script (presumably something written in ASP or .Net since it's running on IIS) that does a recursive scan of the folder structure and outputs this as HTML. It's not particularly complicated to do, although you'd probably have to set a nice bit timeout for the script if there are a lot of files. This one appears to do pretty much what you need.

By: le morte de bea arthur

le morte de bea arthur — Thu, 01 May 2008 08:10:26 -0800

That should have been 'big timeout', not 'bit'. Fingers like hams.

By: jacob

jacob — Thu, 01 May 2008 08:11:24 -0800

If your site has fewer than 500 pages, you can use this free tool to crawl the site to generate a Google XML sitemap, which you could convert to other formats if you need them.

If the site is larger, I believe they have for-pay options, too.

By: le morte de bea arthur

le morte de bea arthur — Thu, 01 May 2008 08:14:08 -0800

The difference between jacob's answer and mine is that the former will give you an actual 'site map' in the web sense (presumably only the publicly-accessible pages), whereas the latter gives you a directory structure. Depends really what you want - your question is a little ambiguous...

By: fvox13

fvox13 — Thu, 01 May 2008 08:22:25 -0800

@le morte de bea arthur: We're justing looking for a directory structure, for internal auditing purposes.

By: mmascolino

mmascolino — Thu, 01 May 2008 09:19:51 -0800

Just doing some quick googling and came across this article detailing a wsh solution to your problem. Haven't tried it but it appears to be what you want.

By: Pronoiac

Pronoiac — Thu, 01 May 2008 19:32:43 -0800

If you're more comfortable or familiar with Unix commands, cygwin lets you use some of them on Windows.

Well. I was honestly surprised to see that ncftp has no ability to pipe stuff, but then I noticed that ncftpls does exactly what you want.

By: Pronoiac

Pronoiac — Fri, 02 May 2008 00:26:37 -0800

Hah! ncftpls, even.

By: Pronoiac

Pronoiac — Fri, 02 May 2008 01:02:10 -0800

Okay, so that might do what you want.

Upon re-reading, Gnuwin32 Tree for Windows might be better.

By: charlie7691

charlie7691 — Fri, 02 May 2008 02:04:33 -0800

dir /b/s/ad>foo.txt
from the root of your site might do the trick...