Do Google and Bing spider XML pages? [more inside]
posted by netbros on Jul 28, 2009 - 2 answers

My company is looking to build a search engine to index our web site and I'm wondering if anyone has used any open package to do the task. Names, URLs, experience would be highly appreciated,
posted by seeminglee on Aug 26, 2008 - 6 answers

Help me find a Windows-based cataloging program that can handle indexing of Word documents and can crawl network (SMB) shares. [more inside]
posted by ostranenie on Jul 9, 2007 - 6 answers

Is there a smart way of indexing/cataloging my offline media? This has been partially asked before (I can't work out how to establish a link in here) - but the links that were in the post (diskbase), were mostly dead (and I didn't like 'Cathy' much). There is of course more inside. [more inside]
posted by mattr on Jan 1, 2007 - 4 answers

How do I get swish-e to index the contents of a specific HTML tag (not a meta tag)? [more inside]
posted by expialidocious on Oct 31, 2005 - 1 answer