How do I build a great keyword search engine?

July 26, 2004 8:33 PM

I'm building a small keyword-relevancy search engine. I'd like to move beyond simply keeping track of what words are in what documents -- at least, I assume there's a beyond having to do with keyword density and such. What should I read to find out more? Are the open source projects I should check out?
posted by namespan to computers & internet (3 answers total)

Apache's Lucene looks to be a pretty capable engine.
posted by Galvatron at 11:31 PM on July 26, 2004

see link i posted to tim bray's blog in thread just a few before this
posted by andrew cooke at 6:43 AM on July 27, 2004

any information retrieval book will help you out. do google searches for tf-idf, latent semantic analysis, etc
posted by neustile at 7:25 AM on July 27, 2004