Web-facing search engine for non-indexed website?
October 1, 2024 2:35 PM

I have the archives of an old yahoo group converted to HTML up on a private NOINDEX-ed subdomain, and I would like to add the ability for people to search the contents. Is there (free) software to do this? My understanding is that google's custom search requires the site itself to be in their database. I have server/shell access, etc.
posted by softlord to Computers & Internet (6 answers total) 1 user marked this as a favorite
algolia does it as-a-service with a free tier, I've never used it though
posted by BungaDunga at 2:42 PM on October 1


I should note that I suppose it would need to have a webcrawler element unless it supports uploading a crapload of html files to be indexed.
posted by softlord at 2:51 PM on October 1


I doubt you do, but just to double check, you don't happen to know PHP and MySQL do you?

On my home network I have a few LAMP (Linux, Apache, Mysql and PHP) apps for: bookmarks, household storage with container contents, budget entries by date and category, etc.

If you have all the HTML-ified archived group data, then are you presenting it from disk files on the server, or do you have a database containing it all? If the latter then presenting results based on user entered search criteria is relatively easy: if user enters one word then look for all hits with that one word, if they entered multiple words then look for all hits containing ALL or MOST of those words and present them in decreasing number of hits order.
posted by forthright at 3:01 PM on October 1


It sounds like you want Stork or something similar.
posted by ssg at 4:14 PM on October 1


@forthright i do know them a bit, but Im trying not to put dev time into this if i can help it
posted by softlord at 4:28 PM on October 1


No problem softlord, glad you got a solution.
posted by forthright at 4:46 PM on October 1


« Older Help me find this book I was obsessed with in the...   |   Mylar balloon midair Newer »

You are not logged in, either login or create an account to post comments