Comments on: Open source site monitoring software

Question: Open source site monitoring software

jedro — Thu, 08 Sep 2005 01:39:21 -0800

Can anybody recommend an open source 'external' site monitoring utility for *nix? By external, I mean the tool should sit on a server that's separate to the one the site being monitored is sitting on. The tool should make regular requests to the monitored site and should send an alert if the page is not returned within a specified time.

By: handee

handee — Thu, 08 Sep 2005 01:43:12 -0800

You mean like "uptime"? http://uptime.openacs.org/uptime/

By: jedro

jedro — Thu, 08 Sep 2005 01:47:40 -0800

Something like that, except preferably a bit more flexible.

By: NinjaPirate

NinjaPirate — Thu, 08 Sep 2005 02:14:54 -0800

Nagios?

By: mrbill

mrbill — Thu, 08 Sep 2005 02:48:24 -0800

Another vote for nagios here. I have it in production at four sites of a large oil and gas firm and it works wonderfully.

There's also Big Brother and OpenNMS. Before I discovered Nagios, I used NOCOL.

By: mrbill

mrbill — Thu, 08 Sep 2005 02:49:55 -0800

Whoops, NOCOL has been superseded by SNIPS. I'd forgotten since its been a few years since I've used it.

By: ajbattrick

ajbattrick — Thu, 08 Sep 2005 04:22:52 -0800

Nagios can be a beatch to setup, but is great

By: poppo

poppo — Thu, 08 Sep 2005 04:29:38 -0800

Mon is excellent. It's totally free, people write all kinds of custom monitors for it, it can page, send email or whatever else you can think up for it.

Simplest use of course would be for it to ping something for you, but you could even use one of the wget monitors to look whether a specific page or pages are up.

By: poppo

poppo — Thu, 08 Sep 2005 04:32:43 -0800

An http monitor for Mon

By: furtive

furtive — Thu, 08 Sep 2005 04:32:44 -0800

Nagios for sure. Along with Apache it's one of a handfull of open source apps that are considered enterprise stable.

By: jedro

jedro — Thu, 08 Sep 2005 05:28:48 -0800

I was hoping there was something simpler to set up than Nagios. All I need it to do is load a page, check for a particular string, and send an alert if the string is not found.

By: sfenders

sfenders — Thu, 08 Sep 2005 05:44:25 -0800

I use Big Brother for serious use.

You want simple to set up? I use 'ping' for various similar temporary uses, like so:

while (true) ; do if ( ! ping -c 1 -i 10 fnord ) ; then echo fnord | mail sfenders ; sleep 60 ; fi ; done

To monitor a website just replace ping with wget, and maybe add an elif clause to grep for page content. wget returns an error code on 404 or whatever.

By: sfenders

sfenders — Thu, 08 Sep 2005 05:47:47 -0800

(... err, I forgot the other 'sleep 10' before 'done' above.)

By: jjj606

jjj606 — Thu, 08 Sep 2005 05:53:57 -0800

this works in linux, probably in unix, too.

(this is one long line)
wget -o /dev/null -O - google.com | grep -q "Feeling Lucky" || echo "not found"

The "not found" message displays if it can't load the page or if the text is not on the page.

Change the echo to an email command once it's working correctly, then add it to cron, or run in a loop by adding

while true ; do
wget...
sleep 60
done

By: eriko

eriko — Thu, 08 Sep 2005 06:17:16 -0800

Big Brother has gone commercial, and the free version isn't supported much (and can't handle large loads.) Henrik Stoerner rewrote the core as BBGen, then went on to rewrite the rest as the Hobbit Monitor. (As to the name, he says "Names are hard.")

I'm quite happy with it, even as a work in progress. It has a bunch of tests built in, some which run on the client, some across the network. The Big Brother client works with it, and the protocol is the same, so many Big Brother extensions, the Hobbit client is new, and not quite ready for primetime. Writing your own tests isn't hard, we've started monitoring our internal processes with it, using a homerolled program that sends messages to the monitor server, which then alerts as needed.

For monitoring one site, it might look like overkill -- but it answers lots of problems, and with the RRD graphs built in, you can get trends you wouldn't see from just "hit page, does it work?" testing.

Otherwise, I'd modify jjj606's script to....



TEST=`wget -o /dev/null -O - google.com | grep -q "Feeling Lucky" || echo "oops"`

if [ "$TEST" = "oops" ]

then

     wget -o ~/brokenpage -O - google.com

     echo "Webpage Not responding, wget reported $?" | mail -s "Ruh-ro, Shaggy!" youremail@example.com

fi

That way, you get a copy of any errors that are presented, and the actual error code from wget, if any. This can make debugging much easier. Fancier versions will look at the result code and mail out appropriate messages. (Using curl, it returns a 6, I'll echo out "Host not found" -- which tells me I need to check DNS and the hostname first, then find out if the remote host is up.)

Further complications ensue. Or, you can run Hobbit, which already takes much of this into account -- plus, if you can install the client, will also warn you of upcoming problems, like running out of disk space or overloading the CPU.

By: jlstitt

jlstitt — Thu, 08 Sep 2005 07:47:42 -0800

Sometimes the method above doesn't work if you're having to use a web site that requires a login. In that case, you can use "curl" instead of "wget" (even supports SSL)

By: bachelor#3

bachelor#3 — Thu, 08 Sep 2005 14:06:03 -0800

You should still be able to use wget, jlstitt. Just use the --http-user and --http-passwd options.

By: darkness

darkness — Thu, 08 Sep 2005 15:23:21 -0800

You can just use the check_http plugin from Nagios directly, without having to run the whole thing. The script exits with a 0,1,2 or 3 depending on the condition of the service you are checking. Should make it easy to wrap it into other scripts to send email or something...

By: darkness

darkness — Thu, 08 Sep 2005 15:23:49 -0800

"whole thing" meaning the whole Nagios infrastructure.