Ask MetaFilter questions tagged with webalizer

Help with stats

thebwit — Wed, 06 Jun 2007 07:49:59 -0800

Why is there such a difference between Google's Analytics, awstats and webalizer? Google analytics says my site received just under 5000 visitors for the month of may, awstats says I received just under 28,000 and webalizer says I received 65,001 visitors. Which one is the most accurate? Which one do I point advertisers to?

Porn sites are spamming my web stats. Make it stop.

Milkman Dan — Wed, 16 May 2007 10:53:16 -0800

Porn sites are spamming my web stats. Make it stop. For a few months now, my referral log has been flooded by mildly amusing, but mostly annoying, porn site URLs. These sites are throwing off my data entirely, filling the log with anywhere from 1 to 200 hits each. Almost all of them are over-the-top porn URLs. I want it to stop.

I know what the phenomenon is, and I’ve read all the other AskMe threads about it. I’m not interested in diagnostics, I want to know the cure. I run WordPress, and I’m currently running the Bad Behaviour plug-in, and have been for two months, but the problem has remained. Yes, I run Google Analytics as an alternative, but I’d like to solve the problem within this stats program (Webalizer Version 2.01), too.

Clear, step-by-step instructions would be most helpful, but any suggestions would be much appreciated. Oh, and you can click here to view my referral log from May.

How do I correct a discrepancy between MRTG and Apache?

PuGZ — Thu, 05 Apr 2007 01:43:34 -0800

How can I go about rectifying the discrepancy between AWStats/Analog/Apache log tools and MRTG graphs? I've searched endlessly on Google, but everyone has the opposite problem to me. My MRTG graphs from my provider (LayeredTech, for what it's worth) are consistently lower than what is reported by Apache logs and therefore tools like AWStats, Analog, Webalizer and the like. I figure this is due to people starting downloads (and thus HTTP 200 status codes), but cancelling their downloads.

The discrepancy is as much as 30GB a month (45GB in MRTG vs. 75GB elsewhere), so a solution to this would be greatly appreciated. Any pointers, AskMefi?

Please recommend an Apache log analysis?

Nelson — Tue, 20 Mar 2007 09:02:07 -0800

What open source package do you like for Apache logfile analysis? I need to set up some significant usage reporting for a web application. I'm looking for a reporting application for Apache style logs that's robust and customizable. Not looking just for some little report of top URLs for the day, but something that goes into detail on user agents, page load times, IP addresses, etc. Something with a pluggable report system would be ideal because I need to do some app-specific custom reports.

Much of my traffic is API calls, not web browsers, so I think Javascript-based logging like Mint and server-hosted things like Google Analytics won't work. I need something that works primarily off of logs. Storing data in MySQL is ok, but I'd prefer just to work straight from log files.

What's good, flexible, and not ugly? I know about Webalizer, Analog, and AWStats, but in the past when I've used them they've all seemed a bit awkward and limited. It's been awhile, maybe they've improved? Or maybe there's an alternative?

Help me parse the logs, Jim!

dance — Mon, 09 Oct 2006 02:53:55 -0800

Hi, I'm hosted with TextDrive who don't provide stats or log analysis for their customers. I do have access to the raw Apache log files, though, and would dearly love to parse them and get some meaningful stats and hopefully graphical charts out of them, ala AWStats, Analog or Webalizer. I've tried installing AWStats onto the host but permissions problems are causing that to fail. Surely there must be a local solution? I have access to Mac and Windows boxes - can anyone talk me through parsing my logs locally? For extra bonus love - would anyone be prepared to produce a oneoff document from a couple of log files while this is being sorted out?