Comments on: Suggestions for Parsing Blog Feeds Using PHP?

Question: Suggestions for Parsing Blog Feeds Using PHP?

jeanmari — Mon, 28 Mar 2005 21:15:26 -0800

Can anyone suggest good PHP books or existing scripts that can help me successfully parse RSS 1.0, 2.0 and Atom 0.3 feeds, then save them to a MySQL database?

I'm developing a website that aggregates entries from various blogs dedicated to a specific topic. (Blog authors have agreed to participate.) I've currently got a version working using Ari Paparo's RSStoMySQL script, but it only seems to work with RSS 1.0 feeds. I'm successfully converting some non-1.0 feeds using FeedBurner.com, but it isn't working for others. Basically the script seems very particular. Any suggestions on other ways I can also successfully scrape Atom and RSS 2.0 feeds? To be clear, my solution needs to save entries to a MySQL database so I can manage entries in several ways.

By: ubernostrum

ubernostrum — Mon, 28 Mar 2005 22:04:58 -0800

For an intro to working with PHP and MySQL, Luke Welling and Laura Thomson's PHP and MySQL Web Development is the best book on the market, IMO.

And parsing feeds is pretty easy with MagpieRSS, which handles the various flavors of RSS and Atom.

By: steveminutillo

steveminutillo — Mon, 28 Mar 2005 22:06:19 -0800

MagpieRSS will do the basic parsing for you, but will not save the feeds to a database. Feed on Feeds will, and so will Gregarius. They are both designed to be end-user apps rather than tools as part of a larger system, but don't let that bother you. They're open source, hack away!

By: cillit bang

cillit bang — Tue, 29 Mar 2005 05:36:17 -0800

The various versions of RSS and Atom aren't all that different from a parsing point of view. I'd figure out how the script works and modify it to support them - it's mostly just changing the names of some tags.

Also, knowing how your parser works will be useful when you find a feed that doesn't work properly and you get complaints.