scrape web content from okcupid?
September 9, 2012 10:48 AM Subscribe
How do I extract content from a website like OKCupid for personal use?
posted by ribboncake to computers & internet (3 answers total) 3 users marked this as a favorite
I basically want to spider the site to extract info from matches that'll dump into a table. This is purely for my own personal nerdy fun (ie doing some sort of clustering on the matches they give me, trying my own search algorithsm, etc, and hopefully not illegal).
I don't know anything about web programming, so I don't know where to start even to search. For example, the match results page somehow causes web scraping tools I've found on online to only be able to lift one profile at a time. I'm not sure about the terminology of any of this. Any advice or directions would be great! Thanks!