How can I rate abstracts for relevance and quality?
November 5, 2009 10:03 AM Subscribe
I'm looking for ways to rate abstracts for relevance and quality so that I can filter out the best ones.
posted by Herkimer to Work & Money (6 answers total) 2 users marked this as a favorite
I'm going to be doing a very large literature review. In preparation I need to set up a rules-based system for filtering through, or triaging, the abstracts I retrieve, in order to select a subset (those articles I'll actually retrieve and read). Ideally this system will allow me to rate abstracts for quality and/or how well they match the topic of concern. (This is all work-related, so I can't be more specific, but the topic is generally in the social sciences.) There might have to be some qualitative or subjective aspect to this ratings system, but there are a lot of ways to rate abstracts more objectively as well (breadth of study population, number of search keywords "hit", etc.).
I'm not formally trained in information science, but I suspect such systems have already been created and used, and I don't want to reinvent the wheel. I know there are specialists in information science here that might be able to keep me from doing so. Could you point me to projects where something similar has been done, or places where such systems have been reviewed, described, or codified? Can you suggest any other resources that might be of use?
If it matters, I think I will have around one or two thousand abstracts to filter through.