Here a Turk. There a Turk. Everywhere a Turk Turk
August 12, 2012 10:04 PM Subscribe
Have you ever used Mechanical Turk
to validate, classify, and clean data sets that would otherwise be mind numbingly impossible for someone to do? If so, were the results useful? What are some tips to make sure one's Mechanical Turk experience goes off without a hitch? How do i best check their work.
posted by Nanukthedog to technology (7 answers total) 10 users marked this as a favorite
In specific I need to take a list of misspelled words, slang, brand names, colloquialisms, and similarly malformed words and provide both (if they both exist) the correct word and/or the intended part of speech. Since it may be hard to verify the accuracy of the final product, is it a good idea to have multiple people score the list , effectively pitting the results against each other.