June 16, 2007 7:19 PM Subscribe
(1) When doing an inter-rater reliability study, does Rater A always have to be paired with Rater B, and Rater C with Rater D, etc? Or can Rater A be paired with Rater B sometimes and Rater C other times?
(2) When trying to determine the appropriate sample size for this kind of study, is the N based on the total number of subjects rated, or on the number of subjects each pair of raters rates?
posted by kenberkun to science & nature (2 answers total)
This is required for determining the number of subjects to rated in a study that is currently being designed.