Quick question. Are complete disagreements when one radiologist thinks that the x-ray is
normal and the other thinks that it is malignant, or any time that the two radiologists do not completely agree?
Thanks,
Teresa
Complete disagreement = "one radiologist thinks that the x-ray is normal and the other thinks that it is malignant"
complete disagreements are when the two radiologists' observations are far apart eg malignant and normal.
My question then is: do we consider malignant and benign or normal and indeterminate as complete disagreements?
By "complete disagreements" we mean they disagreed as much as they possibly could. Any other level of disagreement would count as partial agreement, and tend to increase Kappa at least a little if it occurred more often than expected.
Tom