Resolving to SCORE: Systematic Calibration Of Rater Evaluations