Comparison of peer assessment methods: Reliability, validity, friendship bias, and user reaction

Compared peer nominations, peer rankings, and peer ratings as to reliability, validity, friendship bias, and user reaction. 145 police officers provided each type of peer assessment. Criterion rankings and ratings were provided by 33 squad supervisors. All peer-based methods showed significant reliability and validity, and the validity coefficients were not significantly biased by the friendship between peer assessor and assessee. Peer rankings and peer nominations displayed significantly greater reliability and validity than did peer ratings. User reactions were negative for all methods. Recommendations are made for collection of peer assessment data in nonpolice organizations for comparative purposes and for investigation of techniques to reduce negative reactions to peer assessment. (18 ref) (PsycINFO Database Record (c) 2006 APA, all rights reserved).