Results of reliability and agreement studies are intended to provide information about
the amount of error inherent in any diagnosis, score, or measurement. The level of
reliability and agreement among users of scales, instruments, or classifications is
widely unknown. Therefore, there is a need for rigorously conducted interrater and
intrarater reliability and agreement studies. Information about sample selection,
study design, and statistical analysis is often incomplete. Because of inadequate
reporting, interpretation and synthesis of study results are often difficult. Widely
accepted criteria, standards, or guidelines for reporting reliability and agreement
in the health care and medical field are lacking. The objective was to develop guidelines
for reporting reliability and agreement studies.
Eight experts in reliability and agreement investigation developed guidelines for
Fifteen issues that should be addressed when reliability and agreement are reported
are proposed. The issues correspond to the headings usually used in publications.
The proposed guidelines intend to improve the quality of reporting.
Copyright © 2011 Elsevier Inc. All rights reserved.