Neonatal Pain, Agitation, and Sedation Scale’s use, reliability, and validity: a systematic review

Issues related to the validity and reliability of measurement instruments used in research are reviewed. Key indicators of the quality of a measuring instrument are the reliability and validity of the measures. The process of developing and validating an instrument is in large part focused on reducing error in the measurement process. Reliability estimates evaluate the stability of measures, internal consistency of measurement instruments, and interrater reliability of instrument scores. Validity is the extent to which the interpretations of the results of a test are warranted, which depends on the particular use the test is intended to serve. The responsiveness of the measure to change is of interest in many of the applications in health care where improvement in outcomes as a result of treatment is a primary goal of research. Several issues may affect the accuracy of data collected, such as those related to self-report and secondary data sources. Self-report of patients or subjects is required for many of the measurements conducted in health care, but self-reports of behavior are particularly subject to problems with social desirability biases. Data that were originally gathered for a different purpose are often used to answer a research question, which can affect the applicability to the study at hand. In health care and social science research, many of the variables of interest and outcomes that are important are abstract concepts known as theoretical constructs. Using tests or instruments that are valid and reliable to measure such constructs is a crucial component of research quality.

Managing psychological distress is a central treatment goal in Pediatric Intensive Care Units (PICUs), with medical and psychological implications. However, there is no objective measure for assessing efficacy of pharmacologic and psychological interventions used to reduce distress. Development of the COMFORT scale is described, a nonintrusive measure for assessing distress in PICU patients. Eight dimensions were selected based upon a literature review and survey of PICU nurses. Interrater agreement and internal consistency were high. Criterion validity, assessed by comparison with concurrent global ratings of PICU nurses, was also high. Principal components analysis revealed 2 correlated factors, behavioral and physiologic, accounting for 84% of variance. An ecological-developmental model is presented for further study of children's distress and coping in the PICU.

The prevention of pain in neonates should be the goal of all caregivers, because repeated painful exposures have the potential for deleterious consequences. Neonates at greatest risk of neurodevelopmental impairment as a result of preterm birth (ie, the smallest and sickest) are also those most likely to be exposed to the greatest number of painful stimuli in the NICU. Although there are major gaps in our knowledge regarding the most effective way to prevent and relieve pain in neonates, proven and safe therapies are currently underused for routine minor yet painful procedures. Every health care facility caring for neonates should implement an effective pain-prevention program, which includes strategies for routinely assessing pain, minimizing the number of painful procedures performed, effectively using pharmacologic and nonpharmacologic therapies for the prevention of pain associated with routine minor procedures, and eliminating pain associated with surgery and other major procedures.