Reliability and validity of the NeuroCognitive Performance Test, a web-based neuropsychological assessment

The lack of an accepted standard for measuring cognitive change in schizophrenia has been a major obstacle to regulatory approval of cognition-enhancing treatments. A primary mandate of the National Institute of Mental Health's Measurement and Treatment Research to Improve Cognition in Schizophrenia (MATRICS) initiative was to develop a consensus cognitive battery for clinical trials of cognition-enhancing treatments for schizophrenia through a broadly based scientific evaluation of measures. The MATRICS Neurocognition Committee evaluated more than 90 tests in seven cognitive domains to identify the 36 most promising measures. A separate expert panel evaluated the degree to which each test met specific selection criteria. Twenty tests were selected as a beta battery. The beta battery was administered to 176 individuals with schizophrenia and readministered to 167 of them 4 weeks later so that the 20 tests could be compared directly. The expert panel ratings are presented for the initially selected 36 tests. For the beta battery tests, data on test-retest reliability, practice effects, relationships to functional status, practicality, and tolerability are presented. Based on these data, 10 tests were selected to represent seven cognitive domains in the MATRICS Consensus Cognitive Battery. The structured consensus method was a feasible and fair mechanism for choosing candidate tests, and direct comparison of beta battery tests in a common sample allowed selection of a final consensus battery. The MATRICS Consensus Cognitive Battery is expected to be the standard tool for assessing cognitive change in clinical trials of cognition-enhancing drugs for schizophrenia. It may also aid evaluation of cognitive remediation strategies.

Data relating to the stability and variation in the norms for the Raven's Progressive Matrices Test (a well-validated measure of basic cognitive functioning) for different cultural, ethnic, and socioeconomic groups on a worldwide and within-country basis are first summarized. Subsequent sections deal with variation over time. A possible explanation for the variation in norms over time and between ethnic groups within countries is offered. Copyright 2000 Academic Press.

CNS Vital Signs (CNSVS) is a computerized neurocognitive test battery that was developed as a routine clinical screening instrument. It is comprised of seven tests: verbal and visual memory, finger tapping, symbol digit coding, the Stroop Test, a test of shifting attention and the continuous performance test. Because CNSVS is a battery of well-known neuropsychological tests, one should expect its psychometric properties to resemble those of the conventional tests upon which it is based. 1069 subjects age 7-90 participated in the normative database for CNSVS. Test-retest reliability (TRT) was evaluated in 99 Ss who took the battery on two separate occasions, separated, on the average, by 62 days; the results were comparable to those achieved by equivalent conventional and computerized tests. Concurrent validity studies in 180 subjects, normals and neuropsychiatric patients, indicate correlations that are comparable to the concurrent validity of similar tests. Discriminant validity is supported by studies of patients with mild cognitive impairment and dementia, post-concussion syndrome and severe traumatic brain injury, ADHD (treated and untreated) and depression (treated and untreated). The tests in CNSVS are also sensitive to malingerers and patients with conversion disorders. The psychometric characteristics of the tests in the CNSVS battery are very similar to the characteristics of the conventional neuropsychological tests upon which they are based. CNSVS is suitable for use as a screening instrument, or as a serial assessment measure. But it is not a substitute for formal neuropsychological testing, it is not diagnostic, and it will have only a limited role in the medical setting, absent the active participation of consulting neuropsychologists.