41
views
0
recommends
+1 Recommend
1 collections
    2
    shares
      • Record: found
      • Abstract: found
      • Article: found
      Is Open Access

      Evaluación de la reproducibilidad de la recogida de datos para el APACHE II, APACHE III adaptado para España y SAPS II en 9 Unidades de Cuidados Intensivos en España Translated title: Evaluation of the reproducibility of the data collection for the APACHE II, APACHE III adapted for Spain and the SAPS II in nine Intensive Care Units in Spain

      research-article

      Read this article at

      Bookmark
          There is no author summary for this article yet. Authors can add summaries to their articles on ScienceOpen to make them more accessible to a non-specialist audience.

          Abstract

          Objetivo. Evaluar la reproducibilidad en la recogida de datos y su influencia en el cálculo de la gravedad y del riesgo predicho de muerte para los modelos APACHE II, APACHE III adaptado para España y SAPS II. Diseño. Estudio multicéntrico, prospectivo y observacional de cohortes. Ámbito. Nueve Unidades de Cuidados Intensivos (UCI) en España. Pacientes. Inclusión consecutiva de los pacientes ingresados en el período de estudio. Se excluyeron los pacientes menores de 16 años, con estancia en UCI menor de 24 horas, los ingresados para implante programado de marcapasos y los reingresados en UCI dentro del mismo ingreso hospitalario. Intervención. Ninguna. Variables de interés principales. Se recogieron los datos necesarios para el cálculo de las puntuaciones de gravedad y del riesgo predicho de muerte. Se seleccionaron el 10% de los pacientes por muestreo aleatorio simple y se recogieron los mismos datos por un grupo independiente de intensivistas. Finalmente se compararon los datos recogidos por los dos grupos de intensivistas. Resultados. Se encontraron diferencias significativas en el APS (acute physiology score) y puntuación de gravedad calculados para el APACHE III y SAPS II, y en el riesgo de muerte predicho por SAPS II. El porcentaje de acuerdos en el diagnóstico de ingreso en UCI fue del 50% para los modelos APACHE II y III. En la mayoría de los pacientes (76,58% en el APACHE II y 79,82% en el APACHE III) la diferencia en el riesgo predicho de muerte debido a la diferente asignación del diagnóstico de ingreso en UCI fue menor del 10%. Conclusiones. En este estudio el APS se mostró como el factor más influyente en la reproducibilidad de los índices de gravedad y del cálculo del riesgo predicho de muerte. El diagnóstico de ingreso en UCI no mostró un impacto importante en la reproducibilidad del riesgo predicho de muerte.

          Translated abstract

          Objective. To assess reproducibility in data collection and its influence on the calculation of the severity scoring and mortality risk in APACHE II, APACHE III adapted for Spain and SAPS II. Design. Multicenter, prospective, observational cohort study. Setting. Nine Spanish Intensive Care Units (ICUs). Patients. 1,211 consecutive patients admitted during the study period were included. Those patients under 16 years of age, those with a stay in the ICU of less than 24 hours, those admitted for scheduled pacemaker implant and those readmitted to the ICU within the same hospital admission were excluded. Intervention. None. Endpoints of interest. The data needed to calculate the severity and mortality risk scores were collected. A total of 10% of the patients were chosen by simple random sampling and the same data were collected by an independent group of intensive care physicians. Finally, the data obtained by the two groups of intensivists were compared. Results. Significant differences were detected in the acute physiology score (APS) and severity score used for the calculation of APACHE III and SAPS II, and the predicted risk of death calculated for SAPS II. The percentage of agreement on admission diagnosis to the ICU was 50% for both APACHE II and III models. Nonetheless, in most of the patients (76.58% for APACHE II and 79.82% for APACHE III), the difference in the predicted risk of death due to the different assignation of diagnoses on admission to the ICU was less than 10%. Conclusions. In this study, APS was the most influential factor on the reproducibility of severity scores and risk of death prediction. Admission diagnosis assignment had no significant impact on the reproducibility of the predicted mortality risk.

          Related collections

          Most cited references34

          • Record: found
          • Abstract: found
          • Article: not found

          Inter-observer variability in APACHE II scoring: effect of strict guidelines and training.

          To assess the effect of strict guidelines and a rigorous training program on variability in scoring the revised Acute Physiology and Chronic Health Evaluation (APACHE II). Prospective survey and intervention in the surgical ICU of a university teaching hospital. Seven experienced intensivists and nine residents determined APACHE II scores in one set of patients before and in another set 4 months after a rigorous training program, following strict guidelines for using the APACHE II. APACHE II scores were 14.3+/-4.4 before the training program (n=12) and 18.9+/-2.4 after (n=11). Interobserver agreement rates increased significantly from 59.7% to 76.5% and the interobserver reliability coefficient (weighted kappa) from 0.72 to 0.85 after our training program was implemented. The changes were significantly greater in experienced intensivists than in less experienced residents, indicating that more experienced physicians profited to a greater degree from our training program. Interobserver variability in APACHE II scoring decreases markedly when strict guidelines and a regular training program are implemented, particularly among more experienced physicians. However, in our study a degree of variability (10-15%) persisted even in experienced intensivists with similar training, experience, and background, suggesting that a degree of variability is inherent in APACHE II scoring.
            Bookmark
            • Record: found
            • Abstract: found
            • Article: not found

            Interobserver variability in data collection of the APACHE II score in teaching and community hospitals.

            To examine interobserver reliability of the Acute Physiologic and Chronic Health Evaluation (APACHE) II score and identify major causes of variability in data collection. Descriptive, comparative analysis. Nine intensive care units in two teaching and six community hospitals A random sample of 342 patient records selected from a network database. None. Data were reabstracted and compared with the original records. Individual physiologic points derived from the APACHE II scoring system (instead of the actual physiologic values) were compared using the kappa statistic. Paired measurements of the continuous variables were compared using the interclass correlation coefficient and Bland-Altman plots. Excellent agreement was found in most demographic, admission, and discharge data. The system failure requiring intensive care unit admission was consistently identified by both data collectors in 88% of cases, but only 66% agreed on the exact admitting diagnosis. For APACHE II score components, the kappa statistic ranged from 0.315 for the Glasgow Coma Scale point to 0.976 for the age point. Significant disagreement regarding the probability of death derived from the APACHE II model was evident in some patient records. Overall agreement among groups of patients regarding the APACHE II score was good, however, with no significant difference in the mean score (20.2 vs. 20.1; p = .758). The predicted mortality from the reabstracted data was 30%, similar to the 27% predicted mortality from the original data (p = .380). Reliability of data collection varied widely in different components of the APACHE II probability-of-death model. Significant discrepancies in some components suggested a lack of explicit definitions and timing for consistent data collection between institutions or between data collectors. Nonetheless, variability resulting from data collection appears to be randomly distributed, so that comparisons of group means are valid.
              Bookmark
              • Record: found
              • Abstract: found
              • Article: not found

              Evaluation of severity scoring systems in ICUs--translation, conversion and definition ambiguities as a source of inter-observer variability in Apache II, SAPS and OSF.

              To explore translation, conversion and definition ambiguities, when using severity scoring systems in patients admitted to intensive care units (ICUs). A prospective study of the prognosis of acute renal failure in ICUs. The study was conducted in 20 French ICUs. 360 patients presenting with severe acute renal failure were studied during their ICU stay. The inter-observer variability of Apache II (acute physiology and chronic health evaluation), SAPS (simplified acute physiology score), and OSF (organ-system failure) was considered. For Apache II, we explored the uncertainty of measurements arising from conversion into SI units, the rounding procedures used for the non-inclusive intervals defined for quantitative parameters such as age, mean arterial pressure (MAP) or serum creatinine, the absence of definition of acute renal failure (ARF) and its consequence on doubling serum creatinine values, and the absence of guidelines in the case of spontaneous ventilation when arterial blood gases (ABG) and forced inspiratory oxygen (FIO2) were not measured. The resulting variability was evaluated, calculating the lowest and the highest value of the scoring system for each patient. The mean difference by patient was greater than 1.5 (p < 0.0001). Other examples were presented and discussed for SAPS and OSF. Translation, conversion and definition ambiguities are a source of inter-observer variability and increase the risk of classification and/or selection biases. This gives rise to particular concern in the design and analysis of multicenter trials of meta-analysis, and improvement of these scoring systems should be envisaged in the future.
                Bookmark

                Author and article information

                Contributors
                Role: ND
                Role: ND
                Role: ND
                Role: ND
                Role: ND
                Role: ND
                Role: ND
                Role: ND
                Role: ND
                Role: ND
                Role: ND
                Role: ND
                Journal
                medinte
                Medicina Intensiva
                Med. Intensiva
                Elsevier España, S.L. (, , Spain )
                0210-5691
                February 2008
                : 32
                : 1
                : 15-22
                Affiliations
                [01] Valladolid orgnameHospital Universitario Río Hortega orgdiv1Unidad de Cuidados intensivos
                [02] orgnameUniversidad de Valladolid orgdiv1Departamento de Estadística Aplicada
                [06] orgnameComplejo Hospitalario de León orgdiv1Unidad de Cuidados Intensivos
                [09] orgnameHospital Clínico Universitario de Valladolid orgdiv1Unidad de Cuidados Intensivos
                [05] Palencia orgnameHospital Río Carrión orgdiv1Unidad de Cuidados Intensivos
                [03] Burgos orgnameHospital General Yagüe orgdiv1Unidad de Cuidados Intensivos
                [08] orgnameHospital General de Soria orgdiv1Unidad de Cuidados Intensivos
                [10] Avilés orgnameHospital San Agustín orgdiv1Unidad de Cuidados Intensivos
                [04] orgnameHospital Clínico de Salamanca orgdiv1Unidad de Cuidados Intensivos
                [07] orgnameHospital Central de Asturias orgdiv1Unidad de Cuidados Intensivos
                Article
                S0210-56912008000100004
                10.1016/S0210-5691(08)70898-2
                68060114-18fc-409f-98d8-14c68a886b83

                This work is licensed under a Creative Commons Attribution-NonCommercial 3.0 International License.

                History
                Page count
                Figures: 0, Tables: 0, Equations: 0, References: 21, Pages: 8
                Product

                SciELO Spain


                APACHE,reproducibilidad,cuidados intensivos,predicción de mortalidad y evaluación de resultados,reliability,intensive care,mortality prediction and outcome process assessment

                Comments

                Comment on this article