2
views
0
recommends
+1 Recommend
0 collections
    0
    shares
      • Record: found
      • Abstract: found
      • Article: found
      Is Open Access

      Diagnostic accuracy of adenosine deaminase for pleural tuberculosis in a low prevalence setting: A machine learning approach within a 7-year prospective multi-center study

      research-article

      Read this article at

      Bookmark
          There is no author summary for this article yet. Authors can add summaries to their articles on ScienceOpen to make them more accessible to a non-specialist audience.

          Abstract

          Objective

          To analyze the performance of adenosine deaminase in pleural fluid combined with other parameters routinely measured in clinical practice and assisted by machine learning algorithms for the diagnosis of pleural tuberculosis in a low prevalence setting, and secondly, to identify effusions that are non-tuberculous and most likely malignant.

          Patients and methods

          We prospectively analyzed 230 consecutive patients diagnosed with lymphocytic exudative pleural effusion from March 2013 to June 2020. Diagnosis according to the composite reference standard was achieved in all cases. Pre-test probability of pleural tuberculosis was 3.8% throughout the study period. Parameters included were: levels of adenosine deaminase, pH, glucose, proteins, and lactate dehydrogenase, red and white cell counts and lymphocyte percentage in pleural fluid, as well as age. We tested six different machine learning-based classifiers to categorize the patients. Two different classifications were performed: a) tuberculous/non-tuberculous and b) tuberculous/malignant/other.

          Results

          Out of a total of 230 patients with pleural effusion included in the study, 124 were diagnosed with malignant effusion and 44 with pleural tuberculosis, while 62 were given other diagnoses. In the tuberculous/non-tuberculous classification, and taking into account the validation predictions, the support vector machine yielded the best result: an AUC of 0.98, accuracy of 97%, sensitivity of 91%, and specificity of 98%, whilst in the tuberculous/malignant/other classification, this type of classifier yielded an overall accuracy of 80%. With this three-class classifier, the same sensitivity and specificity was achieved in the tuberculous/other classification, but it also allowed the correct classification of 90% of malignant cases.

          Conclusion

          The level of adenosine deaminase in pleural fluid together with cell count, other routine biochemical parameters and age, combined with a machine-learning approach, is suitable for the diagnosis of pleural tuberculosis in a low prevalence scenario. Secondly, non-tuberculous effusions that are suspected to be malignant may also be identified with adequate accuracy.

          Related collections

          Most cited references59

          • Record: found
          • Abstract: not found
          • Article: not found

          The use of the area under the ROC curve in the evaluation of machine learning algorithms

            Bookmark
            • Record: found
            • Abstract: found
            • Article: found
            Is Open Access

            STARD 2015 guidelines for reporting diagnostic accuracy studies: explanation and elaboration

            Diagnostic accuracy studies are, like other clinical studies, at risk of bias due to shortcomings in design and conduct, and the results of a diagnostic accuracy study may not apply to other patient groups and settings. Readers of study reports need to be informed about study design and conduct, in sufficient detail to judge the trustworthiness and applicability of the study findings. The STARD statement (Standards for Reporting of Diagnostic Accuracy Studies) was developed to improve the completeness and transparency of reports of diagnostic accuracy studies. STARD contains a list of essential items that can be used as a checklist, by authors, reviewers and other readers, to ensure that a report of a diagnostic accuracy study contains the necessary information. STARD was recently updated. All updated STARD materials, including the checklist, are available at http://www.equator-network.org/reporting-guidelines/stard. Here, we present the STARD 2015 explanation and elaboration document. Through commented examples of appropriate reporting, we clarify the rationale for each of the 30 items on the STARD 2015 checklist, and describe what is expected from authors in developing sufficiently informative study reports.
              Bookmark
              • Record: found
              • Abstract: found
              • Article: not found

              Youden Index and optimal cut-point estimated from observations affected by a lower limit of detection.

              The receiver operating characteristic (ROC) curve is used to evaluate a biomarker's ability for classifying disease status. The Youden Index (J), the maximum potential effectiveness of a biomarker, is a common summary measure of the ROC curve. In biomarker development, levels may be unquantifiable below a limit of detection (LOD) and missing from the overall dataset. Disregarding these observations may negatively bias the ROC curve and thus J. Several correction methods have been suggested for mean estimation and testing; however, little has been written about the ROC curve or its summary measures. We adapt non-parametric (empirical) and semi-parametric (ROC-GLM [generalized linear model]) methods and propose parametric methods (maximum likelihood (ML)) to estimate J and the optimal cut-point (c *) for a biomarker affected by a LOD. We develop unbiased estimators of J and c * via ML for normally and gamma distributed biomarkers. Alpha level confidence intervals are proposed using delta and bootstrap methods for the ML, semi-parametric, and non-parametric approaches respectively. Simulation studies are conducted over a range of distributional scenarios and sample sizes evaluating estimators' bias, root-mean square error, and coverage probability; the average bias was less than one percent for ML and GLM methods across scenarios and decreases with increased sample size. An example using polychlorinated biphenyl levels to classify women with and without endometriosis illustrates the potential benefits of these methods. We address the limitations and usefulness of each method in order to give researchers guidance in constructing appropriate estimates of biomarkers' true discriminating capabilities. Copyright 2008 WILEY-VCH Verlag GmbH & Co. KGaA, Weinheim
                Bookmark

                Author and article information

                Contributors
                Role: ConceptualizationRole: Data curationRole: InvestigationRole: SupervisionRole: Writing – original draftRole: Writing – review & editing
                Role: Data curationRole: Funding acquisitionRole: InvestigationRole: Project administrationRole: Resources
                Role: Formal analysisRole: MethodologyRole: SoftwareRole: ValidationRole: Writing – original draftRole: Writing – review & editing
                Role: Data curationRole: Formal analysisRole: InvestigationRole: MethodologyRole: SoftwareRole: Validation
                Role: ConceptualizationRole: Formal analysisRole: MethodologyRole: SoftwareRole: Validation
                Role: Formal analysisRole: InvestigationRole: MethodologyRole: SoftwareRole: Validation
                Role: Data curationRole: Formal analysisRole: InvestigationRole: MethodologyRole: SoftwareRole: Validation
                Role: Data curationRole: InvestigationRole: ResourcesRole: Visualization
                Role: Data curationRole: Formal analysisRole: InvestigationRole: Visualization
                Role: Data curationRole: Formal analysisRole: InvestigationRole: Visualization
                Role: Data curationRole: SupervisionRole: Visualization
                Role: Data curationRole: InvestigationRole: Supervision
                Role: Data curationRole: Formal analysisRole: InvestigationRole: SupervisionRole: Validation
                Role: Data curationRole: Formal analysisRole: SupervisionRole: Validation
                Role: ConceptualizationRole: Data curationRole: InvestigationRole: Supervision
                Role: Editor
                Journal
                PLoS One
                PLoS One
                plos
                PLoS ONE
                Public Library of Science (San Francisco, CA USA )
                1932-6203
                2021
                4 November 2021
                : 16
                : 11
                : e0259203
                Affiliations
                [1 ] Internal Medicine Service, Osakidetza/Basque Health Service, Mendaro Hospital, Gipuzkoa, Spain
                [2 ] Mycobacterial Infection Study Group (GEIM), From the Spanish Infectious Diseases Society, Spain
                [3 ] Microbiology Department, Respiratory Infection and Antimicrobial Resistance Group. Osakidetza/Basque Health Service, Biodonostia Health Research Institute, Donostia University Hospital, Gipuzkoa, Spain
                [4 ] Faculty of Medicine, University of the Basque Country, UPV/EHU, Gipuzkoa, Donostia, Spain
                [5 ] Departamento de Ingeniería Informática y de Sistemas, Universidad de La Laguna, Santa Cruz de Tenerife, Spain
                [6 ] Gipuzkoa Primary Care-Integrated Health Organisation Research Unit, Osakidetza/Basque Health Service, Debagoiena Integrated Health Organisation, Alto Deba Hospital, Arrasate-Mondragon, Spain
                [7 ] Epidemiology and Public Health Area, Economic Evaluation of Chronic Diseases Research Group, Biodonostia Health Research Institute, Donostia, Spain
                [8 ] Kronikgune Institute for Health Services Research, Bizkaia/Barakaldo, Spain
                [9 ] Health Services Research on Chronic Patients Network (REDISSEC), Spain
                [10 ] Preventive Medicine and Western Gipuzkoa Clinical Research Unit, Osakidetza/Basque Health Service, Mendaro Hospital, Gipuzkoa, Spain
                [11 ] Osakidetza/Basque Health Service, Research Unit, Galdakao University Hospital, Bizkaia, Spain
                [12 ] Pneumology Service, Osakidetza/Basque Health Service, Donostia University Hospital, Gipuzkoa. Spain
                [13 ] Thoracic Surgery Service, Osakidetza/Basque Health Service, Donostia University Hospital, Gipuzkoa, Spain
                [14 ] Epidemiological Surveillance Unit, Health Department, Basque Government, Gipuzkoa, Spain
                [15 ] Biochemistry Laboratory, Osakidetza/Basque Health Service, Mendaro Hospital, Gipuzkoa, Spain
                The University of Georgia, UNITED STATES
                Author notes

                Competing Interests: The authors have declared that no competing interests exist.

                ¶ Membership list can be listed in the Acknowledgments section.

                Author information
                https://orcid.org/0000-0001-9959-2429
                https://orcid.org/0000-0003-3933-2582
                https://orcid.org/0000-0002-8049-3030
                Article
                PONE-D-21-13738
                10.1371/journal.pone.0259203
                8568264
                0b9f55f4-7cba-4cf5-9bd2-bb9e7be932a5
                © 2021 Garcia-Zamalloa et al

                This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

                History
                : 25 April 2021
                : 14 October 2021
                Page count
                Figures: 5, Tables: 4, Pages: 22
                Funding
                Funded by: Office of Health Research and Innovation, Department of Health, Basque Government
                Award ID: PI 2016111036
                Award Recipient :
                As we state in the manuscript, our study was supported by grant PI2016111036 to Dr. Diego Vicente from the Office of Health Research and Innovation of the Department of Health of the Basque Government. Funding was mainly used for payment of Xpert MTB/RIF in pleural fluid and tissue samples. There was no role of the funders regarding the study design, data collection, medical decisions or preparation of the manuscript.
                Categories
                Research Article
                Biology and Life Sciences
                Anatomy
                Thorax
                Pleurae
                Medicine and Health Sciences
                Anatomy
                Thorax
                Pleurae
                Medicine and Health Sciences
                Diagnostic Medicine
                Tuberculosis Diagnosis and Management
                Medicine and Health Sciences
                Pulmonology
                Pleural Effusion
                Medicine and Health Sciences
                Diagnostic Medicine
                Medicine and Health Sciences
                Diagnostic Medicine
                Cancer Detection and Diagnosis
                Medicine and Health Sciences
                Oncology
                Cancer Detection and Diagnosis
                Biology and Life Sciences
                Organisms
                Bacteria
                Actinobacteria
                Mycobacterium Tuberculosis
                Medicine and Health Sciences
                Oncology
                Cancers and Neoplasms
                Lung and Intrathoracic Tumors
                Computer and Information Sciences
                Artificial Intelligence
                Machine Learning
                Custom metadata
                All relevant data are within the manuscript and its Supporting information files.

                Uncategorized
                Uncategorized

                Comments

                Comment on this article