Evidence based medicine: a movement in crisis?

Objective To evaluate current risk models and scores for type 2 diabetes and inform selection and implementation of these in practice. Design Systematic review using standard (quantitative) and realist (mainly qualitative) methodology. Inclusion criteria Papers in any language describing the development or external validation, or both, of models and scores to predict the risk of an adult developing type 2 diabetes. Data sources Medline, PreMedline, Embase, and Cochrane databases were searched. Included studies were citation tracked in Google Scholar to identify follow-on studies of usability or impact. Data extraction Data were extracted on statistical properties of models, details of internal or external validation, and use of risk scores beyond the studies that developed them. Quantitative data were tabulated to compare model components and statistical properties. Qualitative data were analysed thematically to identify mechanisms by which use of the risk model or score might improve patient outcomes. Results 8864 titles were scanned, 115 full text papers considered, and 43 papers included in the final sample. These described the prospective development or validation, or both, of 145 risk prediction models and scores, 94 of which were studied in detail here. They had been tested on 6.88 million participants followed for up to 28 years. Heterogeneity of primary studies precluded meta-analysis. Some but not all risk models or scores had robust statistical properties (for example, good discrimination and calibration) and had been externally validated on a different population. Genetic markers added nothing to models over clinical and sociodemographic factors. Most authors described their score as “simple” or “easily implemented,” although few were specific about the intended users and under what circumstances. Ten mechanisms were identified by which measuring diabetes risk might improve outcomes. Follow-on studies that applied a risk score as part of an intervention aimed at reducing actual risk in people were sparse. Conclusion Much work has been done to develop diabetes risk models and scores, but most are rarely used because they require tests not routinely available or they were developed without a specific user or clear use in mind. Encouragingly, recent research has begun to tackle usability and the impact of diabetes risk scores. Two promising areas for further research are interventions that prompt lay people to check their own diabetes risk and use of risk scores on population datasets to identify high risk “hotspots” for targeted public health interventions.

IMPORTANCE Despite the documented prevalence and clinical ramifications of physician distress, few rigorous studies have tested interventions to address the problem. OBJECTIVE To test the hypothesis that an intervention involving a facilitated physician small-group curriculum would result in improvement in well-being. DESIGN, SETTING, AND PARTICIPANTS Randomized clinical trial of 74 practicing physicians in the Department of Medicine at the Mayo Clinic in Rochester, Minnesota, conducted between September 2010 and June 2012. Additional data were collected on 350 nontrial participants responding to annual surveys timed to coincide with the trial surveys. INTERVENTIONS The intervention involved 19 biweekly facilitated physician discussion groups incorporating elements of mindfulness, reflection, shared experience, and small-group learning for 9 months. Protected time (1 hour of paid time every other week) for participants was provided by the institution. MAIN OUTCOMES AND MEASURES Meaning in work, empowerment and engagement in work, burnout, symptoms of depression, quality of life, and job satisfaction assessed using validated metrics. RESULTS Empowerment and engagement at work increased by 5.3 points in the intervention arm vs a 0.5-point decline in the control arm by 3 months after the study (P = .04), an improvement sustained at 12 months (+5.5 vs +1.3 points; P = .03). Rates of high depersonalization at 3 months had decreased by 15.5% in the intervention arm vs a 0.8% increase in the control arm (P = .004). This difference was also sustained at 12 months (9.6% vs 1.5% decrease; P = .02). No statistically significant differences in stress, symptoms of depression, overall quality of life, or job satisfaction were seen. In additional comparisons including the nontrial physician cohort, the proportion of participants strongly agreeing that their work was meaningful increased 6.3% in the study intervention arm but decreased 6.3% in the study control arm and 13.4% in the nonstudy cohort (P = .04). Rates of depersonalization, emotional exhaustion, and overall burnout decreased substantially in the trial intervention arm, decreased slightly in the trial control arm, and increased in the nontrial cohort (P = .03, .007, and .002 for each outcome, respectively). CONCLUSIONS AND RELEVANCE An intervention for physicians based on a facilitated small-group curriculum improved meaning and engagement in work and reduced depersonalization, with sustained results at 12 months after the study. TRIAL REGISTRATION clinicaltrials.gov Identifier: NCT01159977.

Although current electronic methods of scientific publishing offer increased opportunities for publishing all research studies and describing them in sufficient detail, health research literature still suffers from many shortcomings. These shortcomings seriously undermine the value and utility of the literature and waste scarce resources invested in the research. In recent years there have been several positive steps aimed at improving this situation, such as a strengthening of journals' policies on research publication and the wide requirement to register clinical trials. The EQUATOR (Enhancing the QUAlity and Transparency Of health Research) Network is an international initiative set up to advance high quality reporting of health research studies; it promotes good reporting practices including the wider implementation of reporting guidelines. EQUATOR provides free online resources http://www.equator-network.org supported by education and training activities and assists in the development of robust reporting guidelines. This paper outlines EQUATOR's goals and activities and offers suggestions for organizations and individuals involved in health research on how to strengthen research reporting.