Hospital quality reporting in the pandemic era: to what extent did hospitals’ COVID-19 census burdens impact 30-day mortality among non-COVID Medicare beneficiaries?

Abstract

Objectives

Highly visible hospital quality reporting stakeholders in the USA such as the US News & World Report (USNWR) and the Centers for Medicare & Medicaid Services (CMS) play an important health systems role via their transparent public reporting of hospital outcomes and performance. However, during the pandemic, many such quality measurement stakeholders and pay-for-performance programmes in the USA and Europe have eschewed the traditional risk adjustment paradigm, instead choosing to pre-emptively exclude months or years of pandemic era performance data due largely to hospitals’ perceived COVID-19 burdens. These data exclusions may lead patients to draw misleading conclusions about where to seek care, while also masking genuine improvements or deteriorations in hospital quality that may have occurred during the pandemic. Here, we assessed to what extent hospitals’ COVID-19 burdens (proportion of hospitalised patients with COVID-19) were associated with their non-COVID 30-day mortality rates from March through November 2020 to inform whether inclusion of pandemic-era data may still be appropriate.

Design

This was a retrospective cohort study using the 100% CMS Inpatient Standard Analytic File and Master Beneficiary Summary File to include all US Medicare inpatient encounters with admission dates from 1 April 2020 through 30 November 2020, excluding COVID-19 encounters. Using linear regression, we modelled the association between hospitals’ COVID-19 proportions and observed/expected (O/E) ratios, testing whether the relationship was non-linear. We calculated alternative hospital O/E ratios after selective pandemic data exclusions mirroring the USNWR data exclusion methodology.

Setting and participants

We analysed 4 182 226 consecutive Medicare inpatient encounters from across 2601 US hospitals.

Results

The association between hospital COVID-19 proportion and non-COVID O/E 30-day mortality was statistically significant (p<0.0001), but weakly correlated (r ²=0.06). The median (IQR) pairwise relative difference in hospital O/E ratios comparing the alternative analysis with the original analysis was +3.7% (−2.5%, +6.7%), with 1908/2571 (74.2%) of hospitals having relative differences within ±10%.

Conclusions

For non-COVID patient outcomes such as mortality, evidence-based inclusion of pandemic-era data is methodologically plausible and must be explored rather than exclusion of months or years of relevant patient outcomes data.