Development and Validation of a Deep-Learning Model to Screen for Hyperkalemia From the Electrocardiogram

Abstract

Can a deep-learning model classify hyperkalemia from the electrocardiogram (ECG) in patients with chronic kidney disease? In this validation study, a deep neural network was trained using more than 1.5 million ECGs recorded from 1994 to 2017 from approximately 450 000 patients seen at the Mayo Clinic in Minnesota and validated on nearly 62 000 ECGs from the Mayo Clinic in Minnesota, Florida, and Arizona. Using 2 or 4 ECG leads, a deep-learning model detected hyperkalemia with high sensitivity and negative predictive value, with an area under the curve between 0.853 and 0.901. Deep learning may enable noninvasive screening for hyperkalemia in at-risk patients with chronic kidney disease. For patients with chronic kidney disease (CKD), hyperkalemia is common, associated with fatal arrhythmias, and often asymptomatic, while guideline-directed monitoring of serum potassium is underused. A deep-learning model that enables noninvasive hyperkalemia screening from the electrocardiogram (ECG) may improve detection of this life-threatening condition. To evaluate the performance of a deep-learning model in detection of hyperkalemia from the ECG in patients with CKD. A deep convolutional neural network (DNN) was trained using 1 576 581 ECGs from 449 380 patients seen at Mayo Clinic, Rochester, Minnesota, from 1994 to 2017. The DNN was trained using 2 (leads I and II) or 4 (leads I, II, V3, and V5) ECG leads to detect serum potassium levels of 5.5 mEq/L or less (to convert to millimoles per liter, multiply by 1) and was validated using retrospective data from the Mayo Clinic in Minnesota, Florida, and Arizona. The validation included 61 965 patients with stage 3 or greater CKD. Each patient had a serum potassium count drawn within 4 hours after their ECG was recorded. Data were analyzed between April 12, 2018, and June 25, 2018. Use of a deep-learning model. Area under the receiver operating characteristic curve (AUC) and sensitivity and specificity, with serum potassium level as the reference standard. The model was evaluated at 2 operating points, 1 for equal specificity and sensitivity and another for high (90%) sensitivity. Of the total 1 638 546 ECGs, 908 000 (55%) were from men. The prevalence of hyperkalemia in the 3 validation data sets ranged from 2.6% (n = 1282 of 50 099; Minnesota) to 4.8% (n = 287 of 6011; Florida). Using ECG leads I and II, the AUC of the deep-learning model was 0.883 (95% CI, 0.873-0.893) for Minnesota, 0.860 (95% CI, 0.837-0.883) for Florida, and 0.853 (95% CI, 0.830-0.877) for Arizona. Using a 90% sensitivity operating point, the sensitivity was 90.2% (95% CI, 88.4%-91.7%) and specificity was 63.2% (95% CI, 62.7%-63.6%) for Minnesota; the sensitivity was 91.3% (95% CI, 87.4%-94.3%) and specificity was 54.7% (95% CI, 53.4%-56.0%) for Florida; and the sensitivity was 88.9% (95% CI, 84.5%-92.4%) and specificity was 55.0% (95% CI, 53.7%-56.3%) for Arizona. In this study, using only 2 ECG leads, a deep-learning model detected hyperkalemia in patients with renal disease with an AUC of 0.853 to 0.883. The application of artificial intelligence to the ECG may enable screening for hyperkalemia. Prospective studies are warranted. This validation study evaluates the performance of a deep-learning model in detection of hyperkalemia from the electrocardiogram in patients with chronic kidney disease.