Episodic-Memory Performance in Machine Learning Modeling for Predicting Cognitive Health Status Classification

Abstract

Background:

Memory dysfunction is characteristic of aging and often attributed to Alzheimer’s disease (AD). An easily administered tool for preliminary assessment of memory function and early AD detection would be integral in improving patient management.

Objective:

Our primary aim was to utilize machine learning in determining initial viable models to serve as complementary instruments in demonstrating efficacy of the MemTrax online Continuous Recognition Tasks (M-CRT) test for episodic-memory screening and assessing cognitive impairment.

Methods:

We used an existing dataset subset ( n = 18,395) of demographic information, general health screening questions (addressing memory, sleep quality, medications, and medical conditions affecting thinking), and test results from a convenience sample of adults who took the M-CRT test. M-CRT performance and participant features were used as independent attributes: true positive/negative, percent responses/correct, response time, age, sex, and recent alcohol consumption. For predictive modeling, we used demographic information and test scores to predict binary classification of the health-related questions (yes/no) and general health status (healthy/unhealthy), based on the screening questions.

Results:

ANOVA revealed significant differences among HealthQScore groups for response time true positive ( p = 0.000) and true positive ( p = 0.020), but none for true negative ( p = 0.0551). Both % responses and % correct had significant differences ( p = 0.026 and p = 0.037, respectively). Logistic regression was generally the top-performing learner with moderately robust prediction performance (AUC) for HealthQScore (0.648–0.680) and selected general health questions (0.713–0.769).

Conclusion:

Our novel application of supervised machine learning and predictive modeling helps to demonstrate and validate cross-sectional utility of MemTrax in assessing early-stage cognitive impairment and general screening for AD.