Alzheimer’s disease (AD) is traditionally thought of as a neurodegenerative disease. Recent evidence shows that beta amyloid-independent vascular changes and beta amyloid-dependent neuronal dysfunction both equally influence the disease, leading to loss of structural and functional connectivity. White matter changes (WMCs) in the brain are commonly observed in dementia patients. The effect of vascular factors on WMCs and the relationship between WMCs and severity of AD in patients remain to be clarified. We recruited 501 clinically diagnosed probable AD patients with a series of comprehensive neuropsychological tests and brain imaging. The WMCs in cerebral CT or MRI were rated using both the modified Fazekas scale and the combined CT-MRI age related WMC (ARWMC) rating scale. Periventricular WMCs were observed in 79.4% of the patients and deep WMCs were also seen in 48.7% of the patients. WMC scores were significantly higher in the advanced dementia stage in periventricular WMCs ( p = 0.001) and total ARWMCs ( p < 0.001). Age and disease severity were both independently associated with WMCs score, particularly in the total, frontal and parieto-occipital areas. Vascular factors including hypertension, diabetes mellitus, and gender were not significantly associated with WMCs. In conclusion, both age and severity of dementia were significantly associated with WMCs in AD patients. These associations highlight future research targets.