As knowledge-based planning (KBP) attempts to augment and potentially supplant manual treatment planning, it is imperative to ensure any implementation maintains or improves overall plan quality in any disease site. The purpose of this study was to demonstrate the overall quality of KBP-driven automated stereotactic radiosurgery (SRS) treatment planning using blinded physician comparison and determine systematic factors predictive of physician plan preference to guide future KBP refinement.