A Guide to Evaluation of Quality Improvement and Patient Safety Educational Programs: Lessons From the VA Chief Resident in Quality and Safety Program

Abstract

With the recent proliferation of quality improvement (QI) and patient safety (PS) education programs, guidance is needed on how to assess the effectiveness of these programs. Without a systematic approach, evaluation efforts may end up being disjointed, lead to excess participant burden, or yield unhelpful feedback because of poor fit with program priorities. This article presents a framework for developing a multilevel evaluation infrastructure using examples from the evaluation of the national Department of Veterans Affairs Chief Resident in Quality and Safety program, a 1-year, post-accreditation program to develop leadership and teaching skills in QI and PS. It illustrates how to apply the framework to establish evaluation priorities and methods, and shares sample results and how they are used to guide program improvements and track important outcomes at multiple levels. The framework is particularly relevant to other nonaccredited advanced QI/PS programs, yet offers useful considerations for evaluating any advanced medical education program.