Realist evaluation has become widespread partly because of its sensitivity to the influence of contexts on policy implementation. In many such evaluations, the range of contexts considered relevant nevertheless remains disparate and under-conceptualised. This article uses findings from a realist evaluation of English Patient Safety Collaboratives during 2015–2018 to develop a realist taxonomy of contexts, differentiating contexts according to how they affect the corresponding policy mechanism. By analysing the main context-mechanism-outcome configurations that made up the English Patient Safety Collaboratives, we derive a taxonomy of the contexts that affected implementation and outcomes. The categories of context were structural (network, hierarchy, market and organisational contexts); resource-based (actors, material, financial); motivational (receptivity, outcome headroom), and temporal (continuity, history and convergence). To the categories found in previous studies, this study adds the three temporal contexts.
AaronsGSommerfeldDWalrath-GreeneC (2009) Evidence-based practice implementation: The impact of public versus Private Sector Organization type on organizational support, provider attitudes, and adoption of evidence-based practice. Implementation Science4(1): 83.
2.
AdairKCQuowKFrankelA, et al. (2018) The improvement readiness scale of the SCORE survey: A metric to assess capacity for quality improvement in healthcare. BMC Health Services Research18(1): 975.
3.
AlgurénBNordinAAndersson-GäreB, et al. (2019) In-depth comparison of two quality improvement collaboratives from different healthcare areas based on registry data – possible factors contributing to sustained improvement in outcomes beyond the project time. Implementation Science14(1): 74.
AstburyBLeeuwFL (2010) Unpacking black boxes: Mechanisms and theory building in evaluation. American Journal of Evaluation31(3): 363–81.
6.
AvelingE-LParkerMDixon-WoodsM (2016) What is the role of individual accountability in patient safety? A multi-site ethnographic study. Sociology of Health & Illness38(2): 216–32.
7.
BambergerP (2008) Beyond contextualization: Using context theories to narrow the micro-macro gap in management research. Academy of Management Journal51(5): 839–46.
8.
BarcelóACafieroEde BoerM, et al. (2010) Using collaborative learning to improve diabetes care and outcomes: The VIDA project. Primary Care Diabetes4(3): 145–53.
9.
BarnesMMatkaESullivanH (2003) Evidence, understanding and complexity: Evaluation in non-linear systems. Evaluation9(3): 265–84.
10.
BartholomewNGJoeGWRowan-SzalGA, et al. (2007) Counselor assessments of training and adoption barriers. Journal of Substance Abuse Treatment33(2): 193–9.
11.
BastienJ (2009) Goal ambiguity and informal discretion in the implementation of public policies: The case of Spanish immigration policy. International Review of Administrative Sciences75(4): 665–85.
12.
BennJBurnettSParandA, et al. (2012) Factors predicting change in hospital safety climate and capability in a multi-site patient safety collaborative: A longitudinal survey study. BMJ Quality & Safety21(7): 559–68.
13.
BenningAGhalebMSuokasA, et al. (2011) Large scale organisational intervention to improve patient safety in four UK hospitals: Mixed method evaluation. BMJ (Clinical Research Ed.)342(February): d195.
14.
BergenAWhiteA (2005) ‘Implementation deficit’ and ‘street-level bureaucracy’: Policy, practice and change in the development of community nursing issues. Health & Social Care in the Community13(1): 1–10.
15.
BerwickD (2013) A Promise to Learn – A Commitment to Act. Improving the Safety of Patients in England. London: National Advisory Group on the Safety of Patients in England.
16.
BionJRichardsonAHibbertP, et al. (2013) ‘Matching Michigan’: A 2-year stepped interventional programme to minimise central venous catheter-blood stream infections in intensive care units in England. BMJ Quality & Safety22(2): 110–23.
17.
BoschMDijkstraRWensingM, et al. (2008) Organizational culture, team climate and diabetes care in small office-based practices. BMC Health Services Research8(1): 180.
18.
Bradford-HillA (1965) The environment and disease: Association or causation?Proceedings of the Royal Society of Medicine58(5): 295–300.
19.
BradleyEHCurryLADeversKJ (2007) Qualitative data analysis for health services research: Developing taxonomy, themes, and theory. Health Services Research42(4): 1758–72.
20.
BrewerBB (2006) Relationships among teams, culture, safety, and cost outcomes. Western Journal of Nursing Research28(6): 641–53.
21.
BroerTNieboerAPBalR (2012) Governing Mental Health Care: How power is exerted in and through a quality improvement collaborative. Public Administration90(3): 800–15.
22.
ByngRNormanIRedfernS, et al. (2008) Exposing the key functions of a complex intervention for shared care in mental health: Case study of a process evaluation. BMC Health Services Research8(1): 274.
23.
CarmeliAGittellJH (2009) High-quality relationships, psychological safety, and learning from failures in work organizations. Journal of Organizational Behavior30(6): 709–29.
24.
ChecklandKHarrisonS (2010) The impact of the quality and outcomes framework on practice organisation and service delivery: Summary of evidence from two qualitative studies. Quality in Primary Care18(2): 139–46.
25.
ChenHT (2014) Practical Program Evaluation: Theory-Driven Evaluation and the Integrated Evaluation Perspective. Thousand Oaks, CA: SAGE.
26.
ColdwellM (2019) Reconsidering context: Six underlying features of context to improve learning from evaluation. Evaluation25(1): 99–117.
27.
ConnLGMcKenzieMPearsallEA, et al. (2015) Successful implementation of an enhanced recovery after surgery programme for elective colorectal surgery: A process evaluation of champions’ experiences. Implementation Science10(1): 99.
28.
CunninghamFCRanmuthugalaGPlumbJ, et al. (2011) Health professional networks as a vector for improving healthcare quality and safety: A systematic review. BMJ Quality & Safety21(3): 239–49.
29.
CurryLABraultMALinnanderEL, et al. (2017) Influencing organisational culture to improve hospital performance in care of patients with acute myocardial infarction: A mixed-methods intervention study. BMJ Quality & Safety29: 384–91.
30.
DamanpourF (1991) Organizational innovation: A meta-analysis of effects of determinants and moderators. Academy of Management Journal34(3): 555–90.
31.
DamschroderLJLoweryJC (2013) Evaluation of a large-scale weight management program using the consolidated framework for implementation research (CFIR). Implementation Science8(1): 51.
32.
DaviesEShallerDEdgman-LevitanS, et al. (2008) Evaluating the use of a modified CAHPS® survey to support improvements in patient-centred care: Lessons from a quality improvement collaborative. Health Expectations11(2): 160–76.
DillonRLTinsleyCHMadsenPM, et al. (2016) Organizational correctives for improving recognition of near-miss events. Journal of Management42(3): 671–97.
35.
Dixon-WoodsM (2014) The problem of context in quality improvement. In: BatePRobertGFulopN, et al. (eds) Perspectives on Context a Selection of Essays Considering the Role of Context in Successful Quality Improvement. London: Health Foundation, 87–101.
36.
Dixon-WoodsMBakerRCharlesK, et al. (2013a) Culture and behaviour in the English National Health Service: Overview of lessons from a large multimethod study. BMJ Quality & Safety23: 106–15.
37.
Dixon-WoodsMLeslieMTarrantC, et al. (2013b) Explaining matching Michigan: An ethnographic study of a patient safety program. Implementation Science8: 70.
38.
DückersMLASpreeuwenbergPWagnerC, et al. (2009) Exploring the black box of quality improvement collaboratives: Modelling relations between conditions, applied changes and outcomes. Implementation Science4(1): 74.
39.
EdmondsonACBohmerRMPisanoGP (2001) Disrupted routines: Team learning and new technology implementation in hospitals. Administrative Science Quarterly46(4): 685–716.
40.
EisenhartM (2009) Generalization from qualitative inquiry. In: ErcikanKRothWM (eds) Generalizing from Educational Research: Beyond Qualitative and Quantitative Polarization. New York: Routledge, 51–66.
41.
ExworthyMPowellMMohanJ (1999) The NHS: Quasi-market, quasi-hierarchy and quasi-network?Public Money & Management19(4): 15–22.
42.
FerlieEBShortellSM (2001) Improving the quality of health care in the United Kingdom and the United States: A framework for change. Milbank Quarterly79(2): 281–315.
43.
FlinRMearnsKO’ConnorP, et al. (2000) Measuring safety climate: Identifying the common features. Safety Science34(1–3): 177–92.
44.
FrancoLMMarquezL (2011) Effectiveness of collaborative improvement: Evidence from 27 applications in 12 less-developed and middle-income countries. BMJ Quality & Safety20: 658–65.
45.
FultonBDIveySLRodriguezHP, et al. (2017) Countywide physician organization learning collaborative and changes in hospitalization rates. The American Journal of Managed Care23(10): 596–603.
46.
GaleNKHeathGCameronE, et al. (2013) Using the framework method for the analysis of qualitative data in multi-disciplinary health research. BMC Medical Research Methodology13(1): 117.
47.
GarvinDAEdmondsonACGinoF (2008) Is yours a learning organization?Harvard Business Review86(3): 109–16.
48.
GioiaDDziadoszG (2008) Adoption of evidence-based practices in community mental health: A mixed-method study of practitioner experience. Community Mental Health Journal44(5): 347–57.
49.
GittellJH (2000) Organizing work to support relational co-ordination. International Journal of Human Resource Management11(3): 517–39.
50.
GittellJHFairfieldKBierbaumB (2000) Impact of relational coordination on the quality of care, post-operative pain and functioning, and length of stay: A nine-hospital study of surgical patients. Medical Care38(8): 807–19.
51.
GittellJHWeinbergDPfefferleS, et al. (2008) Impact of relational coordination on job satisfaction and quality outcomes: A study of nursing homes. Human Resource Management Journal18(2): 154–70.
52.
HaederSF (2012) Beyond path dependence: Explaining healthcare reform and its consequences. Policy Studies Journal40: 65–86.
53.
HatahetMABowhanJCloughEA (2004) Wisconsin Collaborative for Healthcare Quality (WCHQ): Lessons learned. Wisconsin Medical Society103: 45–8.
54.
HerepathAKitchenerMWaringJ (2015) A realist analysis of hospital patient safety in Wales: Applied learning for alternative contexts from a multisite case study. Health Services and Delivery Research3(40): 1–242.
55.
HillHC (2003) Understanding implementation: Street-level bureaucrats’ resources for reform. Journal of Public Administration Research and Theory13(3): 265–82.
56.
HudsonP (2003) Applying the lessons of high risk industries to health care. BMJ Quality & Safety 12(suppl 1): i7–12.
57.
HulscherMSchoutenLMTGrolR (2009) Collaboratives. London: Health Foundation.
58.
JonesMB (2007) The multiple sources of mission drift. Nonprofit and Voluntary Sector Quarterly36(2): 299–307.
59.
JungCSLeeG (2016) Organizational climate, leadership, organization size, and aspiration for innovation in government agencies. Public Performance & Management Review39(4): 757–82.
60.
KanekoM (1999) A methodological inquiry into the evaluation of smoking cessation programmes. Health Education Research14(3): 433–41.
61.
KaplanHCBradyPWDritzMC, et al. (2010) The influence of context on quality improvement success in health care: A systematic review of the literature. The Milbank Quarterly88(4): 500–59.
62.
KaplanHCProvostLPFroehleCM, et al. (2012) The Model for Understanding Success in Quality (MUSIQ): Building a theory of context in healthcare quality improvement. BMJ Quality & Safety21(1): 13–20.
63.
KennedyMTFissPC (2009) Institutionalization, framing, and diffusion: The logic of TQM adoption and implementation decisions among US hospitals. Academy of Management Journal52(5): 897–918.
64.
KeoghB (2013) Review into the Quality of Care and Treatment Provided by 14 Hospital Trusts in England: Overview Report. London: NHS England.
65.
KiloCM (1998) A framework for collaborative improvement: Lessons from the institute for healthcare improvement’s breakthrough series. Quality Management in Healthcare6(4): 1–14.
66.
KnightAWFordDAudehmR, et al. (2012) The Australian Primary Care Collaboratives Program: Improving diabetes care. BMJ Quality & Safety21(11): 956–63.
67.
KnuthM (2009) Path shifting and path dependence: Labor market policy reforms under German federalism. International Journal of Public Administration32(12): 1048–69.
68.
KreinSLDamschroderLJKowalskiCP, et al. (2010) The influence of organizational context on quality improvement and patient safety efforts in infection prevention: A multi-center qualitative study. Social Science & Medicine71(9): 1692–701.
69.
KringosDSSunolRWagnerC, et al. (2015) The influence of context on the effectiveness of hospital quality improvement strategies: A review of systematic reviews. BMC Health Services Research15(1): 277.
70.
LewisCCBoydMRWalsh-BaileyC, et al. (2020) A systematic review of empirical studies examining mechanisms of implementation in health. Implementation Science15(1): 21.
71.
ManleyKJacksonCMcKenzieC, et al. (2017) Safety Culture, Quality Improvement, Realist Evaluation (SCQIRE). Evaluating the Impact of the Patient Safety Collaborative Initiative Developed by Kent Surrey and Sussex Academic Health Science Network (KSSAHSN) on Safety Culture, Leadership, and Quality Improvement Capability. Canterbury: Kent, Surrey and Sussex Academic Health Science Network.
72.
ManserT (2009) Teamwork and patient safety in dynamic domains of healthcare: A review of the literature. Acta Anaesthesiologica Scandinavica53(2): 143–51.
73.
MarchalBvan BelleSvan OlmenJ, et al. (2012) Is realist evaluation keeping its promise? A review of published empirical studies in the field of health systems research. Evaluation18(2): 192–212.
74.
MardonREKhannaKSorraJ, et al. (2010) Exploring relationships between hospital patient safety culture and adverse events. Journal of Patient Safety6(4): 226–32.
75.
MarshallMNShekellePGLeathermanS, et al. (2000) Public release of performance data. What do we expect to gain? A review of the evidence. Journal of the American Medical Association284(14): 1865–74.
76.
MasonPBarnesM (2007) Constructing theories of change: Methods and sources. Evaluation13(2): 151–70.
77.
MohrJBataldenPBarachP (2004) Integrating patient safety into the clinical microsystem. Quality and Safety in Health Care13(suppl 2): ii34–8.
78.
NadeemEOlinSSHillLC, et al. (2013) Understanding the components of quality improvement collaboratives: A systematic literature review. The Milbank Quarterly91(2): 354–94.
79.
NembhardIM (2012) All teach, all learn, all improve? The role of interorganizational learning in quality improvement collaboratives. Health Care Management Review37(2): 154–64.
80.
NewtonJGrahamJMcLoughlinK, et al. (2003) Receptivity to change in a general medical practice. British Journal of Management14(2): 143–53.
81.
ØvretveitJClearyPCretinS, et al. (2002) Quality collaboratives: Lessons from research. Quality and Safety in Health Care11(4): 345–51.
82.
ØvretveitJCShekellePGDySM, et al. (2011) How does context affect interventions to improve patient safety? An assessment of evidence from studies of five patient safety practices and proposals for research. Quality and Safety in Health Care20(7): 604–10.
83.
ParandABennJBurnettS, et al. (2012) Strategies for sustaining a quality improvement collaborative and its patient safety gains. International Journal for Quality in Health Care24(4): 380–90.
PawsonRGreenhalghTHarveyC, et al. (2005) Realist review – A new method of systematic review designed for complex policy interventions. Journal of Health Services Research and Policy 10(Suppl 1): 21–34.
87.
PettigrewAFerlieEMcKeeL (1992) Shaping strategic change-the case of the NHS in the 1980s. Public Money & Management12(3): 27–31.
88.
PizziLGoldfarbNNashD (2001) Promoting a culture of safety. In: ShojaniaKDuncanBMcDonaldK, et al. (eds) Making Health Care Safer: A Critical Analysis of Patient Safety Practices (43: 447–52. Evidence Report/Technology Assessment). Rockville, MD: Agency for Healthcare Research and Quality. Available at: http://www.ahrq.gov/clinic/ptsafety/chap40.htm
89.
ProfitJSharekPJAmspokerAB, et al. (2014) Burnout in the NICU setting and its relation to safety culture. BMJ Quality & Safety23(10): 806–13.
90.
PronovostPNeedhamDBerenholtzS, et al. (2006) An intervention to decrease catheter-related bloodstream infections in the ICU. The New England Journal of Medicine355(26): 2725–32.
91.
RaghavanRInkelasMFrankeT, et al. (2007) Administrative barriers to the adoption of high-quality mental health services for children in foster care: A national study. Administration and Policy in Mental Health and Mental Health Services Research34(3): 191–201.
92.
RasmussenJPedersenOM (1984) Human factors in probabilistic risk analysis and risk management. Operational Safety of Nuclear Power Plants1: 181–94.
93.
ReamesBNKrellRWCampbellDA, et al. (2015) A checklist-based intervention to improve surgical outcomes in Michigan: Evaluation of the keystone surgery program. JAMA Surgery150(3): 208–15.
94.
RogD (2012) When background becomes foreground: Toward context-sensitive evaluation practice. New Directions for Evaluation2012(135): 25–40.
95.
RossiterMVermaJDenisJ-L, et al. (2017) Governing collaborative healthcare improvement: Lessons from an Atlantic Canadian case. International Journal of Health Policy and Management6(12): 691–4.
96.
RussSJSevdalisNMoorthyK, et al. (2015) A qualitative evaluation of the barriers and facilitators toward implementation of the WHO surgical safety checklist across hospitals in England: Lessons from the ‘Surgical Checklist Implementation Project’. Annals of Surgery261(1): 81–91.
97.
Safe & Reliable Healthcare (2014) The Integrated SCORE (Safety, Communication, Operational Reliability & Engagement Survey) Survey for Organizational Learning and Improvement. Evergreen, CO: Safe & Reliable Healthcare.
98.
SayerA (1992) Method in Social Science: A Realist Approach. Abingdon: Psychology Press.
99.
SchoutenLMTHulscherMEJLvan EverdingenJJE, et al. (2008) Evidence for the impact of quality improvement collaboratives: Systematic review. The BMJ336(7659): 1491–4.
100.
SextonJHelmreichRLNeilandsTB, et al. (2006) The safety attitudes questionnaire: Psychometric properties, benchmarking data, and emerging research. BMC Health Services Research6(1): 44.
101.
SextonJSchwartzSPChadwickWA, et al. (2017) The associations between work–life balance behaviours, teamwork climate and safety climate: Cross-sectional survey introducing the work–life climate scale, psychometric properties, benchmarking data and future directions. BMJ Quality & Safety26(8): 632–40.
102.
ShawEKChaseSMHowardJ, et al. (2012) More black box to explore: How quality improvement collaboratives shape practice change. The Journal of the American Board of Family Medicine25(2): 149–57.
103.
SheaffR (1997) Healthcare access and mobility between the UK and other European Union states: An implementation surplus. Health Policy42(3): 239–53.
104.
ShortellSMMarstellerJALinM, et al. (2004) The role of perceived team effectiveness in improving chronic illness care. Medical Care42(11): 1040–8.
105.
SimonsH (2015) Interpret in context: Generalizing from the single case in evaluation. Evaluation21(2): 173–88.
106.
SingerSJVogusTJ (2013) Reducing hospital errors: Interventions that build safety culture. Annual Review of Public Health34: 373–96.
107.
SmithSNGreeneMTModyL, et al. (2017) Evaluation of the association between Nursing Home Survey on Patient Safety Culture (NHSOPS) measures and catheter-associated urinary tract infections: Results of a national collaborative. BMJ Quality & Safety27: 464–73.
108.
SolbergLI (2005) If you’ve seen one quality improvement collaborative . . . . The Annals of Family Medicine3(3): 198–9.
109.
SouthonGPerkinsRGallerD (2005) Networks: A key to the future of health services. Australian Health Review29(3): 317–26.
110.
The Mid Staffordshire NHS Foundation Trust Inquiry (2010) Independent Enquiry into the Care Provided by Mid Staffordshire NHS Foundation Trust 2005-2009. London: HMSO.
UrbachDRGovindarajanASaskinR, et al. (2014) Introduction of surgical safety checklists in Ontario, Canada. New England Journal of Medicine370(11): 1029–38.
114.
VanderkruikRMcPhersonME (2017) A contextual factors framework to inform implementation and evaluation of public health initiatives. American Journal of Evaluation38(3): 348–59.
115.
VosLDuckersMWagnerC, et al. (2010) Applying the quality improvement collaborative method to process redesign: A multiple case study. Implementation Science5(1): 19.
116.
WellsSTamirOGrayJ, et al. (2018) Are quality improvement collaboratives effective? A systematic review. BMJ Quality & Safety27(3): 226–40.
117.
WilliamsNJGlissonCHemmelgarnA, et al. (2017) Mechanisms of change in the ARC organizational strategy: Increasing mental health clinicians’ EBP adoption through improved organizational culture and capacity. Administration and Policy in Mental Health44(2): 269–83.
118.
ZammutoRFO’ConnorEJ (1992) Gaining advanced manufacturing technologies’ benefits: The roles of organization design and culture. Academy of Management Review17(4): 701–28.
