Implementation strategies support the adoption, implementation, and maintenance of evidence—based interventions in community settings. However, strategies often conclude when funding ends, leaving implementers without assistance to maintain interventions. Implementation strategies focused on program evaluation and dissemination—factors that lead to program maintenance—are needed. The goal of this study was to understand barriers and facilitators to evaluation and dissemination in community-based organizations to inform relevant implementation strategies. Semi-structured interviews were conducted using an interview guide based on Consolidated Framework for Implementation Research (CFIR) constructs hypothesized to influence evaluation and dissemination: complexity, self-efficacy, culture, available resources, leadership engagement, organizational incentives and rewards, external policies and incentives, reflecting and evaluating, and champions. The guide also queried implementation strategy preferences. A rapid deductive approach was used to analyze the data through a template aligned with the interview guide. Nine interviewees shared barriers around reflecting and evaluating (e.g., data collection challenges), available resources (e.g., organizational capacity), and organizational incentives and rewards (e.g., lack of recognition). Interviewees favored ongoing consultation, tools or plans, problem-solving support, and peer sharing. Based on these results, a technical assistance (TA) protocol was developed to include monthly consultation meetings and quarterly learning collaboratives to build capacity in project partner (UnitedHealthcare) grantees. Future work should evaluate the TA protocol for effectiveness in alleviating the identified barriers and improving program implementers’ evaluation and dissemination capacity. If successful, this model could be used in other community settings experiencing similar barriers, ultimately leading to improved maintenance of evidence-based interventions.
AaronsG. A.HurlburtM.HorwitzS. M. (2011). Advancing a conceptual model of evidence-based practice implementation in public service sectors. Administration and Policy in Mental Health and Mental Health Services Research, 38(1), 4–23. https://doi.org/10.1007/s10488-010-0327-7
2.
AaronsG. A.SklarM.MustanskiB.BenbowN.Hendricks BrownC. (2017). “Scaling-out” evidence-based interventions to new populations or new health care delivery systems. Implementation Science, 12, 111. https://doi.org/10.1186/s13012-017-0640-6
3.
Bach-MortensenA. M.LangeB. C. L.MontgomeryP. (2018). Barriers and facilitators to implementing evidence-based interventions among third sector organisations: A systematic review. Implementation Science, 13, 103. https://doi.org/10.1186/s13012-018-0789-7
4.
BalisL. E.HardenS. M. (2021). “Replanning” a statewide walking program through the iterative use of the reach, effectiveness, adoption, implementation, and maintenance framework. Journal of Physical Activity & Health, 18(10), 1310–1317. https://doi.org/10.1123/jpah.2021-0034
5.
BalisL. E.HoughtalingB.ClausenW.LaneH.WendeM. E.PereiraE.McLoughlinG. M.HardenS. M. (2024). Advancing implementation science in community settings: The implementation strategies applied in communities (ISAC) compilation. International Journal of Behavioral Nutrition and Physical Activity, 21(1), 132. https://doi.org/10.1186/s12966-024-01685-5
6.
BalisL. E.HoughtalingB.HardenS. M. (2022). Using implementation strategies in community settings: An introduction to the Expert Recommendations for Implementing Change (ERIC) compilation and future directions. Translational Behavioral Medicine, 12(10), 965–978. https://doi.org/10.1093/tbm/ibac061
7.
BalisL. E.JohnD.HardenS. (2019). Beyond evaluation: Using the RE-AIM framework for program planning in extension. Journal of Extension, 57(2), 2T0T1.
8.
BalisLEHoughtalingB. (2023) Matching barriers and facilitators to implementation strategies: Recommendations for community settings. Implementation Science Communications, 4, 144.
9.
BalisL. E.StrayerT.RamalingamN.WilsonM.HardenS. (2019). Open-access physical activity programs for older adults: A pragmatic and systematic review. The Gerontologist, 59(4), e268–e278. https://doi.org/10.1093/geront/gnx195
10.
BirkenS. A.HainesE. R.HwangS.ChambersD. A.BungerA. C.NilsenP. (2020). Advancing understanding and identifying strategies for sustaining evidence-based practices: A review of reviews. Implementation Science, 15(1), 88. https://doi.org/10.1186/s13012-020-01040-9
11.
BrandT.PischkeC. R.SteenbockB.SchoenbachJ.PoettgenS.Samkange-ZeebF.ZeebH. (2014). What works in community-based interventions promoting physical activity and healthy eating? A review of reviews. International Journal of Environmental Research and Public Health, 11(6), 5866–5888. https://doi.org/10.3390/ijerph110605866
12.
BrownsonR. C.EylerA. A.HarrisJ. K.MooreJ. B.TabakR. G. (2018). Getting the word out: New approaches for disseminating public health science. Journal of Public Health Management and Practice, 24(2), 102–111. https://doi.org/10.1097/PHH.0000000000000673
13.
BrownsonR. C.JacobsJ. A.TabakR. G.HoehnerC. M.StamatakisK. A. (2012). Designing for dissemination among public health researchers: Findings from a National Survey in the United States. American Journal of Public Health, 103(9), 1693–1699. https://doi.org/10.2105/AJPH.2012.301165
ChambersD. A.GlasgowR. E.StangeK. C. (2013). The dynamic sustainability framework: Addressing the paradox of sustainment amid ongoing change. Implementation Science, 8, 117. https://doi.org/10.1186/1748-5908-8-117
16.
ChenA. M. H.DraimeJ. A.BermanS.GardnerJ.KraussZ.MartinezJ. (2022). Food as medicine? Exploring the impact of providing healthy foods on adherence and clinical and economic outcomes. Exploratory Research in Clinical and Social Pharmacy, 5, 100129. https://doi.org/10.1016/j.rcsop.2022.100129
17.
Consolidated Framework for Implementation Research Team. (2025). Consolidated framework for implementation research. Center for Clinical Management Research. http://www.cfirguide.org/
18.
DamschroderL. J.AronD.KeithR.KirshS.AlexanderJ.LoweryJ. (2009). Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implementation Science, 4, 50. https://doi.org/10.1186/1748-5908-4-50
19.
DamschroderL. J.ReardonC. M.WiderquistM. A. O.LoweryJ. (2022). The updated consolidated framework for implementation research based on user feedback. Implementation Science, 17(1), 75. https://doi.org/10.1186/s13012-022-01245-0
20.
DomlynA. M.ScottV.LivetM.LamontA.WatsonA.KenworthyT.TalfordM.YannayonM.WandersmanA. (2021). R = MC2 readiness building process: A practical approach to support implementation in local, state, and national settings. Journal of Community Psychology, 49(5), 1228–1248. https://doi.org/10.1002/jcop.22531
21.
DownerS.BerkowitzS. A.HarlanT. S.OlstadD. L.MozaffarianD. (2020). Food is medicine: Actions to integrate food and nutrition into healthcare. BMJ, 369, m2482. https://doi.org/10.1136/bmj.m2482
22.
FinleyE.HamiltonA.KowalskiC.MidboeA.NevedalA.YoungJ. (2022). Rapid qualitative methods in implementation science: Techniques and considerations [Conference session]. 15th Annual Conference on the Science of Dissemination and Implementation in Health, Washington, DC, United States.
23.
GaleR.WuJ.ErhardtT.BounthavongM.ReardonC.DamschroderL.MidboeA. (2019). Comparison of rapid vs in-depth qualitative analytic methods from a process evaluation of academic detailing in the Veterans Health Administration. Implementation Science, 14, 11. https://doi.org/10.1186/s13012-019-0853-y
24.
GlasgowR.HardenS.GaglioB.RabinB.SmithM.PorterG.OryM.EstabrooksP. (2019). RE-AIM planning and evaluation framework: Adapting to new science and practice with a 20-year review. Frontiers in Public Health, 7, 64. https://doi.org/10.3389/fpubh.2019.00064
25.
GlasgowR.KlesgesL.DzewaltowskiD.BullS.EstabrooksP. (2004). The future of health behavior change research: What is needed to improve translation of research into health promotion practice?Annals of Behavioral Medicine, 27(1), 3–12.
26.
GlasgowR.VogtT.BolesS. (1999). Evaluating the public health impact of health promotion interventions: The RE-AIM framework. American Journal of Public Health, 9, 1322–1327.
27.
GreenL. (2008). Making research relevant: If it is an evidence-based practice, where’s the practice-based evidence?Family Practice, 25(1), i20–i24. https://doi.org/10.1093/fampra/cmn055
28.
GuestG.NameyE.TaylorJ.EleyN.McKennaK. (2017). Comparing focus groups and individual interviews: Findings from a randomized study. International Journal of Social Research Methodology, 20(6), 693–708. https://doi.org/10.1080/13645579.2017.1281601
29.
Gus Schumacher Nutrition Incentive Program Nutrition Incentive Program Training Technical Assistance Evaluation Information Center. (n.d.). Nutrition Incentive Hub. https://www.nutritionincentivehub.org/
30.
HamiltonA. (2013). Qualitative methods in rapid turn-around health services research. VA HSR&D Cyberseminar Spotlight on Women’s Health.
31.
HardenS. M.SmithM.Smith-RayR.OryM.EstabrooksP.GlasgowR. (2018). RE-AIM in clinical, community, and corporate settings: Perspectives, strategies, and recommendations to enhance public health impact. Frontiers in Public Health, 6, 71. https://doi.org/10.3389/fpubh.2018.00071
32.
HardenS. M.SteketeeA.GlasgowT.GlasgowR. E.EstabrooksP. A. (2021). Suggestions for advancing pragmatic solutions for dissemination: Potential updates to evidence-based repositories. American Journal of Health Promotion, 35(2), 289–294. https://doi.org/10.1177/0890117120934619
33.
HelfrichC. D.LiY.-F.SharpN. D.SalesA. E. (2009). Organizational readiness to change assessment (ORCA): Development of an instrument based on the Promoting Action on Research in Health Services (PARIHS) framework. Implementation Science, 4(1), 38. https://doi.org/10.1186/1748-5908-4-38
34.
HiltsK. E.YeagerV. A.GibsonP. J.HalversonP. K.BlackburnJ.MenachemiN. (2021). Hospital partnerships for population health: A systematic review of the literature. Journal of Healthcare Management / American College of Healthcare Executives, 66(3), 170–198. https://doi.org/10.1097/JHM-D-20-00172
35.
HoughtalingB.BalisL.PradhanangaN.CaterM.HolstonD. (2023). Healthy eating and active living policy, systems, and environmental changes in rural Louisiana: A contextual inquiry to inform implementation strategies. International Journal of Behavioral Nutrition and Physical Activity, 20(1), 132. https://doi.org/10.1186/s12966-023-01527-w
36.
KasprzakC. M.LallyA. E.SchoonoverJ. J.GallicchioD.Haynes-MaslowL.VermontL. N.AmmermanA. S.RajaS.Tumiel-BerhalterL.TirabassiJ. N.LeoneL. A. (2022). Operational challenges that may affect implementation of evidence-based mobile market interventions. BMC Public Health, 22(1), 776. https://doi.org/10.1186/s12889-022-13207-8
KononowechJ.HagedornH.HallC.HelfrichC. D.Lambert-KerznerA. C.MillerS. C.SalesA. E.DamschroderL. (2021). Mapping the organizational readiness to change assessment to the Consolidated Framework for Implementation Research. Implementation Science Communications, 2(1), 19. https://doi.org/10.1186/s43058-021-00121-0
39.
KowalskiC. P.NevedalA. L.FinleyE. P.YoungJ. P.LewinskiA. A.MidboeA. M.HamiltonA. B. (2024). Planning for and Assessing Rigor in Rapid Qualitative Analysis (PARRQA): A consensus-based framework for designing, conducting, and reporting. Implementation Science, 19(1), 71. https://doi.org/10.1186/s13012-024-01397-1
40.
LeemanJ.BirkenS. A.PowellB. J.RohwederC.SheaC. M. (2017). Beyond “implementation strategies”: Classifying the full range of strategies used in implementation science and practice. Implementation Science, 12(1), 125. https://doi.org/10.1186/s13012-017-0657-x
41.
LukeD.CalhounA.RobichauxC.ElliotM.Moreland-RussellS. (2014). The program sustainability assessment tool: A new instrument for public health programs. Preventing Chronic Disease, 11, 130184.
42.
MazzuccaS.ArredondoE. M.HoelscherD. M.Haire-JoshuD.TabakR. G.KumanyikaS. K.BrownsonR. C. (2021). Expanding implementation research to prevent chronic diseases in community settings. Annual Review of Public Health, 42(1), 135–158. https://doi.org/10.1146/annurev-publhealth-090419-102547
43.
McNettM.TuckerS.ZadvinskisI.TollesD.ThomasB.GorsuchP.Gallagher-FordL. (2022). A qualitative force field analysis of facilitators and barriers to evidence-based practice in healthcare using an implementation framework. Global Implementation Research and Applications, 2(3), 195–208. https://doi.org/10.1007/s43477-022-00051-6
44.
MiddelC. N. H.Schuitmaker-WarnaarT. J.MackenbachJ. D.BroerseJ. E. W. (2019). Systematic review: A systems innovation perspective on barriers and facilitators for the implementation of healthy food-store interventions. International Journal of Behavioral Nutrition and Physical Activity, 16(1), 108. https://doi.org/10.1186/s12966-019-0867-5
45.
MoullinJ. C.DicksonK. S.StadnickN. A.RabinB.AaronsG. A. (2019). Systematic review of the Exploration, Preparation, Implementation, Sustainment (EPIS) framework. Implementation Science, 14(1), 1. https://doi.org/10.1186/s13012-018-0842-6
46.
MurrielA. L.KahinS.PejavaraA.O’TooleT. (2020). The high obesity program: Overview of the centers for disease control and prevention and cooperative extension services efforts to address obesity. Preventing Chronic Disease, 17, 190235. https://doi.org/10.5888/pcd17.190235
47.
NathanN.PowellB. J.SheltonR. C.LaurC. V.WolfendenL.HailemariamM.YoongS. L.SutherlandR.KingslandM.WaltzT. J.HallA. (2022). Do the Expert Recommendations for Implementing Change (ERIC) strategies adequately address sustainment?Frontiers in Health Services, 2, 905909. https://doi.org/10.3389/frhs.2022.905909
48.
NevedalA. L.ReardonC. M.Opra WiderquistM. A.JacksonG. L.CutronaS. L.WhiteB. S.DamschroderL. J. (2021). Rapid versus traditional qualitative analysis using the Consolidated Framework for Implementation Research (CFIR). Implementation Science, 16(1), 67. https://doi.org/10.1186/s13012-021-01111-5
49.
NewcomerK. E.HatryH. P.WholeyJ. S. (2015). Planning and designing useful evaluations. In NewcomerK. E.HatryH. P.WholeyJ. S. (Eds.), Handbook of practical program evaluation (pp. 7–35). Wiley. https://doi.org/10.1002/9781119171386.ch1
PalinkasL. A.AaronsG. A.HorwitzS.ChamberlainP.HurlburtM.LandsverkJ. (2011). Mixed method designs in implementation research. Administration and Policy in Mental Health and Mental Health Services Research, 38(1), 44–53. https://doi.org/10.1007/s10488-010-0314-z
52.
PowellB. J.WaltzT. J.ChinmanM. J.DamschroderL. J.SmithJ. L.MatthieuM. M.ProctorE. K.KirchnerJ. E. (2015). A refined compilation of implementation strategies: Results from the Expert Recommendations for Implementing Change (ERIC) project. Implementation Science, 10, 21. https://doi.org/10.1186/s13012-015-0209-1
53.
ProctorE. K.BungerA. C.Lengnick-HallR.GerkeD. R.MartinJ. K.PhillipsR. J.SwansonJ. C. (2023). Ten years of implementation outcomes research: A scoping review. Implementation Science, 18(1), 31. https://doi.org/10.1186/s13012-023-01286-z
54.
RabinB.BrownsonR.Haire-JoshuD.KreuterM.WeaverN. (2008). A glossary for dissemination and implementation research in health. Journal of Public Health Management and Practice, 14(2), 117–123. https://doi.org/10.1097/01.PHH.0000311888.06252.bb
55.
ScacciaJ. P.CookB. S.LamontA.WandersmanA.CastellowJ.KatzJ.BeidasR. S. (2015). A practical implementation science heuristic for organizational readiness: R = MC. Journal of Community Psychology, 43(4), 484–501. https://doi.org/10.1002/jcop.21698
56.
StotzS. A.Budd NugentN.RidbergR.Byker ShanksC.HerK.YarochA. L.SeligmanH. (2022). Produce prescription projects: Challenges, solutions, and emerging best practices—Perspectives from health care providers. Preventive Medicine Reports, 29, 101951. https://doi.org/10.1016/j.pmedr.2022.101951
57.
TabakR. G.ReisR. S.WilsonP.BrownsonR. C. (2015). Dissemination of health-related research among scientists in three countries: Access to resources and current practices. BioMed Research International, 2015, e179156. https://doi.org/10.1155/2015/179156
58.
TabakR. G.StamatakisK. A.JacobsJ. A.BrownsonR. C. (2014). What predicts dissemination efforts among public health researchers in the United States?Public Health Reports, 129(4), 361–368. https://doi.org/10.1177/003335491412900411
59.
TaherS.MuramatsuN.Odoms-YoungA.PeacockN.MichaelC. F.CourtneyK. S. (2022). An embedded multiple case study: Using CFIR to map clinical food security screening constructs for the development of primary care practice guidelines. BMC Public Health, 22(1), 97. https://doi.org/10.1186/s12889-021-12407-y
60.
TraplE. S.SmithS.JoshiK.OsborneA.BenkoM.MatosA. T.BolenS. (2018). Dietary impact of produce prescriptions for patients with hypertension. Preventing Chronic Disease, 15, E138. https://doi.org/10.5888/pcd15.180301
U.S. Department of Agriculture. (2019). SNAP-Ed toolkit: Obesity prevention interventions and evaluation framework. https://snapedtoolkit.org/
63.
WolfendenL.ReillyK.KingslandM.GradyA.WilliamsC. M.NathanN.SutherlandR.WiggersJ.JonesJ.HodderR.FinchM.McFadyenT.BaumanA.RisselC.MilatA.SwindleT.YoongS. L. (2019). Identifying opportunities to develop the science of implementation for community-based non-communicable disease prevention: A review of implementation trials. Preventive Medicine, 118, 279–285. https://doi.org/10.1016/j.ypmed.2018.11.014
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
