Limited information exists on evaluating Extension team dynamics to determine activities that positively or negatively impact team outcomes. We sought to identify a new evaluation pathway for Extension teams and reviewed the health field's process evaluation frameworks for potential use in social sciences. We began by updating current process evaluation frameworks in the literature so they could be applied to social sciences and Extension contexts. We then developed a new framework and tested its relevance by implementing a process evaluation for a recent Extension project team. We analyzed the team's backwards plan and project notes and conducted semi-structured interviews with ten project participants. We found that the newly developed process evaluation provides valuable information on team dynamics and activities, but that the most efficient measurement source depends on the specific core component or moderating factor being evaluated.
BooneE. J.DolanR. J.ShearonR. W. (1971). Programming in the cooperative extension service: A conceptual schema. North Carolina Agricultural Extension Service.
4.
CarrollC.PattersonM.WoodS.BoothA.RickJ.BalainS. (2007). A conceptual framework for implementation fidelity. Implementation Science, 2, Article 40. https://doi.org/10.1186/1748-5908-2-40
5.
ChengK. K. F.MetcalfeA. (2018). Qualitative methods and process evaluation in clinical trials context: Where to head to?International Journal of Qualitative Methods, 17(1), 1–4. https://doi.org/10.1177/1609406918774212
DietrichT.Rundle-ThieleS.KubackiK.DurlJ.GulloM. J.ArliD.ConnorJ. P. (2019). Virtual reality in social marketing: A process evaluation. Marketing Intelligence & Planning, 37(7), 806–820. https://doi.org/10.1108/MIP-11-2018-0537
8.
DobsonD.CookT. (1980). Avoiding type III error in program evaluation: Results from a field experiment. Evaluation and Program Planning, 3(4), 269–276. https://doi.org/10.1016/0149-7189(80)90042-7
9.
DowneyL. H.TerpK.ByrdS. H. (2021). A process evaluation of the HappyHealthy social marketing campaign. Journal of Human Sciences and Extension, 9(2), Article 9. https://doi.org/10.54718/PEJN1237
10.
DuerdenM. D.WittP. A. (2012). Assessing program implementation: What it is, why it's important, and how to do it. The Journal of Extension, 50(1), Article 5. https://doi.org/10.34068/joe.50.01.05
DurlakJ. A.DuPreE. P. (2008). Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology, 41(3-4), 327–350. https://doi.org/10.1007/s10464-008-9165-0
13.
FranzN. K.TownsonL. (2008). The nature of complex organizations: The case of Cooperative Extension. New Directions for Evaluation, 2008(120), 5–14. https://doi.org/10.1002/ev.272
14.
GouldF. I.SteeleD.WoodrumW. J. (2014). Cooperative extension: A century of innovation. The Journal of Extension, 52(1), 3. https://doi.org/10.34068/joe.52.01.03
15.
HassonH. (2010). Systematic evaluation of implementation fidelity of complex interventions in health and social care. Implementation Science, 5(1), 1–9. https://doi.org/10.1186/1748-5908-5-67
16.
HassonH.BlombergS.DunérA. (2012). Fidelity and moderating factors in complex interventions: A case study of a continuum of care program for frail elderly people in health and social care. Implementation Science, 7, Article 23. https://doi.org/10.1186/1748-5908-7-23
17.
HetheringtonC.EschbachC.CuthbertsonC. (2019). How evaluation capacity building grows credible and actionable evidence for cooperative extension programs. Journal of Human Sciences and Extension, 7(2), 10. https://doi.org/10.54718/GLDP7457
18.
HulscherM. E. J. L.LaurantM. G. H.GrolR. P. T. M. (2003). Process evaluation on quality improvement interventions. BMJ Quality & Safety, 12(1), 40–46. https://doi.org/10.1136/qhc.12.1.40
19.
KelderS. H.HoelscherD.PerryC. L. (2015). How individuals, environments, and health behaviors interact. Health Behavior: Theory, Research, and Practice, 159, 144–149.
20.
LammA. J.IsraelG. D. (2013). A national examination of extension professionals’ use of evaluation: Does intended use improve effort?Journal of Human Sciences and Extension, 1(1), 4. https://doi.org/10.54718/UCLB3696
21.
LewisC.BoydM.Walsh-BaileyC.LyonA. R.BeidasR.MittmanB., Aarons, G. A., Weiner, B. J., & Chambers, D. A. (2020). A systematic review of empirical studies examining mechanisms of implementation in health. Implementation Science, 15(1), 21. https://doi.org/10.1186/s13012-020-00983-3
22.
McGrawS. A.StoneE. J.OsganianS. K.ElderJ. P.PerryC. L.JohnsonC. C.ParcelG. S.WebberL. S.LuepkerR. V. (1994). Design of process evaluation within the child and adolescent trial for cardiovascular health (CATCH). Health Education Quarterly, 21(Suppl. 2), S5–S26. https://doi.org/10.1177/10901981940210s103
23.
Moore, G. F., Audrey, S., Barker, M., Bond, L., Bonell, C., Hardeman, W., Moore, L., O'Cathain, A., Tinati, T., Wright, D., & Baird, J. (2015). Process evaluation of complex interventions: Medical Research Council guidance. BMJ, 350, h1258. https://doi.org/10.1136/bmj.h1258
24.
NicholsA.BlakeS. M.ChazdonS.RadhakrishnaR. (2015). From farm results demonstrations to multistate impact designs: Cooperative extension navigates its way through evaluation pathways. Journal of Human Sciences and Extension, 3(2), 7. https://doi.org/10.54718/DNHS3672
25.
OakleyA. A. (2025). “Politics is more difficult than physics”: Complexity and challenge of democracy, human rights, and governance program evaluation. New Directions for Evaluation, 2025(176), 15–32, Article e20531. https://doi.org/10.1002/ev.20531
26.
PirieP. L.StoneE. J.AssafA. R.FloraJ. A.Maschewsky-SchneiderU. (1994). Program evaluation strategies for community-based health promotion programs: Perspectives from the cardiovascular disease community research and demonstration studies. Health Education Research, 19(1), 23–36. https://doi.org/10.1093/her/9.1.23
27.
RennekampR. A.EngleM. (2008). A case study in organizational change: Evaluation in cooperative extension. In BravermanM. T.EngleM.ArnoldM. E.RennekampR. A. (Eds.), Program evaluation in a complex organizational system: Lessons from Cooperative Extension (pp. 15–26). New Directions for Evaluation, 2008(120). Jossey-Bass. https://doi.org/10.1002/ev.273
28.
SaundersR. P.EvansM. H.JoshiP. (2005). Developing a process-evaluation plan for assessing health promotion program implementation: A how-to guide. Health Promotion Practice, 6(2), 134–147. https://doi.org/10.1177/1524839904273387
29.
SeeversB.GrahamD. (2012). Education through cooperative extension (3rd ed.). University of Arkansas.
30.
SeeversB.GrahamD.ConklinN. (2007). Education through cooperative extension (2nd ed.). The Ohio State University Curriculum Materials Service.
31.
StecklerA.LinnanL. (Eds) (2002). Process evaluation for public health interventions and research. Jossey-Bass/Wiley.
