As part of a 5-year study to develop and validate an instrument for measuring success in long-standing community-based participatory research (CBPR) partnerships, we utilized the Delphi method with a panel of 16 community and academic CBPR experts to assess face and content validity of the instrument’s broad concepts of success and measurement items. In addition to incorporating quantitative and qualitative feedback from two online surveys, we included a 2-day face-to-face meeting with the Expert Panel to invite open discussion and diversity of opinion in line with the CBPR principles framing and guiding the study. The face-to-face meeting allowed experts to review the survey data (with maintained anonymity), convey their perspectives, and offer interpretations that were untapped in the online surveys. Using a CBPR approach facilitated a synergistic process that moved above and beyond the consensus achieved in the initial Delphi rounds, to enhance the Delphi technique and the development of items in the instrument.
BleijlevensM. H.WagnerL. M.CapezutiE. A.HamersJ. P. (2016). Physical restraints: Consensus of a research definition using a modified Delphi technique. Journal of the American Geriatrics Society, 64(11), 2307–2310. https://doi.org/10.1111/jgs.14435
2.
BolgerF.StranieriA.WrightG.YearwoodJ. (2011). Does the Delphi process lead to increased accuracy in group-based judgmental forecasts or does it simply induce consensus amongst judgmental forecasters?Technological Forecasting and Social Change, 78(9), 1671–1680. https://doi.org/10.1016/j.techfore.2011.06.002
3.
BoulkedidR.AbdoulH.LoustaM.SibonyO.AlbertiC. (2011). Using and reporting the Delphi method for selecting healthcare quality indicators: A systematic review. PLOS ONE, 6(6), Article e20476. https://doi.org/10.1371/journal.pone.0020476
4.
BrushB. L.MentzG.JensenM.JacobsB.SaylorK.IsraelB. A.RoweZ.LachanceL. (2020). Success in long-standing community-based participatory research (CBPR) partnerships: A scoping literature review. Health Education and Behavior, 47(3), 556–568. https://doi.org/10.1177/109019811988298971
5.
CoombeC. M.ChandanabhummaP.BhardwajP.BrushB. L.Greene-MotonE.JensenM.LachanceL.LeeD. S. Y.MeisenheimerM.MinklerM.MuhammadM.ReyesA. G.RoweZ.Wilson-PowersE.IsraelB. A. (2020). A participatory mixed methods approach to define and measure partnership synergy in longstanding equity focused CBPR partnerships. American Journal of Community Psychology, 66(3–4), 427–438. https://doi.org/10.1002/ajcp.12447
6.
DalkeyN.HelmerO. (1963). An experimental application of the Delphi method to the use of experts. Management Science, 9(3), 458–467. https://doi.org/10.1287/mnsc.9.3.458
7.
DariT.LauxJ. M.LiuY.ReynoldsJ. (2019). Development of community-based participatory research competencies: A Delphi study identifying best practices in the collaborative process. The Professional Counselor, 9(1), 1–19. https://doi.org/10.15241/td.9.1.1
8.
DelbecqA. L.Van de VenA. H.GustafsonD. H. (1975). Group techniques for program planning. Scott, Foreman and Co.
9.
DiamondI. R.GrantR. C.FeldmanB. M.PencharzP. B.LingS. C.MooreA. M.WalesP. W. (2014). Defining consensus: A systematic review recommends methodologic criteria for reporting of Delphi studies. Journal of Clinical Epidemiology, 67(4), 401–409. https://doi.org/10.1016/j.jclinepi.2013.12.002
10.
EscaronA. L.WeirR. C.StantonP.VangalaS.GroganT. R.ClarkeR. M. (2016). Testing an adapted modified Delphi method: Synthesizing multiple stakeholder ratings of health care service effectiveness. Health Education in Health Care, 17(2), 217–225. https://doi.org/10.1177/1524839915614308
11.
FarrellB.TsangC.Raman-WilmsL.IrvingH.ConklinJ.PottieK. (2015). What are priorities for deprescribing for elderly patients? Capturing the voice of practitioners: A modified Delphi process. PLOS ONE, 10(4), Article e0122246. https://doi.org/10.1371/journal.pone.0122246
12.
HohmannE.CoteM. P.BrandJ. C. (2018). Research pearls: Expert consensus-based evidence using the Delphi method. Arthroscopy, 34(12), 3278–3282. https://doi.org/10.1016/j.arthro.2018.10.004
13.
HsuC.SandfordB. A. (2007). The Delphi technique: Making sense of consensus. Practical Assessment, Research, and Evaluation, 12(10), 1–8. https://doi.org/10.7275/pdz9-th90
14.
IsraelB. A.EngE.SchulzA. J.ParkerE. A. (2013). Introduction to methods for community-based participatory research for health. In IsraelB. A.EngE.SchulzA. J.ParkerE. A. (Eds.), Methods in community-based participatory research for health (2nd ed., pp. 3–37). Jossey-Bass.
15.
IsraelB. A.LachanceL.CoombeC. M.LeeS. Y. D.JensenM.Wilson-PowersE.MentzG.MuhammadM.RoweZ.ReyesA. G.BrushB. L. (2020). Measurement approaches to partnership success: Theory and methods for measuring success in long-standing CBPR partnerships. Progress in Community Health Partnerships, 14(1), 129–140. http://doi.org/10.1353/cpr.2020.0015
16.
IsraelB. A.LichtensteinR.LantzP.McGranaghanR.AllenA.GuzmanJ. R.SoftleyD.MaciakB. (2001). The Detroit community-academic urban research center: Development, implementation, and evaluation. Journal of Public Health Management and Practice, 7(5), 1–19. https://doi.org/10.1097/00124784-200107050-00003
17.
IsraelB. A.SchulzA.CoombeC.ParkerE. A.ReyesA. G.RoweZ.LichtensteinR. (2019). Community based participatory research: An approach to research in the urban context. In GaleaS.EttmanC.VlahovD. (Eds.), Urban health (pp. 272–282). Oxford University Press.
18.
IsraelB. A.SchulzA. J.ParkerE. A.BeckerA. B. (1998). Review of community-based research: Assessing partnership approaches to improve public health. Annual Review of Public Health, 19, 173–202. https://doi.org/10.1146/annurev.publhealth.19.1.173
19.
IsraelB. A.SchulzA. J.ParkerE. A.BeckerA. B.AllenA. J.IIIGuzmanR.LichtensteinR. (2018). Critical issues in developing and following CBPR principles. In WallersteinN.DuranB.OetzelJ.MinklerM. (Eds.), Community-based participatory research for health: Advancing social and health equity (pp. 31–34). Wiley.
20.
LinstoneH. A.TuroffM. (1975). The Delphi method: Techniques and applications. Addison-Wesley.
OkoliC.PawlowskiS. D. (2004). The Delphi method as a research tool: An example, design considerations and applications. Information and Management, 42, 15–19. https://doi.org/10.1016/j.im.2003.11.002
RideoutC.GilR.BrowneR.CalhoonC.ReyM.GourevitchM.Trinh-ShevrinC. (2013). Using the Delphi and Snow Card techniques to build consensus among diverse community and academic stakeholders. Progress in Community Health Partnerships, 7(3), 331–339. https://doi.org/10.1353/cpr.2013.0033
25.
SutoM. J.LapsleyS.BalramA.BarnesS. J.HouS.RagazanD. C.AustinJ.ScottM.BerkL.MichalakE. E. (2019). Integrating Delphi consensus consultation and community-based participatory research. Engaged Scholar Journal, 5(1), 21–35. https://doi.org/10.15402/esj.v5i1.67847
26.
WallersteinN.DuranB. (2018). Theoretical, historical, and practice roots of community based participatory research. In WallersteinN.DuranB.OetzelJ.MinklerM. (Eds.), Community-based participatory research for health (3rd ed., pp. 17–29). Jossey-Bass.
