Qualitative rapid analysis is one of many rapid research approaches that offer a solution to the problem of time constrained health services evaluations and avoids sacrificing the richness of qualitative data that is needed for intervention design. We describe modifications to an established team-based, rapid analysis approach that we used to rapidly collect and analyze semi-structured interview data for a developmental formative evaluation of a cardiovascular disease prevention intervention. Over 18 weeks, we conducted and analyzed 35 semi-structured interviews that were conducted with patients and health care providers in the Veterans Health Administration to identify targets for adapting the intervention in preparation for a clinical trial. We identified 12 key themes describing actionable targets for intervention modification. We highlight important methodological decisions that allowed us to maintain rigor when using qualitative rapid analysis for intervention adaptation and we provide practical guidance on the resources needed to execute similar qualitative studies. We additionally reflect on the benefits and challenges of the described approach when working within a remote research team environment.
AbrahamT. H.FinleyE. P.DrummondK. L.HaroE. K.HamiltonA. B.TownsendJ. C.LittmanA. J.HudsonT. (2021). A method for developing trustworthiness and preserving richness of qualitative data during team-based analysis of large data sets. American Journal of Evaluation, 42(1), 139–156. https://doi.org/10.1177/1098214019893784
2.
AifahA.RakhraA.StrawbridgeE.SubramaniamS.WilsonS.BosworthH.GierischJ. (2021, December 14–16). Use of a virtual human-centered design approach to adapt a cardiovascular disease prevention intervention among veterans with HIV [Poster]. 14th Annual conference on the science of dissemination and implementation in health, virtual conference, NY, New Yorkhttps://academyhealth.confex.com/academyhealth/2021di/meetingapp.cgi/Paper/49449
3.
AshJ. S.SittigD. F.McMullenC. K.GuapponeK.DykstraR.CarpenterJ. (2008). A rapid assessment process for clinical informatics interventions. AMIA Annual Symposium Proceedings, 2008, 26–30.
4.
AverillJ. B. (2002). Matrix analysis as a complementary analytic strategy in qualitative inquiry. Qualitative Health Research, 12(6), 855–866. https://doi.org/10.1177/104973230201200611
5.
BokhourB. G.BoltonR. E.AschS. M.DvorinK.FixG. M.GiffordA. L.HydeJ. K.McInnesD. K.ParkerV. A.RichardsonK.SkolnikA. A.Vaughan-SarrazinM. S.WuJ.OhlM. E. (2021). How should we organize care for patients with human immunodeficiency virus and comorbidities? A multisite qualitative study of human immunodeficiency virus care in the United States Department of Veterans Affairs. Medical Care, 59(8), 727–735. https://doi.org/10.1097/MLR.0000000000001563
6.
ElwyA. R.WasanA. D.GillmanA. G.JohnstonK. L.DoddsN.McFarlandC.GrecoC. M. (2020). Using formative evaluation methods to improve clinical implementation efforts: Description and an example. Psychiatry Research, 283(165–1781), 1–6. https://doi.org/10.1016/j.psychres.2019.112532
7.
FeinsteinM. J.HsueP. Y.BenjaminL. A.BloomfieldG. S.CurrierJ. S.FreibergM. S.GrinspoonS. K.LevinJ.LongeneckerC. T.PostW. S. (2019). Characteristics, prevention, and management of cardiovascular disease in people living with HIV: A scientific statement from the American Heart Association. Circulation, 140(2), Article. e98–e124. https://doi.org/10.1161/CIR.0000000000000695
FixG. M.AschS. M.SaifuH. N.FletcherM. D.GiffordA. L.BokhourB. G. (2014). Delivering PACT-principled care: Are specialty care patients being left behind?Journal of General Internal Medicine, 29(Suppl 2), S695–S702. https://doi.org/10.1007/s11606-013-2677-9
10.
GaleN. K.HeathG.CameronE.RashidS.RedwoodS. (2013). Using the framework method for the analysis of qualitative data in multi-disciplinary health research. BMC Medical Research Methodology, 13, 117. https://doi.org/10.1186/1471-2288-13-117
11.
GaleR. C.WuJ.ErhardtT.BounthavongM.ReardonC. M.DamschroderL. J.MidboeA. M. (2019). Comparison of rapid vs in-depth qualitative analytic methods from a process evaluation of academic detailing in the Veterans Health Administration. Implementation Science: IS, 14(1), 11. https://doi.org/10.1186/s13012-019-0853-y
12.
GraetzD. E.SnidermanE.VillegasC.RagabI.LaptsevichA.MalitiB.NaiduG.ZhangH.GassantP.NunesL.ArceD.VasquezJ. M.AroraR. S.AlcasabasA. P.RusmawatiningtyasD.RazaM. R.HamidS. A.VelascoP.KambuguJ....MoreiraD. C. (2022). Utilizing multilingual methods and rapid analysis for global qualitative research during a pandemic. Global Qualitative Nursing Research, 9, 1–11. https://doi.org/10.1177/23333936221080969
13.
GreenwoodM.KendrickT.DaviesH.GillF. J. (2017). Hearing voices: Comparing two methods for analysis of focus group data. Applied Nursing Research: ANR, 35(897–1897), 90–93. https://doi.org/10.1016/j.apnr.2017.02.024
HannaD. B.RamaswamyC.KaplanR. C.KizerJ. R.AnastosK.DaskalakisD.ZimmermanR.BraunsteinS. L. (2016). Trends in cardiovascular disease mortality among persons with HIV in New York City, 2001–2012. Clinical Infectious Diseases: An Official Publication of the Infectious Diseases Society of America, 63(8), 1122–1129. https://doi.org/10.1093/cid/ciw470
17.
HannaG. B.BoshierP. R.KnaggsA.GoldinR.SasakoM. (2012). Improving outcomes after gastroesophageal cancer resection: Can Japanese results be reproduced in Western centers?Archives of Surgery, 147(8), 738–745. https://doi.org/10.1001/archsurg.2012.983
18.
KoenigC. J.AbrahamT.ZamoraK. A.HillC.KellyP. A.UddoM.HamiltonM.PyneJ. M.SealK. H. (2016). Pre-implementation strategies to adapt and implement a Veteran peer coaching intervention to improve mental health treatment engagement among rural Veterans. The Journal of Rural Health: Official Journal of the American Rural Health Association and the National Rural Health Care Association, 32(4), 418–428. https://doi.org/10.1111/jrh.12201
19.
LewinskiA. A.CrowleyM. J.MillerC.BosworthH. B.JacksonG. L.SteinhauserK.White-ClarkC.McCantF.ZulligL. L. (2021). Applied rapid qualitative analysis to develop a contextually appropriate intervention and increase the likelihood of uptake. Medical Care, 59(Suppl 3), S242–S251. https://doi.org/10.1097/MLR.0000000000001553
20.
LucianiM.StrachanP. H.ContiA.SchwartzL.KapiririL.OliphantA.NouvetE. (2021). Methodological and practical considerations in rapid qualitative research: Lessons learned from a team-based global study during COVID-19 pandemic. International Journal of Qualitative Methods, 20(1), 1–13. https://doi.org/10.1177/16094069211040302
21.
MadsenH. J.Lambert-KerznerA.MucharskyE.GergenA. K.DyasA. R.McCarterM.StewartC.PratapA.MitchellJ.RandhawaS.MeguidR. A. (2023). Barriers and facilitators in implementation of an esophagectomy care pathway: A qualitative analysis. Journal of Gastrointestinal Surgery: Official Journal of the Society for Surgery of the Alimentary Tract, 27(2), 213–221. https://doi.org/10.1007/s11605-022-05537-0
22.
McNallM.Foster-FishmanP. G. (2007). Methods of rapid evaluation, assessment, and appraisal. American Journal of Evaluation, 28(2), 151–168. https://doi.org/10.1177/1098214007300895
23.
MilfordC.KrielY.NjauI.NkoleT.GichangiP.CorderoJ. P.SmitJ. A.SteynP. S. (2017). Teamwork in qualitative research: Descriptions of a multicountry team approach. International Journal of Qualitative Methods, 16(1), 1–10. https://doi.org/10.1177/1609406917727189
24.
NealJ. W.NealZ. P.VanDykeE.KornbluhM. (2015). Expediting the analysis of qualitative data in evaluation:A procedure for the rapid identification of themes from audio recordings (RITA). American Journal of Evaluation, 36(1), 118–132. https://doi.org/10.1177/1098214014536601
25.
NevedalA. L.ReardonC. M.Opra WiderquistM. A.JacksonG. L.CutronaS. L.WhiteB. S.DamschroderL. J. (2021). Rapid versus traditional qualitative analysis using the consolidated framework for implementation research (CFIR). Implementation Science: IS, 16(1), 67–67. https://doi.org/10.1186/s13012-021-01111-5
26.
OkekeN. L.WebelA. R.BosworthH. B.AifahA.BloomfieldG. S.ChoiE. W.GonzalesS.HaleS.HilemanC. O.Lopez-KidwellV.MuiruriC.OakesM.SchexnayderJ.SmithV.VedanthanR.LongeneckerC. T. (2019). Rationale and design of a nurse-led intervention to extend the HIV treatment cascade for cardiovascular disease prevention trial (EXTRA-CVD). American Heart Journal, 216(2–8703), 91–101. https://doi.org/10.1016/j.ahj.2019.07.005
27.
PalinkasL. A.HorwitzS. M.GreenC. A.WisdomJ. P.DuanN.HoagwoodK. (2015). Purposeful sampling for qualitative data collection and analysis in mixed method implementation research. Administration and Policy in Mental Health, 42(5), 533–544. https://doi.org/10.1007/s10488-013-0528-y
28.
PalinkasL. A.ZatzickD. (2019). Rapid assessment procedure informed clinical ethnography (RAPICE) in pragmatic clinical trials of mental health services implementation: Methods and applied case study. Administration and Policy in Mental Health, 46(2), 255–270. https://doi.org/10.1007/s10488-018-0909-3
29.
PattonM. Q. (1999). Enhancing the quality and credibility of qualitative analysis. Health Services Research, 34(5 Pt 2), 1189–1208.
30.
PetersonK.AndersonJ.BoundyE.FergusonL.McCleeryE.WaldripK. (2018). Mortality disparities in racial/ethnic minority groups in the Veterans Health Administration: An evidence review and map. American Journal of Public Health, 108(3), Article. e1–e11. https://doi.org/10.2105/AJPH.2017.304246
RichardsonK. K.BokhourB.McInnesD. K.YakovchenkoV.OkwaraL.MidboeA. M.SkolnikA.Vaughan-SarrazinM.AschS. M.GiffordA. L.OhlM. E. (2016). Racial disparities in HIV care extend to common comorbidities: Implications for implementation of interventions to reduce disparities in HIV care. Journal of the National Medical Association, 108(4), 201–210. https://doi.org/10.1016/j.jnma.2016.08.001
33.
RushtonS.LewinskiA. A.HwangS.ZulligL. L.Ball RicksK. A.RamosK.GordonA.EarB.BallengeeL. A.BrahmajothiM. V.MooreT.BlalockD. V.WilliamsJ. W.Jr.CantrellS. E.GierischJ. M.GoldsteinK. M. (2023). Barriers and facilitators to the implementation and adoption of improvement coaching: A qualitative evidence synthesis. Journal of Clinical Nursing, 32(1–2), 3–30. https://doi.org/10.1111/jocn.16247
34.
SchosterB.AltpeterM.MeierA.CallahanL. F. (2012). Methodological tips for overcoming formative evaluation challenges: The case of the Arthritis Foundation Walk with Ease Program. Health Promotion Practice, 13(2), 198–203. https://doi.org/10.1177/1524839910384060
35.
ShahA. S. V.StelzleD.LeeK. K.BeckE. J.AlamS.CliffordS.LongeneckerC. T.StrachanF.BagchiS.WhiteleyW.RajagopalanS.KottililS.NairH.NewbyD. E.McAllisterD. A.MillsN. L. (2018). Global burden of atherosclerotic cardiovascular disease in people living with HIV: Systematic review and meta-analysis. Circulation, 138(11), 1100–1112. https://doi.org/10.1161/CIRCULATIONAHA.117.033369
36.
StetlerC. B.LegroM. W.WallaceC. M.BowmanC.GuihanM.HagedornH.KimmelB.SharpN. D.SmithJ. L. (2006). The role of formative evaluation in implementation research and the QUERI experience. Journal of General Internal Medicine, 21(Suppl 2), S1–S8. https://doi.org/10.1111/j.1525-1497.2006.00355.x
37.
TaylorB.HenshallC.KenyonS.LitchfieldI.GreenfieldS. (2018). Can rapid approaches to qualitative analysis deliver timely, valid findings to clinical leaders? A mixed methods study comparing rapid and thematic analysis. BMJ Open, 8(10), 1–13. https://doi.org/10.1136/bmjopen-2017-019993
38.
Vindrola-PadrosC.BrageE.JohnsonG. A. (2021). Rapid, responsive, and relevant?: A systematic review of rapid evaluations in health care. American Journal of Evaluation, 42(1), 1–13. https://doi.org/10.1177/1098214019886914
39.
Vindrola-PadrosC.ChisnallG.CooperS.DowrickA.DjellouliN.SymmonsS. M.MartinS.SingletonG.VanderslottS.VeraN.JohnsonG. A. (2020). Carrying out rapid qualitative research during a pandemic: Emerging lessons from COVID-19. Qualitative Health Research, 30(14), 2192–2204. https://doi.org/10.1177/1049732320951526
40.
Vindrola-PadrosC.JohnsonG. A. (2020). Rapid techniques in qualitative research: A critical review of the literature. Qualitative Health Research, 30(10), 1596–1604. https://doi.org/10.1177/1049732320921835
41.
WanatM.BorekA. J.PilbeamC.AnthierensS.Tonkin-CrineS. (2022). Conducting rapid qualitative interview research during the COVID-19 pandemic—reflections on methodological choices. Frontiers in Sociology, 7, 953872. https://doi.org/10.3389/fsoc.2022.953872
42.
WatkinsD. C. (2017). Rapid and rigorous qualitative data analysis: The “RADaR” technique for applied research. International Journal of Qualitative Methods, 16(1), 160940691771213–160940691771219. https://doi.org/10.1177/1609406917712131
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
