Team-Based Qualitative Rapid Analysis: Approach and Considerations for Conducting Developmental Formative Evaluation for Intervention Design

Abstract

Qualitative rapid analysis is one of many rapid research approaches that offer a solution to the problem of time constrained health services evaluations and avoids sacrificing the richness of qualitative data that is needed for intervention design. We describe modifications to an established team-based, rapid analysis approach that we used to rapidly collect and analyze semi-structured interview data for a developmental formative evaluation of a cardiovascular disease prevention intervention. Over 18 weeks, we conducted and analyzed 35 semi-structured interviews that were conducted with patients and health care providers in the Veterans Health Administration to identify targets for adapting the intervention in preparation for a clinical trial. We identified 12 key themes describing actionable targets for intervention modification. We highlight important methodological decisions that allowed us to maintain rigor when using qualitative rapid analysis for intervention adaptation and we provide practical guidance on the resources needed to execute similar qualitative studies. We additionally reflect on the benefits and challenges of the described approach when working within a remote research team environment.

ClinicalTrials.gov: NCT04545489.

Keywords

formative evaluation qualitative rapid analysis team-based qualitative research intervention adaptation cardiovascular disease prevention

Get full access to this article

View all access options for this article.

References

Abraham

T. H.

Finley

E. P.

Drummond

K. L.

Haro

E. K.

Hamilton

A. B.

Townsend

J. C.

Littman

A. J.

Hudson

(2021). A method for developing trustworthiness and preserving richness of qualitative data during team-based analysis of large data sets. American Journal of Evaluation, 42(1), 139–156. https://doi.org/10.1177/1098214019893784

Aifah

Rakhra

Strawbridge

Subramaniam

Wilson

Bosworth

Gierisch

(2021, December 14–16). Use of a virtual human-centered design approach to adapt a cardiovascular disease prevention intervention among veterans with HIV [Poster]. 14th Annual conference on the science of dissemination and implementation in health, virtual conference, NY, New York https://academyhealth.confex.com/academyhealth/2021di/meetingapp.cgi/Paper/49449

Ash

J. S.

Sittig

D. F.

McMullen

C. K.

Guappone

Dykstra

Carpenter

(2008). A rapid assessment process for clinical informatics interventions. AMIA Annual Symposium Proceedings, 2008, 26–30.

Averill

J. B.

(2002). Matrix analysis as a complementary analytic strategy in qualitative inquiry. Qualitative Health Research, 12(6), 855–866. https://doi.org/10.1177/104973230201200611

Bokhour

B. G.

Bolton

R. E.

Asch

S. M.

Dvorin

Fix

G. M.

Gifford

A. L.

Hyde

J. K.

McInnes

D. K.

Parker

V. A.

Richardson

Skolnik

A. A.

Vaughan-Sarrazin

M. S.

Ohl

M. E.

(2021). How should we organize care for patients with human immunodeficiency virus and comorbidities? A multisite qualitative study of human immunodeficiency virus care in the United States Department of Veterans Affairs. Medical Care, 59(8), 727–735. https://doi.org/10.1097/MLR.0000000000001563

Elwy

A. R.

Wasan

A. D.

Gillman

A. G.

Johnston

K. L.

Dodds

McFarland

Greco

C. M.

(2020). Using formative evaluation methods to improve clinical implementation efforts: Description and an example. Psychiatry Research, 283(165–1781), 1–6. https://doi.org/10.1016/j.psychres.2019.112532

Feinstein

M. J.

Hsue

P. Y.

Benjamin

L. A.

Bloomfield

G. S.

Currier

J. S.

Freiberg

M. S.

Grinspoon

S. K.

Levin

Longenecker

C. T.

Post

W. S.

(2019). Characteristics, prevention, and management of cardiovascular disease in people living with HIV: A scientific statement from the American Heart Association. Circulation, 140(2), Article. e98–e124. https://doi.org/10.1161/CIR.0000000000000695

Fisher

J. D.

Fisher

W. A.

(1992). Changing AIDS-risk behavior. Psychological Bulletin, 111(3), 455–474. https://doi.org/10.1037/0033-2909.111.3.455

Fix

G. M.

Asch

S. M.

Saifu

H. N.

Fletcher

M. D.

Gifford

A. L.

Bokhour

B. G.

(2014). Delivering PACT-principled care: Are specialty care patients being left behind? Journal of General Internal Medicine, 29(Suppl 2), S695–S702. https://doi.org/10.1007/s11606-013-2677-9

10.

Gale

N. K.

Heath

Cameron

Rashid

Redwood

(2013). Using the framework method for the analysis of qualitative data in multi-disciplinary health research. BMC Medical Research Methodology, 13, 117. https://doi.org/10.1186/1471-2288-13-117

11.

Gale

R. C.

Erhardt

Bounthavong

Reardon

C. M.

Damschroder

L. J.

Midboe

A. M.

(2019). Comparison of rapid vs in-depth qualitative analytic methods from a process evaluation of academic detailing in the Veterans Health Administration. Implementation Science: IS, 14(1), 11. https://doi.org/10.1186/s13012-019-0853-y

12.

Graetz

D. E.

Sniderman

Villegas

Ragab

Laptsevich

Maliti

Naidu

Zhang

Gassant

Nunes

Arce

Vasquez

J. M.

Arora

R. S.

Alcasabas

A. P.

Rusmawatiningtyas

Raza

M. R.

Hamid

S. A.

Velasco

Kambugu

... Moreira

D. C.

(2022). Utilizing multilingual methods and rapid analysis for global qualitative research during a pandemic. Global Qualitative Nursing Research, 9, 1–11. https://doi.org/10.1177/23333936221080969

13.

Greenwood

Kendrick

Davies

Gill

F. J.

(2017). Hearing voices: Comparing two methods for analysis of focus group data. Applied Nursing Research: ANR, 35(897–1897), 90–93. https://doi.org/10.1016/j.apnr.2017.02.024

14.

Hamilton

(2013). Qualitative methods in rapid turn-around health services research. VA Health Services Research and Development. https://www.hsrd.research.va.gov/for_researchers/cyber_seminars/archives/video_archive.cfm?SessionID=780

15.

Hamilton

A. B.

(2020). Rapid qualitative analysis: Updates/developments. VA Health Services Research and Development. https://www.hsrd.research.va.gov/for_researchers/cyber_seminars/archives/video_archive.cfm?SessionID=3846

16.

Hanna

D. B.

Ramaswamy

Kaplan

R. C.

Kizer

J. R.

Anastos

Daskalakis

Zimmerman

Braunstein

S. L.

(2016). Trends in cardiovascular disease mortality among persons with HIV in New York City, 2001–2012. Clinical Infectious Diseases: An Official Publication of the Infectious Diseases Society of America, 63(8), 1122–1129. https://doi.org/10.1093/cid/ciw470

17.

Hanna

G. B.

Boshier

P. R.

Knaggs

Goldin

Sasako

(2012). Improving outcomes after gastroesophageal cancer resection: Can Japanese results be reproduced in Western centers? Archives of Surgery, 147(8), 738–745. https://doi.org/10.1001/archsurg.2012.983

18.

Koenig

C. J.

Abraham

Zamora

K. A.

Hill

Kelly

P. A.

Uddo

Hamilton

Pyne

J. M.

Seal

K. H.

(2016). Pre-implementation strategies to adapt and implement a Veteran peer coaching intervention to improve mental health treatment engagement among rural Veterans. The Journal of Rural Health: Official Journal of the American Rural Health Association and the National Rural Health Care Association, 32(4), 418–428. https://doi.org/10.1111/jrh.12201

19.

Lewinski

A. A.

Crowley

M. J.

Miller

Bosworth

H. B.

Jackson

G. L.

Steinhauser

White-Clark

McCant

Zullig

L. L.

(2021). Applied rapid qualitative analysis to develop a contextually appropriate intervention and increase the likelihood of uptake. Medical Care, 59(Suppl 3), S242–S251. https://doi.org/10.1097/MLR.0000000000001553

20.

Luciani

Strachan

P. H.

Conti

Schwartz

Kapiriri

Oliphant

Nouvet

(2021). Methodological and practical considerations in rapid qualitative research: Lessons learned from a team-based global study during COVID-19 pandemic. International Journal of Qualitative Methods, 20(1), 1–13. https://doi.org/10.1177/16094069211040302

21.

Madsen

H. J.

Lambert-Kerzner

Mucharsky

Gergen

A. K.

Dyas

A. R.

McCarter

Stewart

Pratap

Mitchell

Randhawa

Meguid

R. A.

(2023). Barriers and facilitators in implementation of an esophagectomy care pathway: A qualitative analysis. Journal of Gastrointestinal Surgery: Official Journal of the Society for Surgery of the Alimentary Tract, 27(2), 213–221. https://doi.org/10.1007/s11605-022-05537-0

22.

McNall

Foster-Fishman

P. G.

(2007). Methods of rapid evaluation, assessment, and appraisal. American Journal of Evaluation, 28(2), 151–168. https://doi.org/10.1177/1098214007300895

23.

Milford

Kriel

Njau

Nkole

Gichangi

Cordero

J. P.

Smit

J. A.

Steyn

P. S.

(2017). Teamwork in qualitative research: Descriptions of a multicountry team approach. International Journal of Qualitative Methods, 16(1), 1–10. https://doi.org/10.1177/1609406917727189

24.

Neal

J. W.

Neal

Z. P.

VanDyke

Kornbluh

(2015). Expediting the analysis of qualitative data in evaluation:A procedure for the rapid identification of themes from audio recordings (RITA). American Journal of Evaluation, 36(1), 118–132. https://doi.org/10.1177/1098214014536601

25.

Nevedal

A. L.

Reardon

C. M.

Opra Widerquist

M. A.

Jackson

G. L.

Cutrona

S. L.

White

B. S.

Damschroder

L. J.

(2021). Rapid versus traditional qualitative analysis using the consolidated framework for implementation research (CFIR). Implementation Science: IS, 16(1), 67–67. https://doi.org/10.1186/s13012-021-01111-5

26.

Okeke

N. L.

Webel

A. R.

Bosworth

H. B.

Aifah

Bloomfield

G. S.

Choi

E. W.

Gonzales

Hale

Hileman

C. O.

Lopez-Kidwell

Muiruri

Oakes

Schexnayder

Smith

Vedanthan

Longenecker

C. T.

(2019). Rationale and design of a nurse-led intervention to extend the HIV treatment cascade for cardiovascular disease prevention trial (EXTRA-CVD). American Heart Journal, 216(2–8703), 91–101. https://doi.org/10.1016/j.ahj.2019.07.005

27.

Palinkas

L. A.

Horwitz

S. M.

Green

C. A.

Wisdom

J. P.

Duan

Hoagwood

(2015). Purposeful sampling for qualitative data collection and analysis in mixed method implementation research. Administration and Policy in Mental Health, 42(5), 533–544. https://doi.org/10.1007/s10488-013-0528-y

28.

Palinkas

L. A.

Zatzick

(2019). Rapid assessment procedure informed clinical ethnography (RAPICE) in pragmatic clinical trials of mental health services implementation: Methods and applied case study. Administration and Policy in Mental Health, 46(2), 255–270. https://doi.org/10.1007/s10488-018-0909-3

29.

Patton

M. Q.

(1999). Enhancing the quality and credibility of qualitative analysis. Health Services Research, 34(5 Pt 2), 1189–1208.

30.

Peterson

Anderson

Boundy

Ferguson

McCleery

Waldrip

(2018). Mortality disparities in racial/ethnic minority groups in the Veterans Health Administration: An evidence review and map. American Journal of Public Health, 108(3), Article. e1–e11. https://doi.org/10.2105/AJPH.2017.304246

31.

QUALRIS Group (2018). Qualitative methods in implementation science. National Cancer Institute, Division of Cancer Control and Population Sciences. https://cancercontrol.cancer.gov/IS/docs/NCI-DCCPS-ImplementationScience-WhitePaper.pdf

32.

Richardson

K. K.

Bokhour

McInnes

D. K.

Yakovchenko

Okwara

Midboe

A. M.

Skolnik

Vaughan-Sarrazin

Asch

S. M.

Gifford

A. L.

Ohl

M. E.

(2016). Racial disparities in HIV care extend to common comorbidities: Implications for implementation of interventions to reduce disparities in HIV care. Journal of the National Medical Association, 108(4), 201–210. https://doi.org/10.1016/j.jnma.2016.08.001

33.

Rushton

Lewinski

A. A.

Hwang

Zullig

L. L.

Ball Ricks

K. A.

Ramos

Gordon

Ear

Ballengee

L. A.

Brahmajothi

M. V.

Moore

Blalock

D. V.

Williams

J. W.

Jr. Cantrell

S. E.

Gierisch

J. M.

Goldstein

K. M.

(2023). Barriers and facilitators to the implementation and adoption of improvement coaching: A qualitative evidence synthesis. Journal of Clinical Nursing, 32(1–2), 3–30. https://doi.org/10.1111/jocn.16247

34.

Schoster

Altpeter

Meier

Callahan

L. F.

(2012). Methodological tips for overcoming formative evaluation challenges: The case of the Arthritis Foundation Walk with Ease Program. Health Promotion Practice, 13(2), 198–203. https://doi.org/10.1177/1524839910384060

35.

Shah

A. S. V.

Stelzle

Lee

K. K.

Beck

E. J.

Alam

Clifford

Longenecker

C. T.

Strachan

Bagchi

Whiteley

Rajagopalan

Kottilil

Nair

Newby

D. E.

McAllister

D. A.

Mills

N. L.

(2018). Global burden of atherosclerotic cardiovascular disease in people living with HIV: Systematic review and meta-analysis. Circulation, 138(11), 1100–1112. https://doi.org/10.1161/CIRCULATIONAHA.117.033369

36.

Stetler

C. B.

Legro

M. W.

Wallace

C. M.

Bowman

Guihan

Hagedorn

Kimmel

Sharp

N. D.

Smith

J. L.

(2006). The role of formative evaluation in implementation research and the QUERI experience. Journal of General Internal Medicine, 21(Suppl 2), S1–S8. https://doi.org/10.1111/j.1525-1497.2006.00355.x

37.

Taylor

Henshall

Kenyon

Litchfield

Greenfield

(2018). Can rapid approaches to qualitative analysis deliver timely, valid findings to clinical leaders? A mixed methods study comparing rapid and thematic analysis. BMJ Open, 8(10), 1–13. https://doi.org/10.1136/bmjopen-2017-019993

38.

Vindrola-Padros

Brage

Johnson

G. A.

(2021). Rapid, responsive, and relevant?: A systematic review of rapid evaluations in health care. American Journal of Evaluation, 42(1), 1–13. https://doi.org/10.1177/1098214019886914

39.

Vindrola-Padros

Chisnall

Cooper

Dowrick

Djellouli

Symmons

S. M.

Martin

Singleton

Vanderslott

Vera

Johnson

G. A.

(2020). Carrying out rapid qualitative research during a pandemic: Emerging lessons from COVID-19. Qualitative Health Research, 30(14), 2192–2204. https://doi.org/10.1177/1049732320951526

40.

Vindrola-Padros

Johnson

G. A.

(2020). Rapid techniques in qualitative research: A critical review of the literature. Qualitative Health Research, 30(10), 1596–1604. https://doi.org/10.1177/1049732320921835

41.

Wanat

Borek

A. J.

Pilbeam

Anthierens

Tonkin-Crine

(2022). Conducting rapid qualitative interview research during the COVID-19 pandemic—reflections on methodological choices. Frontiers in Sociology, 7, 953872. https://doi.org/10.3389/fsoc.2022.953872

42.

Watkins

D. C.

(2017). Rapid and rigorous qualitative data analysis: The “RADaR” technique for applied research. International Journal of Qualitative Methods, 16(1), 160940691771213–160940691771219. https://doi.org/10.1177/1609406917712131

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.35 MB