Comparing Rapid Qualitative Analysis With Thematic Analysis in a School-Based Mental Health Outcome Evaluation

Abstract

Rapid qualitative methodology has gained popularity among education evaluators, given increasing pressure to develop and disseminate actionable recommendations. To better understand its relative utility, our study compared rapid qualitative analysis versus thematic analysis, assessing time spent and themes derived. The comparison was conducted within the context of a mixed-method evaluation of a clinical training program for school-based mental health clinicians (N = 22). As part of the evaluation, clinicians participated in semi-structured interviews exploring their experience with training and implementation in schools. Interview data were analyzed twice, comparing rapid qualitative analysis with thematic analysis guided by the Consolidated Framework for Implementation Research. Our results showed that rapid qualitative analysis was 2.1 times faster than thematic analysis (54 hours vs. 114 hours), and there was an 85.7% overlap in themes. These findings demonstrate the potential utility of rapid qualitative analysis, which can be used to guide the dissemination and implementation of evidence-based practices.

Keywords

rapid qualitative analysis thematic analysis consolidated framework for implementation research educational evaluation trauma-focused cognitive behavioral therapy

Get full access to this article

View all access options for this article.

References

Adjei-Boateng

(2021). Qualitative evaluation for school improvement: An option for school leaders. The International Journal of Educational Researchers, 12(2), 1–10. https://ijer.inased.org/files/4/manuscript/manuscript_2256/ijers-2256-manuscript-183351.pdf

Beebe

(2014). Rapid qualitative inquiry: A field guide to team-based assessment (2nd ed). Lanham, MD: Rowman & Littlefield.

Boyatzis

R. E.

(1998). Transforming qualitative information: Thematic analysis and code development. Thousand Oaks, CA: Sage Publications Inc.

Brown-Johnson

Safaeinili

Zionts

Holdsworth

Shaw

Asch

Winget

(2019). The Stanford lightning report method: A comparison of rapid qualitative synthesis results across four implementation evaluations. Learning Health Systems, 4(2), e10210. https://doi.org/10.1002/lrh2.10210

Cohen

J. A.

Deblinger

Mannarino

A. P.

Steer

R. A.

(2004). A multisite, randomized controlled trial for children with sexual abuse-related PTSD symptoms. Journal of the American Academy of Child & Adolescent Psychiatry, 43(4), 393–402. https://doi.org/10.1097/00004583-200404000-00005

Cohen

J. A.

Mannarino

A. P.

Deblinger

(2012). Trauma-focused CBT for children and adolescents: Treatment applications. New York, NY: Guilford Press.

Coleman

M. L.

Ragan

Dari

(2024). Intercoder reliability for use in qualitative research and evaluation. Measurement and Evaluation in Counseling and Development, 57(2), 136–146. https://doi.org/10.1080/07481756.2024.2303715

Consolidated Framework for Implementation Research (CFIR) Research Team. (2025a). Consolidated Framework for Implementation Research. https://cfirguide.org/

Consolidated Framework for Implementation Research (CFIR) Research Team. (2025b). Qualitative Data. https://cfirguide.org/evaluation-design/qualitative-data/

10.

Damschroder

L. J.

Aron

D. C.

Keith

R. E.

Kirsh

S. R.

Alexander

J. A.

Lowery

J. C.

(2009). Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implementation Science, 4(1), 50. https://doi.org/10.1186/1748-5908-4-50

11.

Eaton

Stritzke

Ohan

(2019). Using scribes in qualitative research as an alternative to transcription. The Qualitative Report, 24(3), 586–605. https://doi.org/10.46743/2160-3715/2019.3473

12.

Feng

G. C.

(2015). Mistakes and how to avoid mistakes in using intercoder reliability indices. Methodology, 11(1), 13–22. https://doi.org/10.1027/1614-2241/a000086

13.

Gale

R. C.

Erhardt

Bounthavong

Reardon

C. M.

Damschroder

L. J.

Midboe

(2019). Comparison of rapid vs in-depth qualitative analytic methods from a process evaluation of academic detailing in the Veterans Health Administration. Implementation Science, 14(1), 11. https://doi.org/10.1186/s13012-019-0853-y

14.

Guest

MacQueen

K. M.

Namey

E. E.

(2012). Applied thematic analysis. Thousand Oaks, CA: Sage Publications. https://doi.org/10.4135/9781483384436

15.

Hamilton

A. B.

(2013). Qualitative methods in rapid turn-around health services research. https://www.hsrd.research.va.gov/for_researchers/cyber_seminars/archives/video_archive.cfm?SessionID=780

16.

Hamilton

A. B.

Finley

E. P.

(2019). Qualitative methods in implementation research: An introduction. Psychiatry Research, 280, 112516. https://doi.org/10.1016/j.psychres.2019.112516

17.

Hemmler

V. L.

Kenney

A. W.

Langley

S. D.

Callahan

C. M.

Gubbins

E. J.

Holder

(2022). Beyond a coefficient: An interactive process for achieving inter-rater consistency in qualitative coding. Qualitative Research, 22(2), 194–219. https://doi.org/10.1177/1468794120976072

18.

Holdsworth

L. M.

Safaeinili

Winget

Lorenz

K. A.

Lough

Asch

Malcolm

(2020). Adapting rapid assessment procedures for implementation research using a team-based approach to analysis: A case example of patient quality and safety interventions in the ICU. Implementation Science, 15(1), 12. https://doi.org/10.1186/s13012-020-0972-5

19.

Lewinski

A. A.

Crowley

M. J.

Miller

Bosworth

H. B.

Jackson

G. L.

Steinhauser

Zullig

L. L.

(2021). Applied rapid qualitative analysis to develop a contextually appropriate intervention and increase the likelihood of uptake. Medical Care, 59(Suppl 3), S242–S251. https://doi.org/10.1097/MLR.0000000000001553

20.

Murray

L. K.

Dorsey

Skavenski

Kasoma

Imasiku

Bolton

Cohen

J. A.

(2013). Identification, modification, and implementation of an evidence-based psychotherapy for children in a low-income country: The use of TF-CBT in Zambia. International Journal of Mental Health Systems, 7(1), 24. https://doi.org/10.1186/1752-4458-7-24

21.

Neal

VanDyke

Kornbluh

(2015). Expediting the analysis of qualitative data in evaluation: A procedure for the rapid identification of themes from audio recordings (RITA). American Journal of Evaluation, 36(1), 118–132. https://doi.org/10.1177/1098214014536601

22.

Nevedal

A. L.

Reardon

C. M.

Opra Widerquist

M. A.

Jackson

G. L.

Cutrona

S. L.

White

B. S.

Damschroder

L. J.

(2021). Rapid versus traditional qualitative analysis using the Consolidated Framework for Implementation Research (CFIR). Implementation Science, 16(1), 67. https://doi.org/10.1186/s13012-021-01111-5

23.

Ramirez de Arellano

M. A.

Lyman

D. R.

Jobe-Shields

George

Dougherty

R. H.

Daniels

A. S.

Delphin-Rittmon

M. E.

(2014). Trauma-focused cognitive-behavioral therapy for children and adolescents: Assessing the evidence. Psychiatric Services (Washington, D.C.), 65(5), 591–602. https://doi.org/10.1176/appi.ps.20130025

24.

Taylor

Henshall

Kenyon

Litchfield

Greenfield

(2018). Can rapid approaches to qualitative analysis deliver timely, valid findings to clinical leaders? A mixed methods study comparing rapid and thematic analysis. BMJ Open, 8(10), e019993. https://doi.org/10.1136/. bmjopen-2017-019993

25.

Vindrola-Padros

Johnson

G. A.

(2020). Rapid techniques in qualitative research: A critical review of the literature. Qualitative Health Research, 30(10), 1596–1604. https://doi.org/10.1177/1049732320921835

26.

Watkins

D. C.

(2017). Rapid and rigorous qualitative data analysis: The “RADaR” technique for applied research. International Journal of Qualitative Methods, 16(1), 1–9. https://doi.org/10.1177/1609406917712131