As generative AI tools become more commonly used in qualitative research, their role in supporting thematic analysis (TA) calls for critical exploration. This study compares the thematic outputs of four AI tools—ChatGPT-4o, QInsights, ATLAS.ti AI, and MAXQDA AI Assist—against a validated human-coded analysis of K–12 STEM teacher data. Using Braun and Clarke’s six-phase TA framework, we examined how each tool’s outputs aligned with, extended, or diverged from human-generated themes. Findings showed partial convergence across tools, no hallucinated content, and substantial time savings. While none fully replicated the depth of human interpretation, all captured relevant insights. This comparison offers a deeper epistemological understanding of AI integration into qualitative inquiry, as well as practical guidance for researchers considering its thoughtful application in qualitative analysis.
AdelA.AlaniN. (2025). Can generative AI reliably synthesise literature? Exploring hallucination issues in ChatGPT. AI & Society, 40, 6799–6812. https://doi.org/10.1007/s00146-025-02406-7
2.
AhmedS. K.MohammedR. A.NashwanA. J.IbrahimR. H.AbdallaA. Q.AmeenB. M. M.KhdhirR. M. (2025). Using thematic analysis in qualitative research. Journal of Medicine, Surgery, and Public Health, 6, 100198. https://doi.org/10.1016/j.glmedi.2025.100198
3.
AlvessonM.SkoldbergK. (2018). Reflexive methodology: New vistas for qualitative research (3rd ed.). Sage.
AyikB.KimS.ZanY.GuD.KimW. L. (n.d.). Supporting multilingual learners in K-12 STEM classrooms through formative assessments: A qualitative descriptive approach [Manuscript under review].
BraunV.ClarkeV. (2019). Reflecting on reflexive thematic analysis, qualitative research in sport. Exercise and Health, 114(4), 589–597. https://doi.org/10.1080/2159676X.2019.1628806
9.
BraunV.ClarkeV. (2021). Thematic analysis: A practical guide. Sage.
10.
BraunV.ClarkeV. (2023). Toward good practice in thematic analysis: Avoiding common problems and be(com)ing a knowing researcher. International Journal of Transgender Health, 24(1), 1–6. https://doi.org/10.1080/26895269.2022.2129597
CostaK.MfoloL. N.NtsobiM. P. (2024). Challenges, benefits and recommendations for using generative artificial intelligence in academic writing–a case of ChatGPT. Medicon Engineering Themes, 7(4), 03–38. https://www.researchgate.net/publication/389735688
13.
CreswellJ. W. (2009). Research design: Qualitative, quantitative, and mixed methods approaches (3rd ed.). Sage.
14.
DeinerM. S.HoncharovV.LiJ.MackeyT. K.PorcoT. C.SarkarU. (2024). Large language models can enable inductive thematic analysis of a social media corpus in a single prompt: Human validation study. JMIR Infodemiology, 4, e59641. https://doi.org/10.2196/59641
15.
De PaoliS. (2024a, September). Further explorations on the use of large language models for thematic analysis. Open-ended prompts, better terminologies and thematic maps. Forum Qualitative Sozialforschung/Forum: Qualitative Social Research, 25(3). https://doi.org/10.17169/fqs-25.3.4196
16.
De PaoliS. (2024b). Performing an inductive thematic analysis of semi-structured interviews with a large language model: An exploration and provocation on the limits of the approach. Social Science Computer Review, 42(4), 997–1019. https://doi.org/10.1177/08944393231220483
17.
FarahaniM.GhasemiG. (2024). Artificial intelligence and inequality: Challenges and opportunities. Qeios. Advance online publication. https://doi.org/10.32388/7HWUZ2
18.
FinlayL. (2002). “Outing” the researcher: The provenance, principles and practice of reflexivity. Qualitative Health Research, 12(4), 531–545. https://doi.org/10.1177/104973202129120052
19.
FrieseS. (2025, April27). Conversational analysis with AI–CA to the power of AI: Rethinking coding in qualitative analysis. SSRN. https://ssrn.com/abstract=5232579
20.
JowseyT.BraunV.ClarkeV.LuptonD.FineM. (2025). We reject the use of generative artificial intelligence for reflexive qualitative research. SSRN. https://doi.org/10.2139/ssrn.5676462
21.
LeeV.LubbeP. S.LayP.GohH.ValderasP. J. (2024). Harnessing ChatGPT for thematic analysis: Are we ready?Journal of Medical Internet Research, 26, e54974. https://doi.org/10.2196/54974
22.
LincolnY. S.GubaE. G. (1985). Naturalistic inquiry. Sage.
23.
MorganD. L. (2023). Exploring the use of artificial intelligence for qualitative data analysis: The case of ChatGPT. International Journal of Qualitative Methods, 22. https://doi.org/10.1177/16094069231211248
24.
Nguyen-TrungK. (2025). ChatGPT in thematic analysis: Can AI become a research assistant in qualitative research?Quality and Quantity, 59, 4945–4978. https://doi.org/10.1007/s11135-025-02165-z
OzuemW.WillisM.RanfagniS.OmeishF. (2025). Thematic analysis in an artificial intelligence-driven context: A stage-by-stage process. International Journal of Qualitative Methods, 24. https://doi.org/10.1177/16094069251362982
29.
PasipamireN.MuroyiwaA. (2024). Navigating algorithm bias in AI: Ensuring fairness and trust in Africa. Frontiers in Research Metrics and Analytics, 9, Article 1486600. https://doi.org/10.3389/frma.2024.1486600
30.
PaulusT.LesterJ. N.DavisC. (2025). The construction of the role of AI in qualitative data analysis in the social sciences. AI & Society. Advance online publication. https://doi.org/10.1007/s00146-025-02488-3
31.
PerkinsM.RoeJ. (2024). The use of generative AI in qualitative analysis: Inductive thematic analysis with ChatGPT. Journal of Applied Learning & Teaching, 7(1), 390–405. https://doi.org/10.37074/jalt.2024.7.1.22
32.
PrescottM. R.YeagerS.HamL.Rivera SaldanaC. D.SerranoV.NarezJ.. . .MontoyaJ. (2024). Comparing the efficacy and efficiency of human and generative AI: Qualitative thematic analyses. JMIR AI, 3, e54482. https://doi.org/10.2196/54482
33.
Qeludra. (n.d.). Meet QInsights: Your AI-powered tool for analysing unstructured data. https://qeludra.com/
ThominetL.AmorimJ.AcostaK.SohanV. K. (2024). Role play: Conversational roles as a framework for reflexive practice in AI-assisted qualitative research. Journal of Technical Writing and Communication, 54(4), 396–418. https://doi.org/10.1177/00472816241260044
XiaoZ.YuanX.LiaoQ. V.AbdelghaniR.OudeyerP.-Y. (2023, March27–31). Supporting qualitative analysis with large language models: Combining codebook with GPT-3 for deductive coding. Proceedings of the 28th International Conference on Intelligent User Interfaces Companion (IUI’23 Companion), New York, NY, USA. ACM. https://doi.org/10.1145/3581754.3584136
ZhangH.WuC.XieJ.LyuY.CaiJ.CarrollJ. M. (2024). Redefining qualitative analysis in the AI era: Utilizing ChatGPT for efficient thematic analysis. arXiv preprint arXiv:2309.10771.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
