Using Topic Modeling in Gifted Education Research: Drawing Insights From Open-Ended Survey Responses

Abstract

Despite the rich insights they offer, open-ended survey responses remain underutilized in educational research, often due to a lack of awareness of emergent methods that can efficiently analyze such data. This methodological brief addresses this gap by introducing the topic modeling technique, particularly the latent Dirichlet allocation, as a tool for analyzing open-ended responses and facilitating the investigation of relationships between textual responses and measurable outcomes. This brief outlines the rationale behind topic modeling and details the implementation process through the analysis of open-ended responses on students’ career interests as an example. In addition, we discuss the advantages and limitations of this technique and provide practical considerations for its application in educational research.

Keywords

career interest gifted education open-ended response survey research topic modeling

Get full access to this article

View all access options for this article.

References

Arun

Suresh

Madhavan

C. E. V.

Murthy

M. N. N.

(2010). On finding the natural number of topics with latent Dirichlet allocation: Some observations. Lecture Notes in Computer Science, 6118(1), 391–402. https://doi.org/10.1007/978-3-642-13657-3_43

Baccassino

Pinnelli

(2023). Giftedness and gifted education: A systematic literature review. Frontiers in Education, 7, Article 1073007. https://doi.org/10.3389/feduc.2022.1073007

Barde

B. V.

Bainwad

A. M.

(2017, June 15–16). An overview of topic modeling methods and tools [Conference session]. 2017 International Conference on Intelligent Computing and Control Systems (ICICCS), Madurai, India. https://doi.org/10.1109/iccons.2017.8250563

Blei

D. M.

(2012). Probabilistic topic models. Communications of the ACM, 55(4), 77–84. https://doi.org/10.1145/2133806.2133826

Blei

D. M.

A. Y.

Jordan

M. I.

(2003). Latent Dirichlet allocation. Journal of Machine Learning Research, 3, 993–1022. https://doi.org/10.5555/944919.944937

Boyd-Graber

Mimno

(2017). Applications of topic models. Foundations and Trends in Information Retrieval, 11(2–3), 143–296. https://doi.org/10.1561/1500000030

Brown

T. A.

(2015). Confirmatory factor analysis for applied research. Guilford Press. https://psycnet.apa.org/record/2015-10560-000

Buenaño-Fernández

González

Gil

Luján-Mora

(2020). Text mining of open-ended questions in self-assessment of university teachers: An LDA topic modeling approach. IEEE Access, 8, 35318–35330. https://doi.org/10.1109/access.2020.2974983

Canché

M. S. G.

(2023). Machine driven classification of open-ended responses (MDCOR): An analytic framework and no-code, free software application to classify longitudinal and cross-sectional text responses in survey and social media research. Expert Systems with Applications, 215, Article 119265. https://doi.org/10.1016/j.eswa.2022.119265

10.

Cao

Xia

Zhang

Tang

(2009). A density-based method for adaptive LDA model selection. Neurocomputing, 72(7–9), 1775–1781. https://doi.org/10.1016/j.neucom.2008.06.011

11.

Chang

DeJonckheere

Vydiswaran

V. G. V.

Buis

L. R.

Guetterman

T. C.

(2021). Accelerating mixed methods research with natural language processing of big text data. Journal of Mixed Methods Research, 15(3), 398–412. https://doi.org/10.1177/15586898211021196

12.

Chen

Zou

Cheng

Xie

(2020). Detecting latent topics and trends in educational technologies over four decades using structural topic modeling: A retrospective of all volumes of Computers & Education. Computers and Education/computers & Education, 151, Article 103855. https://doi.org/10.1016/j.compedu.2020.103855

13.

Chung

Rodriguez

Lanier

Gibbs

(2022). Text-Mining Open-Ended Survey responses using structural topic modeling: A practical demonstration to understand parents’ coping methods during the COVID-19 pandemic in Singapore. Journal of Technology in Human Services, 40(4), 296–318. https://doi.org/10.1080/15228835.2022.2036301

14.

Collins

L. M.

Lanza

S. T.

(2010). Latent Class and Latent Transition Analysis: With applications in the social, behavioral, and health sciences. John Wiley & Sons. https://doi.org/10.1002/9780470567333

15.

Creswell

J. W.

Plano Clark

V. L.

(2018). Designing and conducting mixed methods research. SAGE.

16.

Dai

D. Y.

Chen

(2013). Three paradigms of gifted education: In search of conceptual clarity in research and practice. Gifted Child Quarterly, 57(3), 151–168. https://doi.org/10.1177/0016986213490020

17.

Deveaud

SanJuan

Bellot

(2014). Accurate and effective latent concept modeling for ad hoc information retrieval. Document Numérique, 17(1), 61–84. https://doi.org/10.3166/DN.17.1.61-84

18.

Fan

Chen

Wang

Huang

(2021). A review on data preprocessing techniques toward efficient and reliable knowledge discovery from building operational data. Frontiers in Energy Research, 9, 1–17. https://doi.org/10.3389/fenrg.2021.652801

19.

Feinerer

Hornik

Meyer

(2008). Text mining infrastructure INR. Journal of Statistical Software, 25(5), 1–54. https://doi.org/10.18637/jss.v025.i05

20.

Finch

W. H.

Hernández Finch

M. E.

McIntosh

C. E.

Braun

(2018). The use of topic modeling with latent Dirichlet analysis with open-ended survey items. Translational Issues in Psychological Science, 4(4), 403–424. https://doi.org/10.1037/tps0000173

21.

Gentry

Pereira

Peters

S. J.

McIntosh

J. S.

Fugate

C. M.

(2015). HOPE teacher rating scale: Involving teachers in equitable identification of gifted and talented students in K-12: Manual. https://doi.org/10.4324/9781003235569

22.

Grün

Hornik

(2011). Topicmodels: An R package for fitting topic models. Directory of Open Access Journals. https://doaj.org/article/139b75da4c704e46a90124c2499e0d58

23.

Holland

J. L.

(1973). Making vocational choices: A theory of vocational personalities and work environments. http://ci.nii.ac.jp/ncid/BA47393964

24.

Hsieh

Shannon

S. E.

(2005). Three approaches to qualitative content analysis. Qualitative Health Research, 15(9), 1277–1288. https://doi.org/10.1177/1049732305276687

25.

Jelodar

Wang

Yuan

Feng

Jiang

Zhao

(2018). Latent Dirichlet allocation (LDA) and topic modeling: Models, applications, a survey. Multimedia Tools and Applications, 78(11), 15169–15211. https://doi.org/10.1007/s11042-018-6894-4

26.

Jordan

M. I.

Ghahramani

Jaakkola

T. S.

Saul

L. K.

(1999). An introduction to variational methods for graphical models. Machine Learning, 37, 183–233. https://doi.org/10.1023/A:1007665907178

27.

Karatas

Zhang

Pereira

(2025, April). Motivational factors for participation in enrichment programs: A topic modeling study [Paper presentation]. 2025 Annual Meeting of American Educational Research Association, Denver, CO, United States.

28.

Lamb

M. E.

Sternberg

K. J.

Orbach

Esplin

P. W.

Stewart

Mitchell

(2003). Age differences in young children’s responses to open-ended invitations in the course of forensic interviews. Journal of Consulting and Clinical Psychology, 71(5), 926–934. https://doi.org/10.1037/0022-006x.71.5.926

29.

Lee

L. E.

Rinn

A. N.

Rambo-Hernandez

K. E.

(2024). What happens after nomination? Evaluating the probability of gifted identification with the Torrance Test of Creative Thinking. Gifted Child Quarterly, 68(2), 119–136. https://doi.org/10.1177/00169862231222886

30.

McCoach

D. B.

Peters

Gambino

A. J.

Long

Siegle

(2024). Who are we measuring? Teacher effects in gifted and talented teacher rating scales. Exceptional Children, 90(4), 422–441. https://doi.org/10.1177/00144029241247035

31.

Miyaoka

Decker-Woodrow

Hartman

Booker

Ottmar

(2023). Emergent coding and topic modeling: A comparison of two qualitative analysis methods on teacher focus group data. International Journal of Qualitative Methods, 22, Article 2311659. https://doi.org/10.1177/16094069231165950

32.

Nanda

Douglas

K. A.

Waller

D. R.

Merzdorf

H. E.

Goldwasser

(2021). Analyzing large collections of open-ended feedback from MOOC learners using LDA topic modeling and qualitative analysis. IEEE Transactions on Learning Technologies, 14(2), 146–160. https://doi.org/10.1109/tlt.2021.3064798

33.

Nikita

(2020). ldatuning: Tuning of the latent Dirichlet allocation models parameters (R package version 1.0.2) [Computer software]. Comprehensive R Archive Network (CRAN). https://cran.r-project.org/package=ldatuning

34.

Peters

S. J.

(2022). The challenges of achieving equity within public school gifted and talented programs. Gifted Child Quarterly, 66(2), 82–94. https://doi.org/10.1177/00169862211002535

35.

R Core Team. (2021). R: A language and environment for statistical computing (Version 4.0. 5).

36.

Roberts

M. E.

Stewart

B. M.

Airoldi

E. M.

(2016). A model of text for experimentation in the social sciences. Journal of the American Statistical Association, 111(515), 988–1003. https://doi.org/10.1080/01621459.2016.1141684

37.

Roberts

M. E.

Stewart

B. M.

Tingley

Lucas

Leder-Luis

Gadarian

S. K.

Albertson

Rand

D. G.

(2014). Structural topic models for open-ended survey responses. American Journal of Political Science, 58(4), 1064–1082. https://doi.org/10.1111/ajps.12103

38.

Şakar

Tan

(2025). Research topics and trends in gifted education: A structural topic model. Gifted Child Quarterly, 69(1), 68–84. https://doi.org/10.1177/00169862241285041

39.

Singer

Couper

M. P.

(2017). Some methodological uses of responses to open questions and other verbatim comments in quantitative surveys. Directory of Open Access Journals, 11, Article 1. https://doi.org/10.12758/mda.2017.01

40.

Vuyk

M. A.

Krieshok

T. S.

Kerr

B. A.

(2016). Openness to experience rather than overexcitabilities: Call it like it is. Gifted Child Quarterly, 60(3), 192–211. https://doi.org/10.1177/0016986216645407

41.

Wheeler

J. M.

Cohen

A. S.

Xiong

Lee

Choi

(2021). Sample size for latent Dirichlet allocation of constructed-response items. In Wiberg

Molenaar

González

Böckenholt

Kim

J. S.

(Eds.), Quantitative psychology (Vol. 353, pp. 263–273). https://doi.org/10.1007/978-3-030-74772-5_24

42.

Woike

B. A.

(2007). Content coding of open-ended responses. In Robins

R. W.

Fraley

R. C.

Krueger

R. F.

(Eds.), Handbook of research methods in personality psychology (pp. 292–307). Guilford Press. https://psycnet.apa.org/record/2007-11524-017

43.

Xiong

Choi

Kim

Kwak

Cohen

A. S.

(2020). Topic modeling of constructed-response answers on social study assessments. In Wibert

Molenaar

González

Böckenholt

Kim

J. S.

(Eds.), Quantitative psychology (Vol. 322, pp. 263–274). Springer. https://doi.org/10.1007/978-3-030-43469-4_20.

44.

Zhao

Chen

J. J.

Perkins

Liu

Ding

Zou

(2015). A heuristic approach to determine an appropriate number of topics in topic modeling. BMC Bioinformatics, 16(Suppl. 13), Article S8. https://doi.org/10.1186/1471-2105-16-s13-s8

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.15 MB