Sage Journals: Discover world-class research

Abstract

Using various types of research methods yields breadth and depth in knowledge creation. Replying to calls for more research employing diverse research methods, this study examines research method trends, rigor, and emerging research methods within the field of human resource development (HRD). We created a research method coding scheme to capture the rigor of empirical research among empirical articles published in three specifically selected HRD journals from 2016–2023. Out of 488 selected studies, quantitative (n = 269) and qualitative (n = 185) methodologies were dominantly used in empirical studies with only 7.0% being mixed methods research (n = 34). The study findings provide implications and reflections on (1) the current status of published scholarly research; and (2) the research practices in the field. To move the field of HRD forward as a mature, effective, and evolving discipline, it is imperative to incorporate multiple approaches, including interdisciplinary investigation of emerging research methods, and development of clear guidelines for the rigor of research methods.

Keywords

research methodologies research method rigor research rigor quantitative research qualitative research

Get full access to this article

View all access options for this article.

References

Akdere

Jiang

Acheson

(2023). To simulate or not to simulate? Comparing the effectiveness of video-based training versus virtual reality-based simulations on interpersonal skills development. Human Resource Development Quarterly, 34(4), 437–462. https://doi.org/10.1002/hrdq.21470

Akdere

Jiang

Lobo

F. D.

(2022). Evaluation and assessment of virtual reality-based simulated training: Exploring the human–technology frontier. European Journal of Training and Development, 46(5/6), 434–449. https://doi.org/10.1108/EJTD-12-2020-0178

Alkin

M. C.

(2004). Evaluation Roots: Tracing theorists’ views and influence. Sage.

Anderson

(2017). Criteria for evaluating qualitative research. Human Resource Development Quarterly, 28(2), 125–133. https://doi.org/10.1002/hrdq.21282

Bartlett

K. R.

Jang

Feng

Aderibigbe

(2021). A cinematic analysis of the leadership behaviours of Robin Hood. Human Resource Development International, 24(2), 151–172. https://doi.org/10.1080/13678868.2020.1789400

Bellini

Cubico

Favretto

Noventa

S. A.

Ardolino

Gianesini

Ciabuschi

Leitao

Jain

A. K.

(2021). A metamodel for competence assessment: Co.S.M.O.© competences software management for organizations. European Journal of Training and Development, 45(6/7), 603–616. https://doi.org/10.1108/EJTD-04-2018-0034

Bennett

E. E.

McWhorter

R. R.

(2016). Opening the black box and searching for smoking guns: Process causality in qualitative research. European Journal of Training and Development, 40(8/9), 691–718. https://doi.org/10.1108/ejtd-07-2015-0049

Black

Warhurst

(2019). Career transition as identity learning: An autoethnographic understanding of human resource development. Human Resource Development International, 22(1), 25–43. https://doi.org/10.1080/13678868.2018.1444005

Cho

Grenier

Williams

(2022). Introduction: Innovation in qualitative research in HRD. European Journal of Training and Development, 46(7/8), 685–692. https://doi.org/10.1108/EJTD-05-2022-0058

10.

Cohen

Manion

Morrison

(2017). Research methods in education (8th ed.). Routledge.

11.

Collins

C. S.

Stockton

C. M.

(2018). The central role of theory in qualitative research. International Journal of Qualitative Methods, 17(1), 160940691879747. https://doi.org/10.1177/1609406918797475

12.

Cornelissen

J. P.

(2017). Preserving theoretical divergence in management research: Why the explanatory potential of qualitative research should be harnessed rather than suppressed. Journal of Management Studies, 54(3), 368–383. https://doi.org/10.1111/joms.12210

13.

Creswell

J. W.

Clark

V. L. P.

(2017). Designing and conducting mixed methods research. Thousand Oaks.

14.

Creswell

J. W.

Poth

C. N.

(2018). Qualitative inquiry and research design: Choosing among five approaches (4th ed.). Sage Publications.

15.

Cypress

B. S.

(2017). Rigor or reliability and validity in qualitative research: Perspectives, strategies, reconceptualization, and recommendations. Dimensions of Critical Care Nursing: DCCN, 36(4), 253–263. https://doi.org/10.1097/dcc.0000000000000253

16.

Dwivedi

Y. K.

Venkitachalam

Sharif

A. M.

Al-Karaghouli

Weerakkody

(2011). Research trends in knowledge management:Analyzing the past and predicting the future. Information Systems Management, 28(1), 43–56. https://doi.org/10.1080/10580530.2011.536112

17.

Ellaway

(2020). Mixed methods, crimes, and misdemeanours. Advances in Health Sciences Education: Theory and Practice, 25(4), 777–779. https://doi.org/10.1007/s10459-020-09985-8

18.

Fahrenbach

Revoredo

Santoro

F. M.

(2020). Valuing prior learning: Designing an ICT artifact to assess professional competences through text mining. European Journal of Training and Development, 44(2/3), 209–235. https://doi.org/10.1108/EJTD-05-2019-0070

19.

Fraenkel

J. R.

Wallen

N. E.

Hyun

H. H.

(2015). How to design and evaluate research in education (9th ed.). McGraw-Hill Education.

20.

Gibson

C. B.

(2017). Elaboration, generalization, triangulation, and interpretation: On enhancing the value of mixed method research. Organizational Research Methods, 20(2), 193–223. https://doi.org/10.1177/1094428116639133

21.

Grodal

Anteby

Holm

A. L.

(2021). Achieving rigor in qualitative analysis: The role of active categorization in theory building. Academy of Management Review, 46(3), 591–612. https://doi.org/10.5465/amr.2018.0482

22.

Guba

E. G.

Lincoln

Y. S.

(1982). Epistemological and methodological bases of naturalistic inquiry. Educational Technology Research & Development, 30(4), 233–252. https://doi.org/10.1007/BF02765185

23.

Gubbins

Rousseau

D. M.

(2015). Embracing translational HRD research for evidence -based management: Let’s talk about how to bridge the research–practice gap. Human Resource Development Quarterly, 26(2), 109–125. https://doi.org/10.1002/hrdq.21214

24.

Hair

J. F.

Black

W. C.

Babin

B. J.

Anderson

R. E.

(2010). Multivariate data analysis (7th ed.). Prentice Hall.

25.

Hamlin

Stewart

(2011). What is HRD? A definitional review and synthesis of the HRD domain. Journal of European Industrial Training, 35(3), 199–220. https://doi.org/10.1108/03090591111120377

26.

Han

Youm

Tucker

Teal

C. R.

Rougas

Park

Y. S.

J Mooney

L Hanson

Berry

(2022). Research methodologies in health professions education publications: Breadth and rigor. Academic Medicine: Journal of the Association of American Medical Colleges, 97(11S), S54–S62. https://doi.org/10.1097/ACM.0000000000004911

27.

Han

Chae

Han

S. J.

Yoon

S. W.

(2017). Conceptual organization and identity of HRD: Analyses of evolving definitions, influence, and connections. Human Resource Development Review, 16(3), 294–319. https://doi.org/10.1177/1534484317719822

28.

Harrison

R. L.

Reilly

T. M.

Creswell

J. W.

(2020). Methodological rigor in mixed methods: An application in management studies. Journal of Mixed Methods Research, 14(4), 473–495. https://doi.org/10.1177/1558689819900585

29.

Hatcher

Guerdat

(2008). Where is innovation in HRD research? Human Resource Development Quarterly, 19(1), 1–5. https://doi.org/10.1002/hrdq.1222

30.

S. J.

Jeung

Park

Yoon

H. J.

(2009). Who is citing whom: Citation network analysis among HRD publications from 1990 to 2007. Human Resource Development Quarterly, 20(4), 503–537. https://doi.org/10.1002/hrdq.20023

31.

Johnson

(2001). Toward a new classification of nonexperimental quantitative research. Educational Researcher, 30(2), 3–13. https://doi.org/10.3102/0013189x030002003

32.

Johnson

J. L.

Adkins

Chauvin

(2020). A review of the quality indicators of rigor in qualitative research. American Journal of Pharmaceutical Education, 84(1), 7120–7146. https://doi.org/10.5688/ajpe7120

33.

Kim

J. M.

(2004). Trends in human resource development research. Journal of Korean Agricultural Education, 36(4), 115–138.

34.

Kirrane

Breen

O’Connor

(2017). A qualitative study on the consequences of intensive working. Human Resource Development Quarterly, 28(2), 227–268. https://doi.org/10.1002/hrdq.21284

35.

Legate

A. E.

Ringle

C. M.

Hair

J. F.

Jr. (2023). PLS-SEM: A method demonstration in the R statistical environment. Human Resource Development Quarterly, 1–29. https://doi.org/10.1002/hrdq.21517

36.

Lester

J. N.

Cho

Lochmiller

C. R.

(2020). Learning to do qualitative data analysis: A starting point. Human Resource Development Review, 19(1), 94–106. https://doi.org/10.1177/1534484320903890

37.

Levitt

H. M.

Motulsky

S. L.

Wertz

F. J.

Morrow

S. L.

Ponterotto

J. G.

(2017). Recommendations for designing and reviewing qualitative research in psychology: Promoting methodological integrity. Qualitative Psychology, 4(1), 2–22. https://doi.org/10.1037/qup0000082

38.

Lincoln

Y. S.

Lynham

S. A.

(2011). Criteria for assessing theory in human resource development from an interpretive perspective. Human Resource Development International, 14(1), 3–22. https://doi.org/10.1080/13678868.2011.542895

39.

Long

(2014). An empirical review of research methodologies and methods in creativity studies (2003–2012). Creativity Research Journal, 26(4), 427–438. https://doi.org/10.1080/10400419.2014.961781

40.

Lub

(2015). Validity in qualitative evaluation: Linking purposes, paradigms, and perspectives. International Journal of Qualitative Methods, 14(5), 160940691562140. https://doi.org/10.1177/1609406915621406

41.

Lynham

S. A.

(2002). The general method of theory-building research in applied disciplines. Advances in Developing Human Resources, 4(3), 221–241. https://doi.org/10.1177/1523422302043002

42.

MacKinnon

D. P.

(2012). Introduction to statistical mediation analysis. Routledge.

43.

Maula

Stam

(2019). Enhancing rigor in quantitative entrepreneurship research. Entrepreneurship Theory and Practice, 44(6), 1059–1090. https://doi.org/10.1177/1042258719891388

44.

Maxwell

J. A.

(2004). Causal explanation, qualitative research, and scientific inquiry in education. Educational Researcher, 33(2), 3–11. https://doi.org/10.3102/0013189x033002003

45.

McGuire

Cseh

(2006). The development of the field of HRD: A Delphi study. Journal of European Industrial Training, 30(8), 653–667. https://doi.org/10.1108/03090590610712304

46.

Mizzi

R. C.

O’Brien-Klewchuk

(2016). Preparing the transnational teacher: A textual analysis of pre-departure orientation manuals for teaching overseas. Human Resource Development International, 19(4), 329–344. https://doi.org/10.1080/13678868.2016.1203637

47.

Moore

H. L.

van Mierlo

Bakker

A. B.

(2022). Development and validation of the behavioural index of occupational strengths (BIOS). Human Resource Development International, 25(5), 527–556. https://doi.org/10.1080/13678868.2021.1959776

48.

Moravcsik

(2013). Transparency: The revolution in qualitative research. PS: Political Science & Politics, 47(01), 48–53. https://doi.org/10.1017/s1049096513001789

49.

Nimon

K. F.

(2016). Methods matter: Call for research methods submissions. Human Resource Development Quarterly, 27(4), 457–459. https://doi.org/10.1002/hrdq.21264

50.

Nimon

K. F.

Astakhova

(2015). Improving the rigor of quantitative HRD research: Four recommendations in support of the general hierarchy of evidence. Human Resource Development Quarterly, 26(3), 231–247. https://doi.org/10.1002/hrdq.21219

51.

O’Brien

B. C.

Harris

I. B.

Beckman

T. J.

Reed

D. A.

Cook

D. A.

(2014). Standards for reporting qualitative research: A synthesis of recommendations. Academic Medicine: Journal of the Association of American Medical Colleges, 89(9), 1245–1251. https://doi.org/10.1097/acm.0000000000000388

52.

Onwuegbuzie

A. J.

Corrigan

J. A.

(2014). Improving the quality of mixed research reports in the field of human resource development and beyond: A call for rigor as an ethical practice. Human Resource Development Quarterly, 25(3), 273–299. https://doi.org/10.1002/hrdq.21197

53.

Paavola

Hakkarainen

(2005). The knowledge creation metaphor: An emergent epistemological approach to learning. Science & Education, 14(6), 535–557. https://doi.org/10.1007/s11191-004-5157-0

54.

Pandya

S. P.

(2023). Professional immigrants and high-functioning anxiety: Assessing some interventions. Human Resource Development International, 26(5), 521–547. https://doi.org/10.1080/13678868.2023.2170200

55.

Patten

M. L.

Newhart

(2018). Understanding research methods: An overview of the essentials (10th ed.). Routledge.

56.

Reio

T. G.

(2016). Nonexperimental research: Strengths, weaknesses and issues of precision. European Journal of Training and Development, 40(8/9), 676–690. https://doi.org/10.1108/ejtd-07-2015-0058

57.

Reio

T. G.

(2021). The ten research questions: An analytic tool for critiquing empirical studies and teaching research rigor. Human Resource Development Review, 20(3), 374–390. https://doi.org/10.1177/15344843211025182

58.

Reeves

T. C.

E. G.

(2017). The goals and methods of educational technology research over a quarter century (1989–2014). Education Technology Research and Development, 65(2), 325–339. https://doi.org/10.1007/s11423-016-9474-1

59.

Reio

T. G.

Jr. (2009). Contributing to the emergent research method conversation. Human Resource Development Quarterly, 20(2), 143–146. https://doi.org/10.1002/hrdq.20012

60.

Reio

T. G.

Jr. (2010). The ongoing quest for theory-building research methods articles. Human Resource Development Review, 9(3), 223–225. https://doi.org/10.1177/1534484310371448

61.

Rocco

T. S.

(2003). Shaping the future: Writing up the method on qualitative studies. Human Resource Development Quarterly, 14(3), 343–349. https://doi.org/10.1002/hrdq.1070

62.

Seale

(1999). Quality in qualitative research. Qualitative Inquiry, 5(4), 465–478. https://doi.org/10.1177/107780049900500402

63.

Shirmohammadi

Hedayati Mehdiabadi

Beigi

McLean

G. N.

(2020). Mapping human resource development: Visualizing the past, bridging the gaps, and moving toward the future. Human Resource Development Quarterly, 32(2), 197–224. https://doi.org/10.1002/hrdq.21415

64.

Sisco

Hart-Mrema

T. S.

Aderibigbe

(2022). Engaging in race-conscious research and applying racial equity in human resource development: A collective autoethnography. Human Resource Development International, 25(1), 59–75. https://doi.org/10.1080/13678868.2020.1860387

65.

Song

J. H.

Lim

D. H.

(2015). Mediating analysis approaches: Trends and implications for advanced applications in HRD research. Advances in Developing Human Resources, 17(1), 57–71. https://doi.org/10.1177/1523422314559807

66.

Standards for reporting on empirical social science research in AERA publications: American Educational Research Association . (2006). Standards for reporting on empirical social science research in AERA publications: American educational research association. Educational Researcher, 35(6), 33–40. https://doi.org/10.3102/0013189x035006033

67.

Storberg-Walker

(2003). Comparison of the Dubin, Lynham, and Van de Ven theory-building research methods and implications for HRD. Human Resource Development Review, 2(2), 211–222. https://doi.org/10.1177/1534484303002002007

68.

Tkachenko

Seo

Ardichvili

(2022). Case study research in HRD: A review of trends and call for advancement. European Journal of Training and Development, 46(7/8), 693–708. https://doi.org/10.1108/EJTD-10-2021-0160

69.

Tong

Sainsbury

Craig

(2007). Consolidated criteria for reporting qualitative research (COREQ): A 32-item checklist for interviews and focus groups. International Journal for Quality in Health Care: Journal of the International Society for Quality in Health Care, 19(6), 349–357. https://doi.org/10.1093/intqhc/mzm042

70.

Wilson

S. R.

Whitmoyer

J. G.

Pieper

T. M.

Astrachan

J. H.

Hair

J. F.

Jr. Sarstedt

(2014). Method trends and method needs: Examining methods needed for accelerating the field, 5(1), 4–14. https://doi.org/10.1016/j.jfbs.2014.01.011

71.

Yoo

Jang

Byun

S. W.

Park

(2018). Exploring human resource development research themes: A keyword network analysis. Human Resource Development Quarterly, 30(2), 155–174. https://doi.org/10.1002/hrdq.21336

72.

Yoon

S. W.

Chae

(2022). Research topics and collaboration in human resource development review 2012–2021: A bibliometrics approach. Human Resource Development Review, 21(1), 24–47. https://doi.org/10.1177/15344843211068807

73.

Zhu

Sari

Lee

M. M.

(2018). A systematic review of research methods and topics of the empirical MOOC literature (2014 – 2016), 37, 31–39. https://doi.org/10.1016/j.iheduc.2018.01.002

The Landscape of Research Method Rigor in the Field of Human Resource Development: An Analysis of Empirical Research from 2016 to 2023

Abstract

Keywords

Get full access to this article

References