Building an Ecosystem to Embrace the Contribution of Replication and Reproducibility Studies,One Special Issue at a Time

Abstract

Keywords

replication open science practices research methods registered report reproducibility

Get full access to this article

View all access options for this article.

References

Aguinis

Cascio

W. F.

Ramani

R. S.

(2017). Science’s reproducibility and replicability crisis: International business is not immune. Journal of International Business Studies, 48(6), 653–663. https://doi.org/10.1057/s41267-017-0081-0

American Psychological Association . (2011). Reviewer guidelines for journal of experimental psychology: Applied. Journal of Experimental Psychology: Applied. https://www.apa.org/pubs/journals/xap/reviewer-guidelines

Angrist

J. D.

Pischke

J.-S.

(2009). Mostly harmless econometrics: An empiricist’s companion. Princeton University Press.

Antonakis

(2017). On doing better science: From thrill of discovery to policy implications. The Leadership Quarterly, 28(1), 5–21. https://doi.org/10.1016/j.leaqua.2017.01.006

Antonakis

Bendahan

Jacquart

Lalive

(2010). On making causal claims: A review and recommendations. The Leadership Quarterly, 21(6), 1086–1120. https://doi.org/10.1016/j.leaqua.2010.10.010

Anvari

Lakens

(2018). The replicability crisis and public trust in psychological science. Comprehensive Results in Social Psychology, 3(3), 266–286. https://doi.org/10.1080/23743603.2019.1684822

Bandura

(1977). Toward a unifying theory of behavioral change. Psychological Review, 84(2), 191–215. https://doi.org/10.1037/0033-295X.84.2.191

Bastardoz

Matthews

M. J.

Sajons

G. B.

Ransom

Kelemen

T. K.

Matthews

S. H.

(2023). Instrumental variables estimation: Assumptions, pitfalls, and guidelines. The Leadership Quarterly, 34(2023), Article 101673. https://doi.org/10.1016/j.leaqua.2022.101673

Bergh

D. D.

Powell

Zhao

Schwab

(2025). Testing and interpreting replication studies: Insights from confidence intervals and Bayesian analyses. Strategic Organization. https://doi.org/10.1177/14761270251410355

10.

Bettis

R. A.

Helfat

C. E.

Shaver

J. M.

(2016). The necessity, logic, and forms of replication. Strategic Management Journal, 37(11), 2193–2203. https://doi.org/10.1002/smj.2580

11.

Bowling

N. A.

Sessa

V. I.

Shaffer

J. A.

Banks

G. C.

(2026). Read my lips: No new constructs! construct proliferation as a threat to the future of I-O psychology. Industrial and Organizational Psychology, 1–17. https://doi.org/10.1017/iop.2025.10067.

12.

Brandt

M. J.

IJzerman

Dijksterhuis

Farach

F. J.

Geller

Giner-Sorolla

Grange

J. A.

Perugini

Spies

J. R.

van ’t Veer

(2014). The replication recipe: What makes for a convincing replication? Journal of Experimental Social Psychology, 50(1), 217–224. https://doi.org/10.1016/j.jesp.2013.10.005

13.

Briker

Gerpott

F. H.

(2024). Publishing registered reports in management and applied psychology: Common beliefs and best practices. Organizational Research Methods, 27(4), 588–620. https://doi.org/10.1177/10944281231210309

14.

Carsten

Clapp-Smith

Alexander Haslam

Bastardoz

Gooty

Connelly

Spain

(2023). Doing better leadership science via replications and registered reports. The Leadership Quarterly, 34(4), Article 101712. https://doi.org/10.1016/j.leaqua.2023.101712

15.

Castille

C. M.

Kreamer

L. M.

Albritton

B. H.

Banks

G. C.

Rogelberg

S. G.

(2022). The open science challenge: Adopt one practice that enacts widely shared values. Journal of Business and Psychology, 37(3), 459–467. https://doi.org/10.1007/s10869-022-09806-2

16.

Dau

L. A.

Santangelo

G. D.

van Witteloostuijn

(2022). Replication studies in international business. Journal of International Business Studies, 53(2), 215–230. https://doi.org/10.1057/s41267-021-00471-w

17.

De Boeck

Jeon

(2018). Perceived crisis and reforms: Issues, explanations, and remedies. Psychological Bulletin, 144(7), 757–777. https://doi.org/10.1037/bul0000154

18.

Eby

L. T.

(2021). Editorial. Journal of Applied Psychology, 106(1), 1–3. https://doi.org/10.1037/apl0000862

19.

Fellnhofer

Wennberg

Allison

T. H.

Arenius

Gish

J. J.

Pollack

J. M.

(2026). Enhancing transparency and replicability in entrepreneurship research with preregistrations, registered reports, and registered revisions: A call for papers. Entrepreneurship Theory and Practice, 50(3), 643–670. https://doi.org/10.1177/10422587251401175

20.

Gerpott

F. H.

(2026). Publishing registered reports: A primer for putting their potential into practice. Zeitschrift Für Arbeits- Und Organisationspsychologie A&O. https://doi.org/10.1026/0932-4089/a000464

21.

Griep

Obenauer

W. G.

Cruz

K. S.

Davis

Harvey

Pinto

Rapp

Rau

Anisman-Razin

Bennett

Bojovic

Branicki

Caner

DeJordy

Djurdjevic

Fenneman

Ferguson

Fida

Wang

(2026). Getting published in, and reviewing for. Group & Organization Management.

22.

Hammond

M. M.

Schyns

Lester

G. V.

Clapp-Smith

Thomas

J. S.

(2023). The romance of leadership: Rekindling the fire through replication of Meindl and Ehrlich. The Leadership Quarterly, 34(4), Article 101538. https://doi.org/10.1016/j.leaqua.2021.101538

23.

Hill

A. D.

Johnson

S. G.

Greco

L. M.

O’Boyle

E. H.

Walter

S. L.

(2021). Endogeneity: A review and agenda for the methodology-practice divide affecting micro and macro research. Journal of Management, 47(1), 105–143. https://doi.org/10.1177/0149206320960533

24.

Hüffmeier

Mazei

Schultze

(2016). Reconceptualizing replication as a sequence of different studies: A replication typology. Journal of Experimental Social Psychology, 66, 81–92. https://doi.org/10.1016/j.jesp.2015.09.009

25.

Jones

S. R. G.

(1992). Was there a Hawthorne effect? American Journal of Sociology, 98(3), 451–468. https://doi.org/10.1086/230046

26.

Köhler

Cortina

J. M.

(2021). Play it again, Sam! An analysis of constructive replication in the organizational sciences. Journal of Management, 47(2), 488–518. https://doi.org/10.1177/0149206319843985

27.

Kraimer

M. L.

(2023). Introducing Journal of Management Scientific Reports (JOMSR). Journal of Management Scientific Reports, 1(1), 3–7. https://doi.org/10.1177/27550311221142152

28.

Levitt

B. S. D.

List

J. A.

(2011). Was there really a Hawthorne effect at the Hawthorne plant? An analysis of the original illumination experiments. American Economic Journal: Applied Economics, 3(1), 224–238. https://doi.org/10.1257/app.3.1.224

29.

Lindsay

D. S.

(2017). Preregistered direct replications in psychological science. Psychological Science, 28(9), 1191–1192. https://doi.org/10.1177/0956797617718802

30.

Locke

E. A.

Latham

G. P.

(2020). Building a theory by induction: The example of goal setting theory. Organizational Psychology Review, 10(3–4), 223–239. https://doi.org/10.1177/2041386620921931

31.

Mathieu

J. E.

(2016). The problem with [in] management theory. Journal of Organizational Behavior, 37(8), 1132–1141. https://doi.org/10.1002/job.2114

32.

Meindl

J. R.

Ehrlich

S. B.

(1987). The romance of leadership and the evaluation of organizational performance. Academy of Management Journal, 30(1), 91–109. https://doi.org/10.5465/255897

33.

Nosek

B. A.

Errington

T. M.

Haber

Stankov

Tyner

A. H.

(2026). A brief glossary of terms about repeatability: Replicability, robustness, and reproducibility. https://osf.io/preprints/metaarxiv/mqfp4_v1

34.

Obenauer

W. G.

(2024). Designing, executing, and publishing replication research: Best practices for successfully taking replication ideas from conceptualization to publication. Journal of Management Scientific Reports, 2(1), 3–26. https://doi.org/10.1177/27550311241232661

35.

Obenauer

W. G.

(2025). Does organizational performance always impact the emergence of Asian American leaders? Using replication to examine how leadership prototypes impact perceptions of fit. Journal of Management Scientific Reports, 4(2), 1–20. https://doi.org/10.1177/27550311251396562

36.

Obenauer

W. G.

Griep

(2026). Is the problem developmental review, or the development of peer review? Industrial and Organizational Psychology, 19(1), 16–20. https://doi.org/10.1017/iop.2025.10050.

37.

Obenauer

W. G.

Kalsher

M. J.

(2023). Is white always the standard? Using replication to revisit and extend what we know about the leadership prototype. The Leadership Quarterly, 34(4), Article 101633. https://doi.org/10.1016/j.leaqua.2022.101633

38.

Obenauer

W. G.

Sieweke

Bastardoz

Arvate

P. R.

Gazdag

B. A.

Hentschel

(2024). Are women strategic leaders more effective during a crisis than men strategic leaders? A causal analysis of the relationship between strategic leader gender and outcomes during the COVID-19 crisis. The Leadership Quarterly, 35(6), 101812. https://doi.org/10.1016/j.leaqua.2024.101812

39.

Pagell

(2021). Replication without repeating ourselves: Addressing the replication crisis in operations and supply chain management research. Journal of Operations Management, 67(1), 105–115. https://doi.org/10.1002/joom.1120

40.

Paterson

T. A.

Harms

P. D.

Steel

Credé

(2016). An assessment of the magnitude of effect sizes: Evidence from 30 years of meta-analysis in management. Journal of Leadership & Organizational Studies, 23(1), 66–81. https://doi.org/10.1177/1548051815614321

41.

Pillutla

M. M.

Thau

(2013). Organizational sciences’ obsession with “that’s interesting!”’: Consequences and an alternative. Organizational Psychology Review, 3(2), 187–194. https://doi.org/10.1177/2041386613479963

42.

Podsakoff

P. M.

Podsakoff

N. P.

(2019). Experimental designs in management and leadership research: Strengths, limitations, and recommendations for improving publishability. The Leadership Quarterly, 30(1), 11–33. https://doi.org/10.1016/j.leaqua.2018.11.002

43.

Rosette

A. S.

Leonardelli

G. J.

Phillips

K. W.

(2008). The white standard: Racial bias in leader categorization. Journal of Applied Psychology, 93(4), 758–777. https://doi.org/10.1037/0021-9010.93.4.758

44.

Schwab

Aguinis

Bamberger

Hodgkinson

G. P.

Shapiro

D. L.

Starbuck

W. H.

Tsui

A. S.

(2023). How replication studies can improve doctoral student education. Journal of Management Scientific Reports, 1(1), 18–41. https://doi.org/10.1177/27550311231156880

45.

Selmer

Shaffer

Guttormsen

D. S. A.

Stoermer

Pinto

L. H.

Chen

Y. P.

Lauring

(2023). Guest editorial: Only replications. Journal of Global Mobility, 11(3), 297–299. https://doi.org/10.1108/JGM-09-2023-102

46.

Sergent

Stajkovic

A. D.

(2020). Women’s leadership is associated with fewer deaths during the COVID-19 crisis: Quantitative and qualitative analyses of United States Governors. Journal of Applied Psychology, 105(8), 771–783. https://doi/10.1037/apl0000577.

47.

Shaver

J. M.

(2020). Causal identification through a cumulative body of research in the study of strategy and organizations. Journal of Management, 46(7), 1244–1256. https://doi.org/10.1177/0149206319846272

48.

Shrout

P. E.

Rodgers

J. L.

(2018). Psychology, science, and knowledge construction: Broadening perspectives from the replication crisis. Annual Review of Psychology, 69, 487–510. https://doi.org/10.1146/annurev-psych-122216-011845

49.

Sieweke

Santoni

(2020). Natural experiments in leadership research: An introduction, review, and guidelines. The Leadership Quarterly, 31(1), Article 101338. https://doi.org/10.1016/j.leaqua.2019.101338

50.

Spector

P. E.

Allen

T. D.

Poelmans

S. A. Y.

Lapierre

L. M.

Cooper

C. L.

O’Driscoll

Sanchez

J. I.

Abarca

Alexandrova

Beham

Brough

Ferreiro

Fraile

C.-Q.

Moreno-Velazquez

Pagon

Pitariu

Salamatov

Ling Siu

(2007). Cross-national differences in relationships of work demands, job satisfaction, and turnover intentions with work-family conflict. Personnel Psychology, 60(4), 805–835. https://doi.org/10.1111/j.1744-6570.2007.00092.x

51.

Standing

L. G.

Grenier

Lane

E. A.

Roberts

M. S.

Sykes

S. J.

(2014). Using replication projects in teaching research methods. Psychology Teaching Review, 20(1), 96–104. https://doi.org/10.53841/bpsptr.2014.20.1.96

52.

Sutton

R. I.

Staw

B. M.

(1995). What theory is not. Administrative Science Quarterly, 40(3), 371–384. https://doi.org/10.2307/2393788

53.

Ubaka

Gutierrez

(2023). Testing the generalizability of the white leadership standard in the post-Obama era. Leadership Quarterly, 34(4), Article 101591. https://doi.org/10.1016/j.leaqua.2021.101591