Enhancing Rigor in Quantitative Entrepreneurship Research

Abstract

Reflecting on common empirical concerns in quantitative entrepreneurship research, recent calls for improved rigor and reproducibility in social science research, and recent methodological developments, we discuss new opportunities for further enhancing rigor in quantitative entrepreneurship research. In addition to highlighting common key concerns of editors and reviewers, we review recent methodological guidelines in the social sciences that offer more in-depth discussions of particular empirical issues and approaches. We conclude by offering a set of best practice recommendations for further enhancing rigor in quantitative entrepreneurship research.

Keywords

editorial entrepreneurship research methods quantitative research

Get full access to this article

View all access options for this article.

References

Abadie

Cattaneo

M. D

. (2018). Econometric methods for program evaluation. Annual Review of Economics, 10(1), 465–503.doi:10.1146/annurev-economics-080217-053402

Abadie

Diamond

Hainmueller

. (2015). Comparative politics and the synthetic control method. American Journal of Political Science, 59(2), 495–510.doi:10.1111/ajps.12116

Acs

Audretsch

Desai

Welpe

. (2010). On experiments in entrepreneurship research. Journal of Economic Behavior & Organization, 76(1), 1–2.doi:10.1016/j.jebo.2010.06.007

Aguinis

Bradley

K. J

. (2014). Best practice recommendations for designing and implementing experimental vignette methodology studies. Organizational Research Methods, 17(4), 351–371.doi:10.1177/1094428114547952

Aguinis

Culpepper

S. A

. (2015). An expanded decision-making procedure for examining cross-level interaction effects with multilevel modeling. Organizational Research Methods, 18(2), 155–176.doi:10.1177/1094428114563618

Aguinis

Edwards

J. R.

Bradley

K. J

. (2017). Improving our understanding of moderation and mediation in strategic management research. Organizational Research Methods, 20(4), 665–685.doi:10.1177/1094428115627498

Aguinis

Gottfredson

R. K.

Culpepper

S. A

. (2013). Best-practice recommendations for estimating cross-level interaction effects using multilevel modeling. Journal of Management, 39(6), 1490–1528.doi:10.1177/0149206313478188

Aguinis

Gottfredson

R. K.

Joo

. (2013). Best-practice recommendations for defining, identifying, and handling outliers. Organizational Research Methods, 16(2), 270–301.doi:10.1177/1094428112470848

Aguinis

Ramani

R. S.

Alabduljader

. (2018). What you see is what you get? enhancing methodological transparency in management research. Academy of Management Annals, 12(1), 83–110.doi:10.5465/annals.2016.0011

10.

Aguinis

Vandenberg

R. J

. (2014). An ounce of prevention is worth a pound of cure: Improving research quality before data collection. Annual Review of Organizational Psychology and Organizational Behavior, 1(1), 569–595.doi:10.1146/annurev-orgpsych-031413-091231

11.

Aguinis

Werner

Lanza Abbott

Angert

Kohlhausen

. (2010). Customer-centric science: Reporting significant research results with rigor, relevance, and practical impact in mind. Organizational Research Methods, 13(3), 515–539.doi:10.1177/1094428109333339

12.

Norton

E. C

. (2003). Interaction terms in logit and probit models. Economic Letters, 80(1), 123–129.doi:10.1016/S0165-1765(03)00032-6

13.

Allison

P. D

. (2014). Event history and survival analysis: Regression for longitudinal event data. SAGE Publications.

14.

American Economic Association . (2018). Data availability policy. Retrieved October 11, 2018, from https://www.aeaweb.org/journals/policies/data-availability-policy.

15.

Amrhein

Greenland

McShane

. (2019). Retire statistical significance. Nature, 567, 305–307.

16.

Amrhein

Trafimow

Greenland

. (2019). Inferential statistics as descriptive statistics: There is no replication crisis if we don’t expect replication. The American Statistician, 73(supp 1), 262–270.doi:10.1080/00031305.2018.1543137

17.

Anderson

A. A

. (2019). Assessing statistical results: Magnitude, precision, and model uncertainty. The American Statistician, 73(supp 1), 118–121.doi:10.1080/00031305.2018.1537889

18.

Anderson

B. S.

Wennberg

McMullen

J. S

. (2019). Editorial: Enhancing quantitative theory-testing entrepreneurship research. Journal of Business Venturing, 34(5), 105928.doi:10.1016/j.jbusvent.2019.02.001

19.

Andersson

Cuervo-Cazurra

Nielsen

B. B

. (2014). From the editors: Explaining interaction effects within and across levels of analysis. Journal of International Business Studies, 45(9), 1063–1071.doi:10.1057/jibs.2014.50

20.

Andraszewicz

Scheibehenne

Rieskamp

Grasman

Verhagen

Wagenmakers

E. -J

. (2015). An introduction to Bayesian hypothesis testing for management research. Journal of Management, 41(2), 521–543.doi:10.1177/0149206314560412

21.

Angrist

J. D.

Pischke

J.-S

. (2009). Mostly harmless econometrics: An empiricist’s companion. Princeton University Press. https://press.princeton.edu/books/paperback/9780691120355/mostly-harmless-econometrics

22.

Antonakis

. (2017). On doing better science: From thrill of discovery to policy implications. Leadership Quarterly, 28(1), 5–21.doi:10.1016/j.leaqua.2017.01.006

23.

Antonakis

Bendahan

Jacquart

Lalive

. (2010). On making causal claims: A review and recommendations. The Leadership Quarterly, 21(6), 1086–1120.doi:10.1016/j.leaqua.2010.10.010

24.

Baker

. (2016). Is there a reproducibility crisis? A nature survey lifts the lid on how researchers view the ’crisis’ rocking science and what they think will help. Nature, 533(7604), 452–455.

25.

Banks

G. C.

Woznyj

H. M.

Wesslen

R. S.

Ross

R. L

. (2018). A review of best practice recommendations for text analysis in R (and a user-friendly app). Journal of Business and Psychology, 33(4), 445–459.doi:10.1007/s10869-017-9528-3

26.

Bascle

. (2008). Controlling for endogeneity with instrumental variables in strategic management research. Strategic Organization, 6(3), 285–327.doi:10.1177/1476127008094339

27.

Becker

T. E.

Robertson

M. M.

Vandenberg

R. J

. (2018). Nonlinear transformations in organizational research: Possible problems and potential solutions. Organizational Research Methods, In press.

28.

Benjamin

D. J.

Berger

J. O

. (2019). Three recommendations for improving the use of p -values. The American Statistician, 73(sup1), 186–191.doi:10.1080/00031305.2018.1543135

29.

Benjamini

Hochberg

. (1995). Controlling the false discovery rate: A practical and powerful approach to multiple testing. Journal of the Royal Statistical Society: Series B, 57(1), 289–300.

30.

Benjamini

Yekutieli

. (2001). The control of the false discovery rate in multiple testing under dependency. The Annals of Statistics, 29(4), 1165–1188.

31.

Bergh

D. D.

Holbein

G. F

. (1997). Assessment and redirection of longitudinal analysis demonstration with a study of the diversification and divestiture relationship. Strategic Management Journal, 18(7), 557–571.doi:10.1002/(SICI)1097-0266(199708)18:7<557::AID-SMJ911>3.0.CO;2-6

32.

Bergh

D. D.

Sharp

B. M.

Aguinis

. (2017). Is there a credibility crisis in strategic management research? evidence on the reproducibility of study findings. Strategic Organization, 15(3), 423–436.doi:10.1177/1476127017701076

33.

Betensky

R. A

. (2019). The p -value requires context, not a threshold. The American Statistician, 73(supp 1), 115–117.doi:10.1080/00031305.2018.1529624

34.

Bettis

R. A.

Ethiraj

Gambardella

Helfat

Mitchell

. (2016). Creating repeatable cumulative knowledge in strategic management. Strategic Management Journal, 37(2), 257–261.doi:10.1002/smj.2477

35.

Bettis

Gambardella

Helfat

Mitchell

. (2014). Quantitative empirical analysis in strategic management. Strategic Management Journal, 35(7), 949–953.doi:10.1002/smj.2278

36.

Bettis

R. A.

Helfat

C. E.

Shaver

J. M

. (2016). The necessity, logic, and forms of replication. Strategic Management Journal, 37(11), 2193–2203.doi:10.1002/smj.2580

37.

Bliese

P. D.

Schepker

D. J.

Essman

S. M.

Ployhart

R. E

. (2019). Bridging methodological divides between macro- and microresearch: Endogeneity and methods for panel data. Journal of Management, 38, 014920631986801.doi:10.1177/0149206319868016

38.

Bollen

K. A.

Curran

P. J

. (2006). Latent curve models: A structural equation perspective. John Wiley & Sons.

39.

Bollen

K. A.

Pearl

. (2013). Eight myths about causality and structural equation models. In Morgan

S. L.

(Ed.), Handbook of causal analysis for social research (pp. 301–328). Springer Netherlands.

40.

Bond

S. R

. (2002). Dynamic panel data models: A guide to micro data methods and practice. Portuguese Economic Journal, 1(2), 141–162.doi:10.1007/s10258-002-0009-9

41.

Borsboom

Mellenbergh

G. J.

van Heerden

. (2004). The concept of validity. Psychological Review, 111(4), 1061–1071.doi:10.1037/0033-295X.111.4.1061

42.

Boyd

B. K.

Takacs Haynes

Hitt

M. A.

Bergh

D. D.

Ketchen

D. J

. (2012). Contingency hypotheses in strategic management research: Use, disuse, or misuse? Journal of Management, 38(1), 278–313.

43.

Braun

M. T.

Kuljanin

DeShon

R. P

. (2018). Special considerations for the acquisition and wrangling of big data. Organizational Research Methods, 21(3), 633–659.doi:10.1177/1094428117690235

44.

Brown

G. W.

Ouimet

P. P.

Robinson

D. T.

Zoller

. (2017). Understanding entrepreneurship: Facilitating academic research with a shared data repository. UNC & Duke University Working Paper.

45.

Bun

M. J. G.

Sarafidis

. (2015). Dynamic panel data models. In Baltagi

B. H.

(Ed.), Oxford handbook on panel data (pp. 76–110). Oxford University Press.

46.

Busenitz

L. W.

West

G. P.

III Shepherd

Nelson

Chandler

G. N.

Zacharakis

. (2003). Entrepreneurship research in emergence: Past trends and future directions. Journal of Management, 29(3), 285–308.doi:10.1016/S0149-2063(03)00013-8

47.

Calin-Jageman

R. J.

Cumming

. (2019). The new statistics for better science: Ask how much, how uncertain, and what else is known. The American Statistician, 73(sup1), 271–280.doi:10.1080/00031305.2018.1518266

48.

Calonico

Cattaneo

M. D.

Farrell

M. H.

Titiunik

. (2019). Regression discontinuity designs using covariates. The Review of Economics and Statistics, 101(3), 442–451.doi:10.1162/rest_a_00760

49.

Calonico

Cattaneo

M. D.

Titiunik

. (2014). Robust data-driven inference in the regression-discontinuity design. The Stata Journal, 14(4), 909–946.doi:10.1177/1536867X1401400413

50.

Camerer

C. F.

Dreber

Forsell

T. -H.

Huber

Johannesson

Kirchler

Almenberg

Altmejd

Chan

Heikensten

Holzmeister

Imai

Isaksson

Nave

Pfeiffer

Razen

. (2016). Evaluating replicability of laboratory experiments in economics. Science, 351(6280), 1433–1436.doi:10.1126/science.aaf0918

51.

Cameron

A. C.

Trivedi

P. K

. (2005). Microeconometrics: Methods and applications. Cambridge University Press.

52.

Carlson

K. D.

Herdman

A. O

. (2012). Understanding the impact of convergent validity on research results. Organizational Research Methods, 15(1), 17–32.doi:10.1177/1094428110392383

53.

Certo

S. T.

Busenbark

J. R.

Woo

H. -S.

Semadeni

. (2016). Sample selection bias and heckman models in strategic management research. Strategic Management Journal, 37(13), 2639–2657.doi:10.1002/smj.2475

54.

Certo

S. T.

Withers

M. C.

Semadeni

. (2017). A tale of two effects: Using longitudinal data to compare within- and between-firm effects. Strategic Management Journal, 38(7), 1536–1556.doi:10.1002/smj.2586

55.

Chandler

G. N.

Lyon

D. W

. (2001). Issues of research design and construct measurement in entrepreneurship research: The past decade. Entrepreneurship Theory and Practice, 25(4), 101–113.doi:10.1177/104225870102500407

56.

Chatterji

A. K.

Findley

Jensen

N. M.

Meier

Nielson

. (2016). Field experiments in strategy research. Strategic Management Journal, 37(1), 116–132.doi:10.1002/smj.2449

57.

Chen

. (2018). Supporting and enhancing scientific rigor. Journal of Applied Psychology, 103(4), 359–361.doi:10.1037/apl0000313

58.

Chen

X. P.

Yao

Kotha

. (2009). Entrepreneur passion and preparedness in business plan presentations: A persuasion analysis of venture capitalists’ funding decisions. Academy of Management Journal, 52(1), 199–214.doi:10.5465/amj.2009.36462018

59.

Christen

. (2019). Data linkage: The big picture. Harvard Data Science Review, 1(2).

60.

Christensen

Miguel

. (2018). Transparency, reproducibility, and the credibility of economics research. Journal of Economic Literature, 56(3), 920–980.doi:10.1257/jel.20171350

61.

Ciuchta

M. P.

Letwin

Stevenson

McMahon

Huvaj

M. N

. (2018). Betting on the coachable entrepreneur: Signaling and social exchange in entrepreneurial pitches. Entrepreneurship Theory and Practice, 42(6), 860–885.doi:10.1177/1042258717725520

62.

Cleves

M. A.

Gould

W. W.

Marchenko

. (2016). An introduction to survival analysis using Stata (3rd ed.). Stata Press.

63.

Clougherty

J. A.

Duso

Muck

. (2016). Correcting for self-selection based endogeneity in management research: Review, recommendations and simulations. Organizational Research Methods, 19(2), 286–347.

64.

Combs

J. G

. (2010). Big samples and small effects: Let’s not trade relevance and rigor for power. Academy of Management Journal, 53(1), 9–13.doi:10.5465/amj.2010.48036305

65.

Connelly

B. L.

Ireland

R. D.

Reutzel

C. R.

Coombs

J. E

. (2010). The power and effects of entrepreneurship research. Entrepreneurship Theory and Practice, 34(1), 131–149.doi:10.1111/j.1540-6520.2009.00316.x

66.

Connelly

Playford

C. J.

Gayle

Dibben

. (2016). The role of administrative data in the big data revolution in social science research. Social Science Research, 59, 1–12.doi:10.1016/j.ssresearch.2016.04.015

67.

Crawford

G. C.

Aguinis

Lichtenstein

Davidsson

McKelvey

. (2015). Power law distributions in entrepreneurship: Implications for theory and research. Journal of Business Venturing, 30(5), 696–713.doi:10.1016/j.jbusvent.2015.01.001

68.

Creswell

J. W.

Plano Clark

V. L

. (2011). Designing and conducting mixed methods research (2nd ed.). Sage.

69.

Crook

T. R.

Shook

C. L.

Morris

M. L.

Madden

T. M

. (2010). Are we there yet?: An assessment of research design and construct measurement practices in entrepreneurship research. Organizational Research Methods, 13(1), 192–206.

70.

Cumming

. (2011). Understanding the new statistics: Effect sizes, confidence intervals, and meta-analysis. Routledge.

71.

Cumming

. (2014). The new statistics: Why and how. Psychological Science, 25(1), 7–29.doi:10.1177/0956797613504966

72.

Dalal

D. K.

Zickar

M. J

. (2012). Some common myths about centering predictor variables in moderated multiple regression and polynomial regression. Organizational Research Methods, 15(3), 339–362.doi:10.1177/1094428111430540

73.

Dalle

J. -M.

Den Besten

Menon

. (2017). Using Crunchbase for economic and managerial research. OECD Publishing.

74.

Davidsson

. (2016). Researching entrepreneurship: Conceptualization and design (2nd ed.). Springer.

75.

Davidsson

Wiklund

. (2001). Levels of analysis in entrepreneurship research: Current research practice and suggestions for the future. Entrepreneurship Theory and Practice, 25(4), 81–100.doi:10.1177/104225870102500406

76.

Dawson

J. F

. (2014). Moderation in management research: What, why, when, and how. Journal of Business and Psychology, 29(1), 1–19.doi:10.1007/s10869-013-9308-7

77.

Dean

M. A.

Shook

C. L.

Payne

G. T

. (2007). The past, present, and future of entrepreneurship research: Data analytic trends and training. Entrepreneurship Theory and Practice, 31(4), 601–618.doi:10.1111/j.1540-6520.2007.00190.x

78.

DeVellis

R. F

. (2016). Scale development: Theory and applications (4th ed.). Sage publications.

79.

Dieleman

J. L.

Templin

. (2014). Random-effects, fixed-effects and the within-between specification for clustered data in observational health studies: A simulation study. Plos One, 9(10), e110257.doi:10.1371/journal.pone.0110257

80.

Edwards

J. R

. (2003). Construct validation in organizational behavior research. In Greenberg

(Ed.), Organizational behavior: A management challenge (pp. 327–371). Erlbaum.

81.

Edwards

J. R.

Berry

J. W

. (2010). The presence of something or the absence of nothing: Increasing theoretical precision in management research. Organizational Research Methods, 13(4), 668–689.doi:10.1177/1094428110380467

82.

Edwards

J. R.

Lambert

L. S

. (2007). Methods for integrating moderation and mediation: A general analytical framework using moderated path analysis. Psychological Methods, 12(1), 1–22.doi:10.1037/1082-989X.12.1.1

83.

Enders

C. K

. (2010). Applied missing data analysis. The Guilford Press.

84.

Ertug

Gruber

Nyberg

Steensma

H. K

. (2018). From the editors—A brief primer on data visualization opportunities in management research. Academy of Management Journal, 61(5), 1613–1625.doi:10.5465/amj.2018.4005

85.

Ethiraj

S. K.

Gambardella

Helfat

C. E

. (2017). Improving data availability: A new SMJ initiative. Strategic Management Journal, 38(11), 2145–2146.doi:10.1002/smj.2690

86.

Farhat

Matusik

Robb

Robinson

D. T

. (2018). New directions in entrepreneurship research with the Kauffman firm survey. Small Business Economics, 50(3), 521–532.doi:10.1007/s11187-017-9905-3

87.

Farhat

Robb

. (2018). Analyzing complex survey data: The Kauffman firm survey. Small Business Economics, 50(3), 657–670.doi:10.1007/s11187-017-9913-3

88.

Freese

. (2007). Replication standards for quantitative social science: Why not sociology? Sociological Methods and Research, 36(2), 153–172.

89.

Gelman

. (2018). The failure of null hypothesis significance testing when studying incremental changes, and what to do about it. Personality and Social Psychology Bulletin, 44(1), 16–23.doi:10.1177/0146167217729162

90.

Gelman

Stern

H. S.

Carlin

J. B.

Dunson

D. B.

Vehtari

Rubin

D. B

. (2013). Bayesian data analysis. Chapman and Hall/CRC.

91.

George

Haas

M. R.

Pentland

. (2014). Big data and management. Academy of Management Journal, 57(2), 321–326.doi:10.5465/amj.2014.4002

92.

George

Osinga

E. C.

Lavie

Scott

B. A

. (2016). Big data and data science methods for management research. Academy of Management Journal, 59(5), 1493–1507.doi:10.5465/amj.2016.4005

93.

Gigerenzer

. (2004). Mindless statistics. The Journal of Socio-Economics, 33(5), 587–606.doi:10.1016/j.socec.2004.09.033

94.

Gigerenzer

Marewski

J. N

. (2015). Surrogate science: The idol of a universal method for scientific inference. Journal of Management, 41(2), 421–440.

95.

Goetz

Hyatt

McEntarfer

Sandusky

. (2015). The promise and potential of linked employer-employee data for entrepreneurship research.. Working Paper No. 21639.

96.

Golubov

Yawson

Zhang

. (2015). Extraordinary acquirers. Journal of Financial Economics, 116(2), 314–330.doi:10.1016/j.jfineco.2015.02.005

97.

Grant

A. M.

Wall

T. D

. (2009). The neglected science and art of quasi-experimentation. Organizational Research Methods, 12(4), 653–686.

98.

Greene

W. H

. (2010). Testing hypotheses about interaction terms in nonlinear models. Economics Letters, 107(2), 291–296.doi:10.1016/j.econlet.2010.02.014

99.

Greene

W. H

. (2012). Econometric analysis (International ed.). Pearson Education Limited.

100.

Greenland

. (2019). Valid p-values behave exactly as they should: Some misleading criticisms of p-values and their resolution with s-values . The American Statistician, 73(sup1), 106–114.doi:10.1080/00031305.2018.1529625

101.

Greenland

Senn

S. J.

Rothman

K. J.

Carlin

J. B.

Poole

Goodman

S. N.

Altman

D. G

. (2016). Statistical tests, P values, confidence intervals, and power: A guide to misinterpretations. European Journal of Epidemiology, 31(4), 337–350.

102.

Grégoire

D. A.

Binder

J. K.

Rauch

. (2019). Navigating the validity tradeoffs of entrepreneurship research experiments: A systematic review and best-practice suggestions. Journal of Business Venturing, 34(2), 284–310.doi:10.1016/j.jbusvent.2018.10.002

103.

Greve

H. R

. (2018). Show me the data! improving evidence presentation for publication. Management and Organization Review, 14(2), 423–432.doi:10.1017/mor.2018.18

104.

Guide

V. D. R.

Ketokivi

. (2015). Notes from the editors: Redefining some methodological criteria for the journal. Journal of Operations Management, 37(1), v–0.doi:10.1016/S0272-6963(15)00056-X

105.

Haans

R. F. J.

Pieters

Z. -L

. (2016). Thinking about u: Theorizing and testing u- and inverted u-shaped relationships in strategy research. Strategic Management Journal, 37(7), 1177–1195.doi:10.1002/smj.2399

106.

Hahn

E. D.

Ang

S. H

. (2017). From the editors: New directions in the reporting of statistical results in the Journal of world business. Journal of World Business, 52(2), 125–126.doi:10.1016/j.jwb.2016.12.003

107.

Hamilton

B. H

. (2000). Does entrepreneurship pay? an empirical analysis of the returns to self‐employment. Journal of Political Economy, 108(3), 604–631.doi:10.1086/262131

108.

Hamilton

B. H.

Nickerson

J. A

. (2003). Correcting for endogeneity in strategic management research. Strategic Organization, 1(1), 51–78.doi:10.1177/1476127003001001218

109.

Hannigan

T. R.

Haans

R. F. J.

Vakili

Tchalian

Glaser

V. L.

Wang

M. S.

Kaplan

Jennings

P. D

. (2019). Topic modeling in management research: Rendering new theory from textual data. Academy of Management Annals, 13(2), 586–632.doi:10.5465/annals.2017.0099

110.

Harrison

G. W.

List

J. A

. (2004). Field experiments. Journal of Economic Literature, 42(4), 1009–1055.doi:10.1257/0022051043004577

111.

Healy

. (2018). Data visualization: A practical introduction. Princeton University Press.

112.

Hicks

Tingley

. (2011). Causal mediation analysis. The Stata Journal, 11(4), 605–619.doi:10.1177/1536867X1201100407

113.

Hoenig

J. M.

Heisey

D. M

. (2001). The abuse of power: The pervasive fallacy of power calculations for data analysis. The American Statistician, 55(1), 19–24.

114.

Hoetker

. (2007). The use of logit and probit models in strategic management research: Critical issues. Strategic Management Journal, 28(4), 331–343.doi:10.1002/smj.582

115.

Honig

Lampel

Baum

J. A. C.

Glynn

M. A.

Jing

Lounsbury

Schüßler

Sirmon

D. G.

Tsui

A. S.

Walsh

J. P.

van Witteloostuijn

. (2018). Reflections on scientific misconduct in management: Unfortunate incidents or a normative crisis? Academy of Management Perspectives, 32(4), 412–442.doi:10.5465/amp.2015.0167

116.

Hsu

D. K.

Simmons

S. A.

Wieland

A. M

. (2017). Designing entrepreneurship experiments: A review, typology, and research agenda. Organizational Research Methods, 20(3), 379–412.

117.

Huang

J. L.

Liu

Bowling

N. A

. (2015). Insufficient effort responding: Examining an insidious confound in survey data. Journal of Applied Psychology, 100(3), 828–845.doi:10.1037/a0038510

118.

Hubbard

. (2015). Corrupt research: The case for reconceptualizing empirical management and social science. Sage Publications.

119.

Hurlbert

S. H.

Levine

R. A.

Utts

. (2019). Coup de grâce for a tough old bull: “Statistically significant” expires. The American Statistician, 73(sup1), 352–357.doi:10.1080/00031305.2018.1543616

120.

Iacus

S. M.

King

Porro

. (2009). CEM: Software for coarsened exact matching. Journal of Statistical Software, 30(9), 1–27.doi:10.18637/jss.v030.i09

121.

Iacus

S. M.

King

Porro

. (2012). Causal inference without balance checking: Coarsened exact matching. Political Analysis, 20(1), 1–24.doi:10.1093/pan/mpr013

122.

Imbens

G. W

. (2019). Potential outcome and directed acyclic graph approaches to causality: Relevance for empirical practice in economics. NBER Working Paper No. 26104.

123.

Imbens

G. W.

Rubin

D. B

. (2015). Causal inference for statistics, social, and biomedical sciences: An introduction. Cambridge University Press.

124.

Imbens

G. W.

Wooldridge

J. M

. (2009). Recent developments in the econometrics of program evaluation. Journal of Economic Literature, 47(1), 5–86.doi:10.1257/jel.47.1.5

125.

Jick

T. D

. (1979). Mixing qualitative and quantitative methods: Triangulation in action. Administrative Science Quarterly, 24(4), 602–611.

126.

Keele

Tingley

Yamamoto

. (2015). Identifying mechanisms behind policy interventions via causal mediation analysis. Journal of Policy Analysis and Management, 34(4), 937–963.doi:10.1002/pam.21853

127.

Kenny

D. A

. (1979). Correlation and causality. Wiley.

128.

Ketokivi

McIntosh

C. N

. (2017). Addressing the endogeneity dilemma in operations management research: Theoretical, empirical, and pragmatic considerations. Journal of Operations Management, 52(1), 1–14.doi:10.1016/j.jom.2017.05.001

129.

King

Nielsen

. (2019). Why propensity scores should not be used for matching. Political Analysis, 27(4), 435–454.doi:10.1017/pan.2019.11

130.

King

Tomz

Wittenberg

. (2000). Making the most of statistical analyses: Improving interpretation and presentation. American Journal of Political Science, 44(2), 347–361.doi:10.2307/2669316

131.

Kirkman

B. L.

Chen

. (2011). Maximizing your data or data slicing? recommendations for managing multiple submissions from the same dataset. Management and Organization Review, 7(3), 433–446.doi:10.1111/j.1740-8784.2011.00228.x

132.

Koenker

Hallock

K. F

. (2001). Quantile regression. Journal of Economic Perspectives, 15(4), 143–156.doi:10.1257/jep.15.4.143

133.

Kolkman

van Witteloostuijn

. (2019). Data science in strategy: Machine learning and text analysis in the study of firm growth. Tinbergen Institute Discussion Paper TI 2019-066/VI.

134.

Kriauciunas

Parmigiani

Rivera-Santos

. (2011). Leaving our comfort zone: Integrating established practices with unique adaptations to conduct survey-based strategy research in nontraditional contexts. Strategic Management Journal, 32(9), 994–1010.doi:10.1002/smj.921

135.

Krueger

J. I.

Heck

P. R

. (2019). Putting the p-value in its place. The American Statistician, 73(sup1), 122–128.doi:10.1080/00031305.2018.1470033

136.

Kuhn

T. S

. (1962). The structure of scientific revolutions. University of Chicago.

137.

Lahti

Halko

M. -L.

Karagozoglu

Wincent

. (2019). Why and how do founding entrepreneurs bond with their ventures? neural correlates of entrepreneurial and parental bonding. Journal of Business Venturing, 34(2), 368–388.doi:10.1016/j.jbusvent.2018.05.001

138.

Laitin

D. D.

Reich

. (2017). Trust, transparency, and replication in political science. Political Science and Politics, 50(1), 172–175.doi:10.1017/S1049096516002365

139.

Lance

C. E.

Vandenberg

R. J.

. (Eds.). (2009). Statistical and methodological myths and urban legends: Doctrine, verity and fable in the organizational and social sciences: Routledge.

140.

Landers

R. N.

Brusso

R. C.

Cavanaugh

K. J.

Collmus

A. B

. (2016). A primer on theory-driven web scraping: Automatic extraction of big data from the Internet for use in psychological research. Psychological Methods, 21(4), 475–492.doi:10.1037/met0000081

141.

Laureiro-Martínez

Brusoni

Canessa

Zollo

. (2015). Understanding the exploration–exploitation dilemma: An fMRI study of attention control and decision-making performance. Strategic Management Journal, 36(3), 319–338.doi:10.1002/smj.2221

142.

Lechner

. (2011). The estimation of causal effects by difference-in-difference methods. Foundations and Trends® in Econometrics, 4(3), 165–224.

143.

Lee

Hwang

Che

. (2017). Are founder CEOs more overconfident than professional CEOs? Evidence from S&P 1500 companies. Strategic Management Journal, 38, 751–769.

144.

Levie

Autio

Acs

Hart

. (2014). Global entrepreneurship and institutions: An introduction. Small Business Economics, 42(3), 437–444.doi:10.1007/s11187-013-9516-6

145.

Levine

S. S

. (2018). Show us your data: Connect the dots, improve science. Management and Organization Review, 14(2), 433–437.doi:10.1017/mor.2018.19

146.

Levitt

S. D.

List

J. A

. (2009). Field experiments in economics: The past, the present, and the future. European Economic Review, 53(1), 1–18.doi:10.1016/j.euroecorev.2008.12.001

147.

Lewin

A. Y.

Chiu

C. -Y.

Fey

C. F.

Levine

S. S.

McDermott

Murmann

J. P.

Tsang

. (2016). The critique of empirical social science: New policies at management and organization review . Management and Organization Review, 12(4), 649–658.doi:10.1017/mor.2016.43

148.

Lindsay

D. S

. (2015). Replication in psychological science. Psychological Science, 26(12), 1827–1832.doi:10.1177/0956797615616374

149.

Lohrke

F. T.

Carson

C. M.

Lockamy

. (2018). Bayesian analysis in entrepreneurship decision-making research: Review and future directions. Management Decision, 56(5), 972–986.

150.

Long

J. S

. (2009). The workflow of data analysis using Stata. Stata Press.

151.

Low

Meghir

. (2017). The use of structural models in econometrics. Journal of Economic Perspectives, 31(2), 33–58.doi:10.1257/jep.31.2.33

152.

MacKinnon

D. P

. (2008). Introduction to statistical mediation analysis. Erlbaum.

153.

Mathieu

J. E.

Chen

. (2011). The etiology of the multilevel paradigm in management research. Journal of Management, 37(2), 610–641.doi:10.1177/0149206310364663

154.

Matthews

R. A. J

. (2019). Moving towards the post p < 0.05 era via the analysis of credibility. The American Statistician, 73(sup1), 202–212.

155.

McArdle

J. J

. (2009). Latent variable modeling of differences and changes with longitudinal data. Annual Review of Psychology, 60(1), 577–605.doi:10.1146/annurev.psych.60.110707.163612

156.

McCann

B. T.

Schwab

. (2019). Bayesian analysis in strategic management research: Time to update your priors. Strategic Management Review, Forthcoming.

157.

McKenny

A. F.

Aguinis

Short

J. C.

Anglin

A. H

. (2018). What doesn’t get measured does exist: Improving the accuracy of computer-aided text analysis. Journal of Management, 44(7), 2909–2933.doi:10.1177/0149206316657594

158.

McNeish

. (2018). Thanks coefficient alpha, we’ll take it from here. Psychological Methods, 23(3), 412–433.doi:10.1037/met0000144

159.

McShane

B. B.

Gal

Gelman

Robert

Tackett

J. L

. (2019). Abandon statistical significance. The American Statistician, 73(sup1), 235–245.doi:10.1080/00031305.2018.1527253

160.

Mellor

D. T.

Nosek

B. A

. (2018). Easy preregistration will benefit any research. Nature Human Behaviour, 2(2), 98–98.doi:10.1038/s41562-018-0294-7

161.

Meyer

K. E.

van Witteloostuijn

Beugelsdijk

. (2017). What’s in a p? Reassessing best practices for conducting and reporting hypothesis-testing research. Journal of International Business Studies, 48(5), 535–551.doi:10.1057/s41267-017-0078-8

162.

Miguel

Camerer

Casey

Cohen

Esterling

K. M.

Gerber

Glennerster

Green

D. P.

Humphreys

Imbens

Laitin

Madon

Nelson

Nosek

B. A.

Petersen

Sedlmayr

Simmons

J. P.

Simonsohn

Van der Laan

. (2014). Social science. promoting transparency in social science research. Science, 343(6166), 30–31.doi:10.1126/science.1245317

163.

Mitchell

M. N

. (2010). Data management using stata: A practical handbook. Stata Press.

164.

Mize

T. D

. (2019). Best practices for estimating, interpreting, and presenting nonlinear interaction effects. Sociological Science, 6, 81–117.doi:10.15195/v6.a4

165.

Molina-Azorin

J. F.

Bergh

D. D.

Corley

K. G.

Ketchen

D. J

. (2017). Mixed methods in the organizational sciences. Organizational Research Methods, 20(2), 179–192.doi:10.1177/1094428116687026

166.

Molina-Azorín

J. F.

López-Gamero

M. D.

Pereira-Moliner

Pertusa-Ortega

E. M

. (2012). Mixed methods studies in entrepreneurship research: Applications and contributions. Entrepreneurship & Regional Development, 24(5-6), 425–456.doi:10.1080/08985626.2011.603363

167.

Morgan

S. L.

Winship

. (2007). Counterfactuals and causal inference: Methods and principles for social research. Cambridge University Press.

168.

Mullainathan

Spiess

. (2017). Machine learning: An applied econometric approach. Journal of Economic Perspectives, 31(2), 87–106.doi:10.1257/jep.31.2.87

169.

Mundlak

. (1978). On the pooling of time series and cross section data. Econometrica, 46(1), 69–85.doi:10.2307/1913646

170.

Newman

D. A

. (2014). Missing data: Five practical guidelines. Organizational Research Methods, 17(4), 372–411.

171.

Nofal

Nicolaou

Symeonidou

. (2017). Biology and entrepreneurship. In Ahmetoglu

Chamorro‐Premuzic

Klinger

Karcisky

(Eds.), The Wiley handbook of entrepreneurship (pp. 259–272). Chichester, UK: John Wiley & Sons Ltd.

172.

Nosek

B. A.

Alter

Banks

G. C.

Borsboom

Bowman

S. D.

Breckler

S. J.

Buck

Chambers

C. D.

Chin

Christensen

Contestabile

Dafoe

Eich

Freese

Glennerster

Goroff

Green

D. P.

Hesse

Humphreys

Yarkoni

. (2015). Promoting an open research culture. Science, 348(6242), 1422–1425.doi:10.1126/science.aab2374

173.

Obschonka

Fisch

Boyd

. (2017). Using digital footprints in entrepreneurship research: A Twitter-based personality analysis of superstar entrepreneurs and managers. Journal of Business Venturing Insights, 8, 13–23.doi:10.1016/j.jbvi.2017.05.005

174.

Open Science Collaboration (2015). Psychology. estimating the reproducibility of psychological science. Science, 349(6251), aac4716.doi:10.1126/science.aac4716

175.

Pearl

. (1995). Causal diagrams for empirical research. Biometrika, 4(1), 669–688.

176.

Pearl

. (2009). Causality: Models, reasoning, and inference (2nd ed.). Cambridge University Press.

177.

Pearl

. (2012). The causal foundations of structural equation modeling. In Hoyle

R. H.

(Ed.), Handbook of structural equation modeling (pp. 68–91). Guilford Press.

178.

Pearl

Mackenzie

. (2018). The book of why: The new science of cause and effect. Basic Books.

179.

Pearl

Glymour

Jewell

N. P

. (2016). Causal inference in statistics: A primer. John Wiley & Sons.

180.

Ployhart

R. E.

Vandenberg

R. J

. (2010). Longitudinal research: The theory, design, and analysis of change. Journal of Management, 36(1), 94–120.doi:10.1177/0149206309352110

181.

Podsakoff

P. M.

MacKenzie

S. B.

Podsakoff

N. P

. (2012). Sources of method bias in social science research and recommendations on how to control it. Annual Review of Psychology, 63(1), 539–569.doi:10.1146/annurev-psych-120710-100452

182.

Podsakoff

P. M.

MacKenzie

S. B.

Podsakoff

N. P

. (2016). Recommendations for creating better concept definitions in the organizational, behavioral, and social sciences. Organizational Research Methods, 19(2), 159–203.doi:10.1177/1094428115624965

183.

Podsakoff

P. M.

MacKenzie

S. B.

Lee

J. -Y.

Podsakoff

N. P

. (2003). Common method biases in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology, 88(5), 879–903.doi:10.1037/0021-9010.88.5.879

184.

Popper

K. R

. (1959). The logic of scientific discovery. Basic Books.

185.

Prüfer

. (2019). Data science for entrepreneurship research: Studying demand dynamics for entrepreneurial skills in the Netherlands. Small Business Economics, 54(2).doi:10.1007/s11187-019-00208-y

186.

Rabe-Hesketh

Skrondal

. (2012). Multilevel and longitudinal modeling using stata. Stata Press.

187.

Reynolds

P. D

. (2007). New firm creation in the United States a PSED I overview. Foundations and Trends® in Entrepreneurship, 3(1), 1–150.

188.

Reynolds

P. D.

Bosma

Autio

Hunt

De Bono

Servais

Lopez-Garcia

Chin

. (2005). Global entrepreneurship monitor: Data collection design and implementation 1998–2003. Small Business Economics, 24(3), 205–231.doi:10.1007/s11187-005-1980-1

189.

Richardson

H. A.

Simmering

M. J.

Sturman

M. C

. (2009). A tale of three perspectives: Examining post hoc statistical techniques for detection and correction of common method variance. Organizational Research Methods, 12(4), 762–800.

190.

Roberts

M. R.

Whited

T. M

. (2013). Endogeneity in empirical corporate finance. In Constantinides

G. M.

Harris

Stulz

R. M.

(Eds.), Handbook of the economics of finance (Vol. 2 , pp. 493–572). Elsevier.

191.

Rohrer

J. M

. (2018). Thinking clearly about correlations and causation: Graphical causal models for observational data. Advances in Methods and Practices in Psychological Science, 1(1), 27–42.doi:10.1177/2515245917745629

192.

Royston

. (2013). Marginscontplot: Plotting the marginal effects of continuous predictors. Stata Journal, 13(3), 510–527.doi:10.1177/1536867X1301300305

193.

Rubin

D. B

. (1974). Estimating causal effects of treatments in randomized and nonrandomized studies. Journal of Educational Psychology, 66(5), 688–701.doi:10.1037/h0037350

194.

Rubin

D. B

. (2005). Causal inference using potential outcomes: Design, modeling, decisions. Journal of the American Statistical Association, 100(469), 322–331.

195.

Schunck

Perales

. (2017). Within- and between-cluster effects in generalized linear mixed models: A discussion of approaches and the xthybrid command. Stata Journal, 17(1), 89–115.doi:10.1177/1536867X1701700106

196.

Schwab

. (2015). Why all researchers should report effect sizes and their confidence intervals: Paving the way for meta–analysis and evidence–based management practices. Entrepreneurship Theory and Practice, 39(4), 719–725.doi:10.1111/etap.12158

197.

Schwab

. (2018). Investigating and communicating the uncertainty of effects: The power of graphs. Entrepreneurship Theory and Practice, 42(6), 823–834.doi:10.1177/1042258717753126

198.

Schwab

Zhang

. (2019). A new methodological frontier in entrepreneurship research: Big data studies. Entrepreneurship Theory and Practice, 43(5), 843–854.

199.

Schwab

Abrahamson

Starbuck

W. H.

Fidler

. (2011). Researchers should make thoughtful assessments instead of null-hypothesis significance tests. Organization Science, 22(4), 1105–1120.doi:10.1287/orsc.1100.0557

200.

Semadeni

Withers

M. C.

Certo

T. S

. (2014). The perils of endogeneity and instrumental variables in strategy research: Understanding through simulations. Strategic Management Journal, 35(7), 1070–1079.doi:10.1002/smj.2136

201.

Shadish

W. R.

Cook

T. D.

Campbell

D. T

. (2002). Experimental and quasi-experimental designs for generalized causal inference. Houghton Mifflin.

202.

Shaver

J. M

. (2019). Interpreting interactions in linear fixed-effect regression models: When fixed-effect estimates are no longer within-effects. Strategy Science, 4(1), 25–40.doi:10.1287/stsc.2018.0065

203.

Short

J. C.

Broberg

J. C.

Cogliser

C. C.

Brigham

K. H

. (2010). Construct validation using computer-aided text analysis (CATA): An illustration using entrepreneurial orientation. Organizational Research Methods, 13(2), 320–347.

204.

Short

J. C.

Ketchen

D. J.

Combs

J. G.

Ireland

R. D

. (2010). Research methods in entrepreneurship: Opportunities and challenges. Organizational Research Methods, 13(1), 6–15.

205.

Shrout

P. E.

Rodgers

J. L

. (2018). Psychology, science, and knowledge construction: Broadening perspectives from the replication crisis. Annual Review of Psychology, 69(1), 487–510.doi:10.1146/annurev-psych-122216-011845

206.

Singleton

Straits

B. C

. (2017). Approaches to social research (6th ed.). Oxford University Press.

207.

Spector

P. E.

Brannick

M. T

. (2011). Methodological urban legends: The misuse of statistical control variables. Organizational Research Methods, 14(2), 287–305.doi:10.1177/1094428110369842

208.

Starbuck

W. H

. (2016). 60th Anniversary essay: How journals could improve research practices in social science. Administrative Science Quarterly, 61(2), 165–183.

209.

Stata . (2018). Stata extended regression models reference manual release 15. Stata Press.

210.

Stevenson

R. M.

Josefy

. (2019). Knocking at the gate: The path to publication for entrepreneurship experiments through the lens of gatekeeping theory. Journal of Business Venturing, 34(2), 242–260.doi:10.1016/j.jbusvent.2018.10.008

211.

Tarasconi

Menon

. (2017). Matching crunchbase with patent data. OECD Science, Technology and Industry ( Working Papers, No. 2017/07 ). OECD Publishing.

212.

Tay

Malik

Zhang

Chae

Ebert

D. S.

Ding

Zhao

Kern

. (2018). Big data visualizations in organizational science. Organizational Research Methods, 21(3), 660–688.doi:10.1177/1094428117720014

213.

Tingley

Yamamoto

Hirose

Keele

Imai

. (2014). Mediation: R package for causal mediation analysis. Journal of Statistical Software, 59(5), 1–38.doi:10.18637/jss.v059.i05

214.

Tonidandel

King

E. B.

Cortina

J. M

. (2018). Big data methods: Leveraging modern data analytic techniques to build organizational science. Organizational Research Methods, 21(3), 525–547.

215.

Toraldo

M. L.

Islam

Mangia

. (2018). Modes of knowing: Video research and the problem of elusive knowledges. Organizational Research Methods, 21(2), 438–465.

216.

Turner

S. F.

Cardinal

L. B.

Burton

R. M

. (2017). Research design for mixed methods. Organizational Research Methods, 20(2), 243–267.doi:10.1177/1094428115610808

217.

Van de Ven

A. H.

Johnson

P. E

. (2006). Knowledge for theory and practice. Academy of Management Review, 31(4), 802–821.doi:10.5465/amr.2006.22527385

218.

Vandekerckhove

Rouder

J. N.

Kruschke

J. K

. (2018). Editorial: Bayesian methods for advancing psychological science. Psychonomic Bulletin & Review, 25(1), 1–4.doi:10.3758/s13423-018-1443-8

219.

Vermeulen

. (2005). On rigor and relevance: Fostering dialectic progress in management research. Academy of Management Journal, 48(6), 978–982.doi:10.5465/amj.2005.19573102

220.

Wasserstein

R. L.

Lazar

N. A

. (2016). The ASA’s statement on p-values: Context, process, and purpose. The American Statistician, 70(2), 129–133.doi:10.1080/00031305.2016.1154108

221.

Wasserstein

R. L.

Schirm

A. L.

Lazar

N. A

. (2019). Moving to a world beyond “p < 0.05”. The American Statistician, 73(sup1), 1–19.

222.

Wennberg

. (2005). Entrepreneurship research through databases: Measurement and design issues. New England Journal of Entrepreneurship, 8(2), 9–19.doi:10.1108/NEJE-08-02-2005-B002

223.

Wennberg

Anderson

B. S

. (2019). Editorial: Enhancing the exploration and communication of quantitative entrepreneurship research. Journal of Business Venturing, .doi:10.1016/j.jbusvent.2019.05.002

224.

Wenzel

Van Quaquebeke

. (2018). The double-edged sword of big data in organizational and management research: A review of opportunities and risks. Organizational Research Methods, 21(3), 548–591.

225.

Wiersema

M. F.

Bowen

H. P

. (2009). The use of limited dependent variable techniques in strategy research: Issues and methods. Strategic Management Journal, 30(6), 679–692.doi:10.1002/smj.758

226.

Wiklund

Davidsson

Audretsch

D. B.

Karlsson

. (2011). The future of entrepreneurship research. Entrepreneurship Theory and Practice, 35(1), 1–9.doi:10.1111/j.1540-6520.2010.00420.x

227.

Williams

D. W.

Wood

M. S.

Mitchell

J. R.

Urbig

. (2019). Applying experimental methods to advance entrepreneurship research: On the need for and publication of experiments. Journal of Business Venturing, 34(2), 215–223.doi:10.1016/j.jbusvent.2018.12.003

228.

Williams

. (2012). Using the margins command to estimate and interpret adjusted predictions and marginal effects. Stata Journal, 12(2), 308–331.doi:10.1177/1536867X1201200209

229.

Wilson

Aruliah

D. A.

Brown

C. T.

Chue Hong

N. P.

Davis

Guy

R. T.

Haddock

S. H. D.

Huff

K. D.

Mitchell

I. M.

Plumbley

M. D.

Waugh

White

E. P.

Wilson

. (2014). Best practices for scientific computing. PLoS Biology, 12(1), e1001745.doi:10.1371/journal.pbio.1001745

230.

Wooldridge

J. M

. (2010). Econometric analysis of cross section and panel data (2nd ed.). MIT press.

231.

Wooldridge

J. M

. (2015). Introductory econometrics: A modern approach. Cengage Education.

232.

Wulff

J. N

. (2015). Interpreting results from the multinomial logit model: Demonstrated by foreign market entry. Organizational Research Methods, 18(2), 300–325.

233.

Wunsch

Russo

Mouchart

. (2010). Do we necessarily need longitudinal data to infer causal relations? Bulletin of Sociological Methodology, 106(1), 5–18.doi:10.1177/0759106309360114

234.

Zelner

B. A

. (2009). Using simulation to interpret results from logit, probit, and other nonlinear models. Strategic Management Journal, 30(12), 1335–1348.doi:10.1002/smj.783

235.

Zhang

Y. A. N.

Shaw

J. D

. (2012). Publishing in AMJ—Part 5: Crafting the methods and results. Academy of Management Journal, 55(1), 8–12.doi:10.5465/amj.2012.4001

236.

Zundel

MacIntosh

Mackay

. (2018). The utility of video diaries for organizational research. Organizational Research Methods, 21(2), 386–411.doi:10.1177/1094428116665463

237.

Zyphur

M. J.

Oswald

F. L

. (2015). Bayesian estimation and inference: A user’s guide. Journal of Management, 41(2), 390–420.