Although many have recognized the value of computer simulations as a research tool, instruction on building computer simulations is absent from most doctoral education and research methods texts. This paper provides an introductory tutorial on computer simulations for research and teaching. It shows the techniques needed to create data based on desired relationships among the variables or based on a specified model. The paper also introduces techniques to make data more “interesting,” including adding skew or kurtosis, creating multi-item measures with unreliability, making data multilevel, and incorporating mediated, moderated, and nonlinear relationships. The methods described in the paper are illustrated using Excel, Mplus, and R; furthermore, the functionality of using ChatGPT to create code in R is explored and compared to the paper's illustrative examples. Supplemental files are provided that illustrate each example used in the paper as well as several more advanced techniques mentioned in the paper. The goal of this paper is not to help inform experts on simulation; rather, it is to open up to all readers the powerful potential of this research and teaching tool.
AguinisH.GottfredsonR. K. (2010). Best-practice recommendations for estimating interaction effects using moderated multiple regression. Journal of Organizational Behavior, 31(6), 776–786. https://doi.org/10.1002/job.686
2.
AguinisH.PierceC. A.CulpepperS. A. (2009). Scale coarseness as a methodological artifact: Correcting correlation coefficients attenuated from using coarse scales. Organizational Research Methods, 12(4), 623–652. https://doi.org/10.1177/1094428108318065
3.
AguinisH.SturmanM. C.PierceC. A. (2008). Comparison of three meta-analytic procedures for estimating moderating effects of categorical variables. Organizational Research Methods, 11(1), 9–34. https://doi.org/10.1177/1094428106292896
4.
AvenaliA.DaraioC.Di LeoS.MatteucciG.NepomucenoT. (2023). Systematic reviews as a metaknowledge tool: Caveats and a review of available options. International Transactions in Operational Research, 30(6), 2761–2806. https://doi.org/10.1111/itor.13309
5.
BallardT.PaladaH.GriffinM.NealA. (2021). An integrated approach to testing dynamic, multilevel theory: Using computational models to connect theory, model, and data. Organizational Research Methods, 24(2), 251–284. https://doi.org/10.1177/1094428119881209
6.
BedeianA. G.SturmanM. C.StreinerD. L. (2009). Decimal dust, significant digits, and the search for stars. Organizational Research Methods, 12(4), 687–694. https://doi.org/10.1177/1094428108321153
7.
BoscoF. A.AguinisH.SinghK.FieldJ. G.PierceC. A. (2015). Correlational effect size benchmarks. Journal of Applied Psychology, 100(2), 431–449. https://doi.org/10.1037/a0038047
8.
BrudererE.SinghJ. V. (1996). Organizational evolution, learning, and selection: A genetic-algorithm-based model. Academy of Management Journal, 39(5), 1322–1349. https://doi.org/10.2307/257001
9.
BudhwarP.ChowdhuryS.WoodG.AguinisH.BamberG. J.BeltranJ. R.BoselieP.Lee CookeF.DeckerS.DeNisiA.DeyP. K.GuestD.KnoblichA. J.MalikA.PaauweJ.PapagiannidisS.PatelC.PereiraV.RenS.RogelbergS.SaundersM. N. K.TungR. L.VarmaA. (2023). Human resource management in the age of generative artificial intelligence: Perspectives and research directions on ChatGPT. Human Resource Management Journal, 33(3), 606–659. https://doi.org/10.1111/1748-8583.12524
10.
BurgerB.KanbachD. K.KrausS.BreierM.CorvelloV. (2023). On the use of AI-based tools like ChatGPT to support management research. European Journal of Innovation Management, 26(7), 233–241. https://doi.org/10.1108/EJIM-02-2023-0156
11.
Commandant Benoit (1924). Note sur une méthode de résolution des équations normales provenant de l'application de la méthode des moindres carrés à un système d'équations linéaires en nombre inférieur à celui des inconnues (Procédé du Commandant Cholesky). Bulletin Géodésique, 2(1), 67–77. https://doi.org/10.1007/BF03031308
12.
D'AmicoR. S.WhiteT. G.ShahH. A.LangerD. J. (2023). I asked a ChatGPT to write an editorial about how we can incorporate chatbots into neurosurgical research and patient care…. Neurosurgery, 92(4), 663–664.
13.
DavisJ. P.EisenhardtK. M.BinghamC. B. (2007). Developing theory through simulation methods. Academy of Management Review, 32(2), 480–499. https://doi.org/10.5465/amr.2007.24351453
HallJ. A.RosenthalR. (1991). Testing for moderator variables in meta-analysis: Issues and methods. Communications Monographs, 58(4), 437–448. https://doi.org/10.1080/03637759109376240
16.
HarrisonJ. R.LinZ.CarrollG. R.CarleyK. M. (2007). Simulation modeling in organizational and management research. Academy of Management Review, 32(4), 1229–1245. https://doi.org/10.5465/amr.2007.26586485
17.
HoaglinD. C. (2011). Summarizing shape numerically: The g-and-h distributions. In D. C. Hoaglin, F. Mosteller, & J. W. Tukey (Eds.), Exploring data tables, trends, and shapes (Chapter 11, pp. 461–514). John Wiley & Sons.
18.
JohnstonN. (2021). Advanced linear and matrix algebra. Springer Nature.
19.
KleinA.MoosbruggerH. (2000). Maximum likelihood estimation of latent interaction effects with the LMS method. Psychometrika, 65(4), 457–474. https://doi.org/10.1007/BF02296338
20.
LomiA.LarsenE. R. (1996). Interacting locally and evolving globally: A computational approach to the dynamics of organizational populations. Academy of Management Journal, 39(5), 1287–1321. https://doi.org/10.2307/257000
21.
MaddenT. M.MaddenL. T.RousseauM. B.WoehrD. J. (2016). Developing depth and breadth of research methods training for doctoral students with CARMA webcasts. The International Journal of Management Education, 14(3), 368–378. https://doi.org/10.1016/j.ijme.2016.07.003
22.
MatsumotoM.NishimuraT. (1998). Mersenne twister: A 623-dimensionally equidistributed uniform pseudo-random number generator. ACM Transactions on Modeling and Computer Simulation (TOMACS), 8(1), 3–30. https://doi.org/10.1145/272991.272995
23.
MoonanW. J. (1957). Linear transformation to a set of stochastically dependent normal variables. Journal of the American Statistical Association, 52(278), 247–252. https://doi.org/10.1080/01621459.1957.10501383
ParkS.SturmanM. C.VanderpoolC.ChanE. (2015). Only time will tell: The changing relationships between LMX, job performance, and justice. Journal of Applied Psychology, 100(3), 660–680. https://doi.org/10.1037/a0038907
29.
PedhazurE. J.SchmelkinL. P. (1991). Measurement, design, and analysis: An integrated approach (1st ed.). Psychology Press.
30.
PetersC. C.van VoorhisW. R. (1940). Statistical procedures and their mathematical bases. McGraw-Hill.
31.
R Core Team (2020). R: A language and environment for statistical computing. R Foundation for Statistical Computing. https://www.R-project.org/
32.
RichardsonH. A.SimmeringM. J.SturmanM. C. (2009). A tale of three perspectives: Examining post hoc statistical techniques for detection and correction of common method variance. Organizational Research Methods, 12(4), 762–800. https://doi.org/10.1177/1094428109332834
33.
RunkelP. J.McGrathJ. E. (1972). Research on human behavior: A systematic guide to method. Holt, Rinehart & Winston.
34.
SchwabD. P. (2005). Research methods for organizational studies (2nd ed.). Psychology Press.
35.
SturmanM. C.SturmanA. J.SturmanC. J. (2022). Uncontrolled control variables: The extent that a researcher’s degrees of freedom with control variables increases various types of statistical errors. Journal of Applied Psychology, 107(1), 9–22.
36.
TukeyJ. W. (1977). Modern techniques in data analysis. NSF-sponsored regional research conference at Southeastern Massachusetts University, North Dartmouth, MA.
37.
VancouverJ. B.WeinhardtJ. M.SchmidtA. M. (2010). A formal, computational theory of multiple-goal pursuit: Integrating goal-choice and goal-striving processes. Journal of Applied Psychology, 95(6), 985–1008. https://doi.org/10.1037/a0020628
38.
VenablesW. N.RipleyB. D. (2002). Modern applied statistics with S (4th ed.). Springer.
39.
VignaS. (2021). xoshiro/xoroshiro generators and the PRNG shootout. Retrieved October 5, 2021. https://prng.di.unimi.it/
40.
WinsbergE. (2010). Science in the age of computer simulation. University of Chicago Press.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
