When first learning Bayesian statistics, the organizational scholar may be confronted by a number of conceptual and practical challenges. The present article seeks to minimize these by first explicating how the Bayesian process can be understood simply as the combination of two complementary sources of information: prior beliefs and data. In turn, we describe how each source is derived from Bayes’s theorem and mathematically formalized, essential knowledge for the Bayesian analyst. However, the beginner can also be undermined by practical difficulties such as software implementation. To this end, we offer a walkthrough of how a Bayesian logistic regression model is coded within BugsXLA, a user-friendly Excel add-in for Bayesian estimation. The data for this example come from a previously published study that identified a subpopulation of “job hobos,” individuals characterized by their frequent voluntary turnover and positive attitudes toward quitting. In the original frequentist analysis, exploring the predictors of hoboism proved to be inefficient and inconclusive. We contrast this standard approach with Bayesian estimation, whose results provide rich and novel insights on the topic.
AdelsonE. H.PentlandA. P. (1996). The perception of shading and reflectance. In KnillD.RichardsW. (Eds.), Perception as Bayesian inference (pp. 409–423). Cambridge, UK: Cambridge University Press.
2.
AndersonD. R.LinkW. A.JohnsonD. H.BurnhamK. P. (2001). Suggestions for presenting the results of data analyses. Journal of Wildlife Management, 65, 373–378. doi:10.2307/3803088
3.
BayarriM. J.BergerJ. O. (2004). The interplay of Bayesian and frequentist analysis. Statistical Science, 19, 58–80.
4.
BergerJ. (2003). Could Fisher, Jeffreys, and Neyman have agreed on testing?Statistical Science, 18, 1–32.
5.
BergerJ. O.BerryD. A. (1988). Statistical analysis and the illusion of objectivity. American Scientist, 76, 159–165.
6.
BergerJ. O.BoukaiB.WangY. (1997). Unified frequentist and Bayesian testing of a precise hypothesis. Statistical Science, 12, 133–160.
7.
BergerJ. O.BrownL. D.WolpertR. L. (1994). A unified conditional frequentist and Bayesian test for fixed and sequential simple hypothesis testing. Annals of Statistics, 22, 1787–1807.
8.
BoltonL. R.BeckerL. K.BarberL. K. (2010). Big Five trait predictors of differential counterproductive work behavior dimensions. Personality and Individual Differences, 49, 537–541.
9.
BurdetteW. J.GehanE. A. (1970). Planning and analysis of clinical studies. Springfield, IL: Charles C Thomas.
10.
CohenJ. (1962). The statistical power of abnormal-social psychological research: A review. Journal of Abnormal and Social Psychology, 65, 145–153.
11.
CohenJ. (1994). The earth is round (p < .05). American Psychologist, 49, 997–1003.
12.
CourvilleA. C.DawN. D.TouretzkyD. S. (2006). Bayesian theories of conditioning in a changing world. Trends in Cognitive Science, 10, 294–300.
13.
CulpepperS. A.AguinisH. (2011). R is for revolution: A cutting-edge, free, open source statistical package. Organizational Research Methods, 14, 735–740.
14.
CummingG. (2012). Understanding the new statistics: Effect sizes, confidence intervals, and meta-analysis. New York, NY: Routledge.
15.
CummingG. (2014). The new statistics: Why and how. Psychological Science, 25, 7–29. doi:10.1177/0956797613504966
16.
DienesZ. (2011). Bayesian versus orthodox statistics: Which side are you on?Perspectives on Psychological Science, 6, 274–290.
17.
DilchertS.OnesD. S.DavisR. D.RostowC. D. (2007). Cognitive ability predicts objectively measured counterproductive work behaviors. Journal of Applied Psychology, 27, 616–627.
18.
DunsonD. B. (2001). Commentary: Practical advantages of Bayesian analysis of epidemiologic data. American Journal of Epidemiology, 153, 1222–1226.
19.
FanelliD. (2012). Negative results are disappearing from most disciplines and countries. Scientometrics, 90, 891–904. doi:10.1007/s11192-011-0494-7
20.
FeldmanJ. (2001). Bayesian contour integration. Perception and Psychophysics, 63, 1171–1182.
21.
FisherR. A. (1935). The design of experiments. Edinburgh, UK: Oliver & Boyd.
22.
FisherR. A. (1955). Statistical methods and scientific induction. Journal of the Royal Statistical Society, 17, 69–77.
23.
FisherR. A. (1956). Statistical methods and scientific inference. Edinburgh, UK: Oliver & Boyd.
24.
GelfandA. E.SmithA. M. (1990). Sampling-based approaches to calculating marginal densities. Journal of the American Statistical Association, 85, 398–409.
25.
GelmanA. (2008). Objections to Bayesian statistics. Bayesian Analysis, 3, 445–450.
26.
GelmanA.CarlinJ. B.SternH. S.RubinD. B. (2004). Bayesian data analysis (2nd ed.). Boca Raton, FL: CRC Press.
27.
GelmanA.RubinD. B. (1992). Inference from iterative simulation using multiple sequences. Statistical Science, 7, 457–511.
28.
GhiselliE. E. (1974). Some perspectives for industrial psychology. American Psychologist, 80, 80–87.
29.
GigerenzerG. (2004). Mindless statistics. Journal of Socio-Economics, 33, 587–606.
30.
GigerenzerG.KraussS.VitouchO. (2004). The null ritual: What you always wanted to know about null hypothesis testing but were afraid to ask. In KaplanD. (Ed.), Handbook on quantitative methods in the social sciences (pp. 389–406). Thousand Oaks, CA: Sage.
31.
GillJ. (2002). Bayesian methods: A social and behavioral science approach. Boca Raton, FL: Chapman & Hall.
32.
GoodP. I. (1999). Resampling methods: A practical guide to data analysis. Boston, MA: Birkhauser.
33.
GriffithsT. L.SteyversM.TenenbaumJ. B. (2007). Topics in semantic association. Psychological Review, 114, 211–44.
34.
GriffithsT. L.TenenbaumJ. B. (2005). Structure and strength in causal induction. Cognitive Psychology, 51, 354–384.
35.
HoekstraR.FinchS.KiersH.JohnsonA. (2006). Probability as certainty: Dichotomous thinking and the misuse of p values. Psychonomic Bulletin & Review, 13, 1033–1037.
36.
HowellD. C. (2013). Statistical methods for psychology. Belmont, CA: Cengage.
37.
HowsonC.UrbachP. (1991). Bayesian reasoning in science. Nature, 350, 371–374.
38.
HubbardR.BayarriM. J. (2003). Confusion over measures of evidence (p’s) versus errors (α’s) in classical statistical testing. American Statistician, 57, 171–182.
JackmanS. D. (2000). Estimation and inference via Bayesian simulation: An introduction to Markov chain Monte Carlo. American Journal of Political Science, 44, 375–404.
41.
KepesS.McDanielM. A. (2013). How trustworthy is the scientific literature in I-O psychology?Industrial and Organizational Psychology: Perspectives on Science and Practice, 6, 252–268.
42.
KruschkeJ. K. (2010a). Bayesian data analysis. Wiley Interdisciplinary Reviews: Cognitive Science, 1, 658–676.
43.
KruschkeJ. K. (2010b). What to believe: Bayesian methods for data analysis. Trends in Cognitive Sciences, 14, 293–300.
44.
KruschkeJ. K. (2011). Doing Bayesian data analysis: A tutorial with R and BUGS. Burlington, MA: Academic Press.
45.
KruschkeJ. K. (2013). Bayesian estimation supersedes the t-test. Journal of Experimental Psychology: General, 142, 573–603.
46.
KruschkeJ. K.AguinisH.JooH. (2012). The time has come: Bayesian methods for data analysis in the organizational sciences. Organizational Research Methods, 15, 722–752.
47.
LeH.OhI. S.ShafferJ.SchmidtF. (2007). Implications of methodological advances for the practice of personnel selection: How practitioners benefit from meta-analysis. Academy of Management Perspectives, 21, 6–15.
48.
LeeM. D.WagenmakersE. J. (2005). Bayesian statistical inference in psychology: Comment on Trafimow (2003). Psychological Review, 112, 662–668.
49.
LoredoT. J. (1992). The promise of Bayesian inference for astrophysics. In FeigelsonE. D.BabuG. J. (Eds.), Statistical challenges in modern astronomy (pp. 275–297). New York, NY: Springer-Verlag.
50.
LunnD. J.ThomasA.BestN.SpiegelhalterD. (2000). WinBUGS: A Bayesian modelling framework: Concepts, structure, and extensibility. Statistics and Computing, 10, 325–337.
51.
LunnD.JacksonC.BestN.ThomasA.SpiegelhalterD. (2012). The BUGS book: A practical introduction to Bayesian analysis. Boca Raton, FL: Chapman & Hall/CRC Press.
52.
LynchS. M. (2007). Introduction to applied Bayesian statistics and estimation for social scientists. New York, NY: Springer.
53.
MaertzC. P.JrGriffethR. W. (2004). Eight motivational forces and voluntary turnover: A theoretical synthesis with implications for research. Journal of Management, 30, 667–683.
54.
MathWorks. (2012). MATLAB and statistics toolbox release. Natick, MA: Author.
55.
MaxwellS. E. (2004). The persistence of underpowered studies in psychological research: Causes, consequences, and remedies. Psychological Methods, 9, 147–163. doi:10.1037/1082-989X.9.2.147.
56.
MountM.IliesR.JohnsonE. (2006). Relationship of personality traits and counterproductive work behaviors: The mediating effects of job satisfaction. Personnel Psychology, 59, 591–622.
57.
NtzoufrasI. (2009). Bayesian modeling using WinBUGS. Hoboken, NJ: John Wiley.
58.
O’BoyleE.BanksG.Gonzalez-MuléE. (in press). The chrysalis effect: How ugly initial results metamorphosize into beautiful articles. Journal of Management.
59.
PlummerM. (2003). JAGS: A program for analysis of Bayesian graphical models using Gibbs sampling. In HornikK.LeischF.ZeileisA. (Eds.), Proceedings of the 3rd International Workshop on Distributed Statistical Computing, March 20-22. Vienna, Austria: DSC. Retrieved fromhttp://www.ci.tuwien.ac.at/Conferences/DSC-2003/Proceedings/
60.
R Development Core Team. (2012). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing. Retrieved fromhttp://www.R-project.org/
61.
SharpeD. (2013). Why the resistance to statistical innovations? Bridging the communication gap. Psychological Methods, 18, 572–582.
62.
ShoemakerJ. S.PainterI. S.WeirB.S. (1999). Bayesian statistics in genetics: A guide for the uninitiated. Trends in Genetics, 15, 354–358.
63.
SpiegelhalterD.ThomasA.BestN.LunnD. (2003). WinBUGS user manual, version 1.4. Cambridge, UK: MRC Biostatistics Unit.
64.
Stan Development Team. (2014). Stan: A C++ library for probability and sampling, version 2.2. Retrieved fromhttp://mc-stan.org
65.
TressoldiP. E.GiofréD.SellaF.CummingG. (2013). High impact = high statistical standards? Not necessarily so. PLOS ONE, 8, e56180.
66.
WagenmakersE. J. (2007). A practical solution to the pervasive problems of p values. Psychonomic Bulletin & Review, 14, 779–804.
67.
WagenmakersE. J.WetzelsR.BorsboomD.van der MaasH. (2011). Why psychologists must change the way they analyze their data: The case of psi: Comment on Bem (2011). Journal of Personality and Social Psychology, 100, 426–432.
68.
WeissY. (1997). Interpreting images by propagating Bayesian beliefs. In MozerM. C.JordanM. I.T. PetscheT. (Eds.), Advances in neural information processing systems (pp. 908–915). Cambridge, MA: MIT Press.
69.
WetzelsR.MatzkeD.LeeM. D.RouderJ. N.IversonG. J.WagenmakersE. J. (2011). Statistical evidence in experimental psychology: An empirical comparison using 855 t tests. Perspectives on Psychological Science, 6, 291–298.
70.
WooS. E. (2011). A study of Ghiselli’s hobo syndrome. Journal of Vocational Behavior, 29, 461–469.
71.
WoodwardP. (2005). BugsXLA: Bayes for the common man. Journal of Statistical Software, 14, 1–18.
72.
WoodwardP. (2011a). Bayesian analysis made simple: An excel GUI for WinBUGS. Boca Raton, FL: CRC Press.
