Let’s Talk about Stats: Revising Our Approach to Teaching Statistics in Psychology

Abstract

Undergraduate statistics in psychology is an important, often challenging, course for students. The focus in psychology tends to be on hypothesis tests, such as t tests and analysis of variance. While adequate for some questions, there are many other topics we might include that could improve that data analytic abilities of students and improve psychological science in the long run. Topics such as generalized linear modeling, multilevel modeling, Bayesian statistics, model building and comparison, and causal analysis, could be introduced in an undergraduate psychological statistics course. For each topic, I discuss their importance and provide sources for instructor’s continuing education. These topics would give students greater flexibility in analyzing data, allow them to conduct more meaningful analyses, allow them to understand more modern data analytic approaches, and potentially help the field of psychology in the long run, by being one part of the strategy to address the reproducibility problem.

Keywords

Statistics modeling teaching Bayesian undergraduate education

Get full access to this article

View all access options for this article.

References

Aczel

Palfi

Szaszi

(2017). Estimating the evidential value of significant results in psychological science. PLoS One, 12(8), 1–8. https://doi.org/10.1371/journal.pone.0182651

Adams

K. A.

Lawrence

E. V.

(2019). Research methods, statistics, and applications (2nd ed.). Sage Publications.

Aiken

L. S.

West

S. G.

Millsap

R. E.

(2008). Doctoral training in statistics, measurement, and methodology in psychology. American Psychologist, 62, 32–50.

Aiken

L. S.

West

S. G.

Sechrest

Reno

R. R.

Roediger

H. L.

Scarr

Kazdin

A. E.

Sherman

S. J.

(1990). Graduate training in statistics, methodology, and measurement in psychology. American Psychologist, 45(6), 721–734.

Akaike

(1973). Information theory and an extension of the maximum likelihood principle. In B. N. Petrov & F. Csaki (Eds.), Second international symposium on information theory (pp. 267–281). Academiai Kiado.

Akaike

(1974). A new look at the statistical model identification. IEEE Transactions on Automatic Control, 19(6), 716–723. https://doi.org/10.1109/TAC.1974.1100705

Akaike

(1981). Likelihood of a model and information criteria. Journal of Econometrics, 16(1), 3–14. https://doi.org/10.1016/0304-4076(81)90071-3

Akaike

(1987). Factor analysis and AIC. Psychometrika, 52(3), 317–332. https://doi.org/10.1007/BF02294359

Alder

A. G.

Vollick

(2000). Undergraduate statistics in psychology: A survey of Canadian institutions. Canadian Psychology/Psychologie Canadienne, 41(3), 149–151. https://doi.org/10.1037/h0086864

10.

Baker

(2016). Is there a reproducibility crisis? Nature, 533(7604), 452–454. https://doi.org/10.1038/533452a

11.

Baron

R. M.

Kenny

D. A.

(1986). The moderator-mediator variable distinction in social psychological research: Conceptual, strategic, and statistical considerations. Journal of Personality and Social Psychology, 51(6), 1173–1182. https://doi.org/10.1037/0022-3514.51.6.1173

12.

Bates

Mächler

Bolker

Walker

(2015). Fitting linear mixed-effects models using lme4. Journal of Statistical Software, 67(1), 1–48. https://doi.org/10.18637/jss.v067.i01

13.

Breiman

(2001). Statistical modeling: The two cultures. Statistical Science, 16(3), 199–231.

14.

Bürkner

P. C.

(2017). brms: An R package for Bayesian multilevel models using Stan. Journal of Statistical Software, 80(1), 1–28. https://doi.org/10.18637/jss.v080.i01

15.

Bürkner

P.-C.

Vuorre

(2019). Ordinal regression models in psychology: A tutorial. Advances in Methods and Practices in Psychological Science, 2(1), 77–101. https://doi.org/10.1177/2515245918823199

16.

Cassidy

S. A.

Dimova

Giguère

Spence

J. R.

Stanley

D. J.

(2019). Failing grade: 89% of introduction-to-psychology textbooks that define or explain statistical significance do so incorrectly. Advances in Methods and Practices in Psychological Science, 2(3), 233–239. https://doi.org/10.1177/2515245919858072

17.

Cesario

Johnson

D. J.

Terrill

(2019). Is there evidence of racial disparity in police use of deadly force? Analyses of officer-involved fatal shootings in 2015–2016. Social Psychological and Personality Science, 10(5), 586–595. https://doi.org/10.1177/1948550618775108

18.

Cobb

(2015). Mere renovation is too little too late: We need to rethink our undergraduate curriculum from the ground up. The American Statistician, 69(4), 266–282. https://doi.org/10.1080/00031305.2015.1093029

19.

Cohen

(1994). The earth is round (p <.05). American Psychologist, 49(12), 997–1003. https://doi.org/10.1037/0003-066X.49.12.997

20.

Cozby

P. C.

Bates

(2018). Methods in behavioral research (13th ed.). McGraw-Hill.

21.

Cruise

R. J.

Cash

R. W.

Bolton

D. L.

(1985). Development and validation of an instrument to measure statistical anxiety. American Statistical Association, 4, 92–97.

22.

Depaoli

van de Schoot

(2017). Improving transparency and replication in Bayesian statistics: The WAMBS-Checklist. Psychological Methods, 22(2), 240–261. https://doi.org/10.1037/met0000065.supp

23.

Dienes

(2011). Bayesian versus orthodox statistics: Which side are you on? Perspectives on Psychological Science 6(3), 274–290. https://doi.org/10.1177/1745691611406920

24.

Dunn

P. K.

Smyth

G. K.

(2018). Generalized linear models with examples in R. Springer.

25.

Etz

Gronau

Q. F.

Dablander

Edelsbrunner

P. A.

Baribault

(2018). How to become a Bayesian in eight easy steps: An annotated reading list. Psychonomic Bulletin & Review, 25(1), 219–234. https://doi.org/10.3758/s13423-017-1317-5

26.

Etz

Vandekerckhove

(2018). Introduction to Bayesian inference for psychology. Psychonomic Bulletin & Review, 25(1), 5–34. https://doi.org/10.3758/s13423-017-1262-3

27.

Finch

W. H.

Bolin

J. E.

Kelley

(2019). Multilevel modeling using R. CRC Press.

28.

Friedrich

Buday

Kerr

(2000). Statistical training in psychology: A national survey and commentary on undergraduate programs. Teaching of Psychology, 27(4), 248–257. https://doi.org/10.1207/S15328023TOP2704_02

29.

Friedrich

Childress

Cheng

(2018). Replicating a national survey on statistical training in undergraduate psychology programs: Are there “new statistics” in the new millennium? Teaching of Psychology, 45(4), 312–323. https://doi.org/10.1177/0098628318796414

30.

Fryer

R. G.

(2019). An empirical analysis of racial differences in police use of force. Journal of Political Economy, 127(3), 1210–1261. https://doi.org/10.1086/701423

31.

Garfield

Ben-Zvi

(2007). How students learn statistics revisited: A current review of research on teaching and learning statistics. International Statistical Review, 75(3), 372–396. https://doi.org/10.1111/j.1751-5823.2007.00029.x

32.

Gelman

Carlin

J. B.

Stern

H. S.

Dunson

D. B.

Vehtari

Rubin

D. B.

(2014). Bayesian data analysis (3rd ed.). Chapman and Hall/CRC.

33.

Gelman

Hill

(2007). Data analysis using regression and multilevel/hierarchical models. Cambridge University Press.

34.

Goodman

(2008). A dirty dozen: Twelve p-value misconceptions. Seminars in Hematology, 45(3), 135–140. https://doi.org10.1053/j.seminhematol.2008.04.003

35.

Gravetter

F. J.

Wallnau

L. B.

(2013). Essentials for statistics for the behavioral sciences (8th ed.). Thomson Wadsworth.

36.

Hadfield

J. D.

(2010). MCMC methods for multi-response generalized linear mixed models: The MCMCglmm R package. Journal of Statistical Software, 33(2), 1–22.

37.

Hoffmann

J. P.

(2004). Generalized linear models: An applied approach. Pearson Education.

38.

Ioannidis

J. P. A.

(2019). What have we (not) learnt from millions of scientific papers with p values? The American Statistician, 73(sup1), 20–25. https://doi.org/10.1080/00031305.2018.1447512

39.

Koehler

J. J.

Macchi

(2004). Thinking about low-probability events. Psychological Science, 15(8), 540–546.

40.

Konishi

Kitagawa

(2007). Information criteria and statistical modeling. Springer.

41.

Kranzler

J. H.

(2018). Statistics for the terrified (6th ed.). Rowman and Littlefield.

42.

Kruschke

J. K.

(2015). Doing Bayesian data analysis (2nd ed.). Academic Press.

43.

Kruschke

J. K.

Liddell

T. M.

(2018a). Bayesian data analysis for newcomers. Psychonomic Bulletin & Review, 25(1), 155–177. https://doi.org/10.3758/s13423-016-1221-4

44.

Kruschke

Liddell

(2018b). The Bayesian new statistics: Hypothesis testing, estimation, meta-analysis, and power analysis from a Bayesian perspective. Psychonomic Bulletin & Review, 25(1), 178–206. doi:10.3758/s13423-016-1221-4

45.

Lambert

(2018). A student’s guide to Bayesian statistics. Sage.

46.

Liddell

T. M.

Kruschke

J. K.

(2018). Analyzing ordinal data with metric models: What could possibly go wrong? Journal of Experimental Social Psychology, 79, 328–348. https://doi.org/10.1016/j.jesp.2018.08.009

47.

Lindley

D. V.

(1993). The analysis of experimental data: The appreciation of tea and wine. Teaching Statistics, 15(1), 22–25. http://doi.org/10.1111/j.1467-9639.1993.tb00252.x.

48.

McElreath

(2016). Rethinking: Statistical rethinking book package. R package version 1.59.

49.

McElreath

(2020). Statistical rethinking: A Bayesian course with examples in R and Stan (2nd ed.). CRC Press/Taylor & Francis Group.

50.

Moore

(1998). Statistics among the liberal arts. Journal of the American Statistical Association, 93(444), 1253–1259. https://doi.org/10.1080/01621459.1998.10473786

51.

Myers

J. L.

Well

A. D.

Lorch

R. F.

(2010). Research design and statistical analysis (3rd ed.). Routledge.

52.

National Science Foundation, National Center for Science and Engineering Statistics. (2017). National survey of college graduates public use microdata file and codebook. https://sestat.nsf.gov/datadownload/.

53.

Niles

H. E.

(1922). Correlation, causation and wright’s theory of “path coefficients. Genetics, 7(3), 258–273.

54.

Page

Satake

(2017). Beyond p values and hypothesis testing: Using the minimum Bayes factor to teach statistical inference in undergraduate introductory statistics courses. Journal of Education and Learning, 6(4), 254–266. http://doi.org/10.5539/jel.v6n4p254

55.

Pearl

(2009). Causality: Models, reasoning, and inference (2nd ed.). Cambridge University Press.

56.

Pearl

Mackenzie

(2018). The book of why: The new science of cause and effect. Basic Books.

57.

Pearson

(1892). The grammar of science. Adam & Charles Black.

58.

Porter

T. M.

(2004). Karl Pearson: The scientific life in a statistical age. Princeton University Press.

59.

Project Syllabus – Society for the Teaching of Psychology. (2021). http://teachpsych.org/otrp/syllabi/index.php#stats

60.

R Core Team. (2020). R: A language and environment for statistical computing. R Foundation for Statistical Computing. https://www.R-project.org/

61.

Roberts

D. M.

Reese

C. M.

(1987). A comparison of two scales measuring attitudes towards statistics. Educational and Psychological Measurement, 47(3), 759–764. https://doi.org/10.1177/001316448704700329

62.

Robson

Pevalin

(2016). Multilevel modeling in plain language. Sage.

63.

Rohrer

(2012). Interleaving helps students distinguish among similar concepts. Educational Psychology Review, 24(3), 355–367. https://doi.org/10.1007/s10648-012-9201-3

64.

Rohrer

Taylor

(2007). The shuffling of mathematics problems improves learning. Instructional Science, 35(6), 481–498. http://doi.org/10.1007/s11251-007-9015-8

65.

Rohrer

J. M.

(2018). Thinking clearly about correlations and causation: Graphical causal models for observational data. Advances in Methods and Practices in Psychological Science, 1(1), 27–42. https://doi.org/10.1177/2515245917745629

66.

Ross

C. T.

Winterhalder

McElreath

(2018). Resolution of apparent paradoxes in the race-specific frequency of use-of-force by police. Palgrave Communications, 4(61), 1–9. https://doi.org/10.1057/s41599-018-0110-z

67.

Ross

C. T.

Winterhalder

McElreath

(2021). Racial disparities in police use of deadly force against unarmed individuals persist after appropriately benchmarking shooting data on violent crime rates. Social Psychological and Personality Science, 12(3), 323–332. https://doi.org/10.1177/1948550620916071

68.

Satake

Murray

A. V.

(2014). Teaching an application of Bayes’ rule for legal decision-making: Measuring the strength of evidence. Journal of Statistics Education, 22(1), 1–29. https://doi.org/10.1080/10691898.2014.11889692

69.

Schacter

D. L.

Gilbert

D. T.

Wegner

D. M.

(2019). Psychology (5th ed.). Worth Publishers.

70.

Scott

D. S.

Sadler

M. S.

Correll

(2017). A social scientific approach toward understanding racial disparities in police shooting: Data from the department of justice (1980–2000). Journal of Social Issues, 73(4), 701–722. https://doi.org/10.1111/josi.12243

71.

Shipley

(2016). Cause and correlation in biology: A user’s guide to path analysis, structural equations and causal inference with R (2nd ed.). Cambridge University Press.

72.

Silver

(2012). The signal and the noise: Why so many predictions fail-but some don't. The Penguin Press.

73.

Szucs

Ioannidis

(2017). When null hypothesis significance testing is unsuitable for research: A reassessment. Frontiers in Human Neuroscience, 11(390), 1–21. https://doi.org/10.3389/fnhum.2017.00390

74.

Textor

van der Zander

Gilthorpe

M. S.

Liśkiewicz

Ellison

G. T.

(2016). Robust causal inference using directed acyclic graphs: The R package ‘dagitty’. International Journal of Epidemiology, 45(6), 1887–1894. https://doi.org/10.1093/ije/dyw341

75.

van de Schoot

Depaoli

(2014). Bayesian analyses: Where to start and what to report. The European Health Psychologist, 16, 73–82.

76.

VanderWeele

T. J.

(2014). Commentary: Resolutions of the birthweight paradox: Competing explanations and analytical insights. International Journal of Epidemiology, 43(5), 1368–1373. https://doi.org/10.1093/ije/dyu162

77.

Vehtari

Gelman

Gabry

(2017). Practical Bayesian model evaluation using leave-one-out cross-validation and WAIC. Statistics and Computing, 27(5), 1413–1432. https://doi.org/10.1007/s11222-016-9696-4

78.

Venables

W. N.

Ripley

B. D.

(2002). Modern applied statistics with S (4th ed.). Springer.

79.

Wagenmakers

E.-J.

Marsman

Jamil

Verhagen

Love

Selker

Gronau

Q. F.

Šmíra

Epskamp

Matzke

Rouder

J. N.

Morey

R. D.

(2018). Bayesian inference for psychology. Part I: Theoretical advantages and practical ramifications. Psychonomic Bulletin & Review, 25(1), 35–57. (2018). https://doi.org/10.3758/s13423-017-1343-3

80.

Warne

R. T.

(2018). Statistics for the social sciences: A general linear model approach. Cambridge University Press.

81.

Welkowitz

Cohen

B. H.

Lea

R. B.

(2012). Introductory statistics for the behavioral sciences (7th ed.). John Wiley & Sons.

82.

Yerushalmy

(1971). The relationship of parents’ cigarette smoking to outcome of pregnancy – Implications as to the problem of inferring causation from observed associations. American Journal of Epidemiology, 93(6), 443–456. https://doi.org/10.1093/oxfordjournals.aje.a121278

83.

Yong

C. S.

Rosli

(2020). Validity and reliability of the survey of attitudes toward statistics (SATS) instrument. Malaysian Journal of Education, 45, 17–24. http://dx.doi.org/10.17576/JPEN-2020-45.01SI-03

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.35 MB