Sage Journals: Discover world-class research

Abstract

Background

A philosophical shift in statistics regarding emphasis on “New Statistics” (NS; Cumming, G. (2014). The new statistics: Why and how. Psychological Science, 25(1), 7-29.) over conventional null hypothesis significance testing (NHST) raises the question of appropriate material coverage in undergraduate statistics courses.

Objective

We examined current practices in statistics pedagogy at the graduate and undergraduate levels for both NS and NHST.

Method

Using an online survey of a nationwide sample of current graduate students (n = 452) and graduate faculty (n = 162), we examined statistics pedagogy and perceptions of best approaches for teaching undergraduate statistics.

Results

In undergraduate statistics courses, coverage of NS material involves modest instruction in effect sizes and confidence intervals, while NHST remains dominant. Graduate courses have more balanced coverage. Effect size estimation was regarded as the most important NS knowledge for success in graduate school and the topic most in need of increased undergraduate coverage.

Conclusion

Undergraduate statistics courses could increase NS coverage, particularly effect size estimation, to better align with and prepare students for graduate work.

Teaching Implications

This research summarizes graduate program expectations and graduate student experiences regarding undergraduate statistics that current instructors can use to shape the content of their classes.

Keywords

teaching statistics psychology graduate instruction undergraduate instruction New Statistics

Get full access to this article

View all access options for this article.

References

Aiken

L. S.

West

S. G.

Millsap

R. E.

(2008). Doctoral training in statistics, measurement, and methodology in psychology: Replication and extension of Aiken, West, Sechrest, and Reno’s (1990) survey of PhD programs in North America. American Psychologist, 63, 32-50. doi:10.1037/0003-066X.63.1.32

(1990). Graduate training in statistics, methodology, and measurement in psychology: A survey of PhD programs in North America. American Psychologist, 45, 721-734. doi:10.1037/0003-066X.63.1.32

American Psychological Association (2019). Graduate study in psychology (2019 ed.). American Psychological Association.

American Psychological Association (2020). Publication manual of the American psychological association (7th ed.). American Psychological Association.

(2018). Journal article reporting standards for quantitative research in psychology: The APA Publications and Communications Board task force report. American Psychologist, 73(1), 3-25. doi:10.1037/amp0000191

Calin-Jageman

R. J.

Cumming

(2019). The New Statistics for better science: Ask how much, how uncertain, and what else is known. The American Statistician, 73, 271-280. doi:10.1080/00031305.2018.1518266

Cohen

(1994). The earth is round (p < .05). American Psychologist, 49(12), 997-1003. doi:10.1037/0003-066X.49.12.997

Cumming

(2014). The new statistics: Why and how. Psychological Science, 25(1), 7-29. doi:10.1177/0956797613504966

Friedrich

Buday

Kerr

(2000). Statistical training in psychology: A national survey and commentary on undergraduate programs. Teaching of Psychology, 27, 248-257. doi:10.1207/S15328023TOP2704_02

(2018). Replicating a national survey on statistical training in undergraduate psychology programs: Are there “New Statistics” in the new millennium? Teaching of Psychology, 45(4), 1-12. doi:10.1177/0098628318796414

11.

Goodman

S. N.

(2019). Why is getting rid of p-values so hard? Musings on science and statistics. The American Statistician, 73, 26-30. doi:10.1080/00031305.2018.1558111

12.

Haller

Krauss

(2002). Misinterpretations of significance: A problem students share with their teachers? Methods of Psychological Research Online, 7(1), 1-17.

13.

Kline

R. B.

(2013). Beyond significance testing: Reforming data analysis methods in behavioral research (2nd ed.). American Psychological Association.

(2020). What psychology teachers should know about open science and the new statistics. Teaching of Psychology, 47(2), 169-179. doi:10.1177/0098628320901372

(2019). Introducing the new statistics in the classroom. Scholarship of Teaching and Learning in Psychology, 5(2), 162-168. doi:10.1037/stl0000141

16.

Oakes

M. W.

(1986). Statistical inference: A commentary for the social and behavioural sciences (1st ed.). Wiley.

(2021, May 5). New statistics, old schools: An overview of current introductory undergraduate and graduate statistics pedagogy practices. Retrieved from osf.io/4t873.

18.

Trafimow

Marks

(2015). Editorial. Basic and Applied Social Psychology, 37, 1-2. doi:10.1080/01973533.2015.1012991

19.

U.S. News & World Report (1997). America’s best colleges. U.S. News & World Report.

20.

Wasserstein

Lazar

(2016). The ASA’s statement on p-values: Context, process, and purpose. The American Statistician, 70, 129-133. doi:10.1080/00031305.2016.1154108 .