The overuse of lecture-based approaches for instruction in university courses may have limited student access to knowledge, particularly the transfer of complex concepts, such as central limit theorem in statistics. This study seeks to contribute to empirical research regarding the effectiveness of serious educational games (SEGs) to increase undergraduates’ conceptual understanding and affective interest in statistics. An experimental design was used to test the efficacy of an SEG, Deadly Distribution, which simulates a real-world context to learn and interact with statistics concepts, compared to traditional notes and homework problems, as supplements to instruction in addition to class lectures. Students who played the game had similar increases in academic growth of conceptual knowledge as students who studied traditional course material. Furthermore, this treatment group had a significant increase in affective outcomes compared to the control group. These findings extend the current literature, which is mixed and sparse, on the effectiveness of SEGs in the undergraduate classroom. In an undergraduate introductory statistics course, an SEG might be an effective substitute for traditional study time of course materials outside of class to increase their affect toward the subject matter and produce similar gains for students who might not otherwise study.
AgarwalR.KarahannaE. (2000) Time flies when you’re having fun: Cognitive absorption and beliefs about information technology usage. MIS Quarterly24(4): 665–694.
2.
Anderson, D. R., Sweeney, D. J., & Williams, T. A. (2014a). Discrete probability distributions. In Essentials of modern business statistics (pp. 209–250). Independence, KY: Cengage Learning.
3.
Anderson, D. R., Sweeney, D. J., & Williams, T. A. (2014b). Continuous probability distributions. In Essentials of modern business statistics (pp. 251–282). Independence, KY: Cengage Learning.
4.
Anderson, D. R., Sweeney, D. J., & Williams, T. A. (2014c). Sampling and sampling distributions. In Essentials of modern business statistics (pp. 283–323). Independence, KY: Cengage Learning.
5.
Annetta, L.A., Minogue, J., Holmes, S.Y., & Cheng, M. (2009). Investigating the impact of video games on high school students' engagement and learning about genetics. Computers and Education, 53, 74–85.
6.
BaloğluM. (2003) Individual differences in statistics anxiety among college students. Personality and Individual Differences34(5): 855–865.
7.
BarabS. A.GresalfiM.Ingram-GobleA. (2010) Transformational play: Using games to position person, content, and context. Educational Researcher39(7): 525–536.
8.
BarrM. (2017) Video games can develop graduate skills in higher education students: A randomised trial. Computers & Education113(Supplement C): 86–97. doi:10.1016/j.compedu.2017.05.016.
9.
Ben-ZviD.GarfieldJ. (2004) Statistical literacy, reasoning, and thinking: Goals, definitions, and challenges. In: Ben-ZviD.GarfieldJ. (eds) The challenge of developing statistical literacy, reasoning and thinking, Dordrecht, the Netherlands: Springer, pp. 3–15.
10.
BoyleE. A.MacArthurE. W.ConnollyT. M.HaineyT.ManeaM.KärkiA.van RosmalenP. (2014) A narrative literature review of games, animations and simulations to teach research methods and statistics. Computers & Education74: 1–14. doi:10.1016/j.compedu.2014.01.004.
11.
BromC.DěchtěrenkoF.FrollováN.StárkováT.BromováE.D’MelloS. K. (2017) Enjoyment or involvement? Affective-motivational mediation during learning from a complex computerized simulation. Computers & Education114: 236–254. doi:10.1016/j.compedu.2017.07.001.
12.
Campbell, D. T. (1957). Factors relevant to the validity of experiments in social settings. Psychological Bulletin, 54(4), 297–312. http://dx.doi.org/10.1037/h0040950.
13.
Campbell, D. T. (1975). “Degrees of freedom” and the case study. Comparative Political Studies, 8, 178–93.
14.
Chance, B., & Rossman, A. (2006, July). Using simulation to teach and learn statistics. In Proceedings of the Seventh International Conference on Teaching Statistics, The Hague, the Netherlands: International Statistics Institute.
15.
ClarkD. B.Tanner-SmithE. E.KillingsworthS. S. (2016) Digital games, design, and learning: A systematic review and meta-analysis. Review of Educational Research86(1): 79–122. doi:10.3102/0034654315582065.
16.
Cohen, J. (1992). A power primer. Psychological Bulletin,112(1), 155–159.
17.
ConnersF. A.McCownS. M.Roskos-EwoldsenB. (1998) Unique challenges in teaching undergraduate statistics. Teaching of Psychology25(1): 40–42.
18.
ConnollyT. M.BoyleE. A.MacarthurE.HaineyT.BoyleJ. M. (2012) A systematic literature review of empirical evidence on computer games and serious games. Computers & Education59(2): 661–686. doi:10.1016/j.compedu.2012.03.004.
19.
DelMasR. C.GarfieldJ.ChanceB. (1999) A model of classroom research in action: Developing simulation activities to improve students’ statistical reasoning. Journal of Statistics Education7(3): 1–2.
20.
EmbretsonS.ReiseS. (2000) Item response theory for psychologists, Mahwah, NJ: Lawrence Erlbaum Associates.
21.
FjællingsdalK. S.KlöcknerC. A. (2017) ENED-GEM: A conceptual framework model for psychological enjoyment factors and learning mechanisms in educational games about the environment. Frontiers in Psychology8: 1085, doi:10.3389/fpsyg.2017.01085.
22.
FosterA. N. (2011) The process of learning in a simulation strategy game: Disciplinary knowledge construction. Journal of Educational Computing Research45(1): 1–27. doi:10.2190/EC.45.1.a.
23.
Freeman, S., Eddy, S. L., McDonough, M., Smith, M. K., Okoroafor, N., Jordt, H., & Wenderoth, M.P. (2014). Active learning increases student performance in science, engineering, and mathematics. Proceedings of the National Academy of Sciences of the United States of America, (pp. 8410–8415).
24.
GalI. (2004) Statistical literacy. In: Ben-ZviD.GarfieldJ. (eds) The challenge of developing statistical literacy, reasoning and thinking, Dordrecht, the Netherlands: Springer, pp. 47–78.
25.
GarneliV.GiannakosM.ChorianopoulosK. (2017) Serious games as a malleable learning medium: The effects of narrative, gameplay, and making on students’ performance and attitudes. British Journal of Educational Technology48(3): 842–859. doi:10.1111/bjet.12455.
26.
GarrisR.AhlersR.DriskellJ. E. (2002) Games, motivation, and learning: A research and practice model. Simulation & Gaming33(4): 441–467.
27.
GeeJ. P. (2003) What video games have to teach us about learning and literacy. Computers in Entertainment1(1): 20–20. doi:10.1145/950566.950595.
28.
GeeJ. P. (2005) Learning by design: Good video games as learning machines. E-Learning and Digital Media2(1): 5–16. doi:10.2304/elea.2005.2.1.5.
29.
GirardC.EcalleJ.MagnanA. (2013) Serious games as new educational tools: How effective are they? A meta-analysis of recent studies. Journal of Computer Assisted Learning29(3): 207–219. doi:10.1111/j.1365-2729.2012.00489.x.
30.
HagtvedtR.JonesG. T.JonesK. (2007) Pedagogical simulation of sampling distributions and the Central Limit Theorem. Teaching Statistics29(3): 94–97.
31.
HildrethL. A.Robison-CoxJ.SchmidtJ. (2018) Comparing student success and understanding in introductory statistics under consensus and simulation-based curricula. Statistics Education Research Journal17(1): 103–120.
32.
HolmesJ. B.GeeE. R. (2016) A framework for understanding game-based teaching and learning. On the Horizon24(1): 1–16. doi:10.1108/OTH-11-2015-0069.
33.
KeF. (2008) Computer games application within alternative classroom goal structures: Cognitive, metacognitive, and affective evaluation. Educational Technology Research and Development56(5): 539–556. doi:10.1007/s11423-008-9086-5.
34.
KebritchiM.HirumiA.BaiH. (2010) The effects of modern mathematics computer games on mathematics achievement and class motivation. Computers & Education55(2): 427–443. doi:10.1016/j.compedu.2010.02.007.
35.
KennedyG.JuddT.DalgarnoB.WaycottJ. (2010) Beyond natives and immigrants: Exploring types of net generation students. Journal of Computer Assisted Learning26(5): 332–343. doi:10.1111/j.1365-2729.2010.00371.x.
36.
KermackW. O.McKendrickA. G. (1927) A contribution to the mathematical theory of epidemics. Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences115(772): 700–721.
37.
KolbD. A. (2015) Experiential learning: Experience as the source of learning and development, 2nd ed. Upper Saddle River, NJ: Pearson Education.
38.
LambR. L. (2016) Examination of the effects of dimensionality on cognitive processing in science: A computational modeling experiment comparing online laboratory simulations and serious educational games. Journal of Science Education and Technology25(1): 1–15. doi:10.1007/s10956-015-9587-z.
39.
LambR. L.AnnettaL.FirestoneJ.EtopioE. (2018) A meta-analysis with examination of moderators of student cognition, affect, and learning outcomes while using serious educational games, serious games, and simulations. Computers in Human Behavior80(Supplement C): 158–167. doi:10.1016/j.chb.2017.10.040.
40.
Lambert, G. (2012). Twilight of the lecture: The trend toward “active learning” may overthrow the style of teaching that has ruled universities for 600 years. Harvard Magazine. Retrieved from http://harvardmagazine.com/2012/03/twilight-of-the-lecture.
41.
LamerasP.ArnabS.DunwellI.StewartC.ClarkeS.PetridisP. (2017) Essential features of serious games design in higher education: Linking learning attributes to game mechanics. British Journal of Educational Technology48(4): 972–994. doi:10.1111/bjet.12467.
42.
LaneD. M.TangZ. (2000) Effectiveness of simulation training on transfer of statistical concepts. Journal of Educational Computing Research22(4): 383–396.
43.
Lopez, X., Valenzuela, J., Nussbaum, M., & Tsai, C. (2015). Some recommendations for the reporting of quantitative studies. Computers and Education, 91, 106–110.
44.
MazerJ. P.HessJ. A. (2017) What is the place of lecture in higher education?Communication Education66(2): 236–237. doi:10.1080/03634523.2017.1287411.
45.
McClave, J. T., Benson, P. G., & Sincich, T. T. (2012a). Sampling distributions. In Statistics for business and economics (pp. 277–312). London, England: Pearson Education Limited.
46.
McClave, J. T., Benson, P. G., & Sincich, T. T. (2012b). Inferences based on a single sample: Estimation with confidence intervals. In Statistics for business and economics (pp. 313–270). London, England: Pearson Education Limited.
47.
McGlynnA. P. (2007) Millennials in college: How do we motivate them?The Hispanic Outlook in Higher Education17(25): 34–36.
48.
Mertler, C. A., & Vannatta, R. A. (2002). Advanced and multivariate statistical methods: Practical application and interpretation (2nd ed.). Los Angeles: Pyrczak.
49.
MillsJ. D. (2002) Using computer simulation methods to teach statistics: A review of the literature. Journal of Statistics Education10(1): 1–20.
50.
MillsJ. D. (2004) Learning abstract statistics concepts using simulation. Educational Research Quarterly28(4): 18–33.
51.
MorenoR.MayerR. E.SpiresH. A.LesterJ. C. (2001) The case for social agency in computer-based teaching: Do students learn more deeply when they interact with animated pedagogical agents?Cognition and Instruction19(2): 177–213.
52.
MvududuN.KanyongoG. Y. (2011) Using real life examples to teach abstract statistical concepts. Teaching Statistics33(1): 12–16.
53.
NewboldP.CarlsonW. L.ThorneB. (2013) Statistics for business and economics, Boston, MA: Pearson.
54.
Nichols, R. (2017). The effectiveness of inquiry-based vs. didactic teaching methods on student performance in undergraduate statistics (Dissertation). Florida Gulf Coast University, ProQuest Dissertations Publishing. Retrieved from https://search-proquest-com.ezproxy.lib.ou.edu/docview/1925938923?accountid=12964 (10286086).
55.
OblingerD.OblingerJ. L.LippincottJ. K. (2005) Educating the net generation, Boulder, CO: EDUCAUSE.
56.
OnwuegbuzieA.DaRosD.RyanJ. (1997) The components of statistics anxiety: A phenomenological study. Focus on Learning Problems in Mathematics19: 11–35.
57.
PlassJ. L.O’keefeP. A.HomerB. D.CaseJ.HaywardE. O.SteinM.PerlinK. (2013) The impact of individual, competitive, and collaborative mathematics game play on learning, performance, and motivation. Journal of Educational Psychology105(4): 1050–1066. doi:10.1037/a0032688.
58.
RandelJ.MorrisB.WetzelC.WhitehillB. (1992) The effectiveness of games for educational purposes: A review of recent research. Simulation & Gaming23(3): 261–276.
59.
Scheaffer, R.L. & Stansy, E.A (2004). The state of undergraduate education in statistics: A report from the CBMS 2000. The American Statistician, 54(4), 265–271.
60.
Shadish, W. R. (1995). The logic of generalization: Five principles common to experiments and ethnographies. American Journal of Community Psychology, 23, 419–428.
61.
Shadish, W. & Cook, T.R. (1999). Comment-design rules: More steps toward a complete theory of quasi-experimentation. Statistical Science, 14(3), 294–300.
62.
Shadish, W., Cook, T. D., & Campbell, D. (2002). Experimental and quasi-experimental design for generalized causal inference. Boston, MA: Houghton Mifflin.
63.
SitzmannT. (2011) A meta-analytic examination of the instructional effectiveness of computer-based simulation games. Personnel Psychology64(2): 489–528. doi:10.1111/j.1744-6570.2011.01190.x.
64.
SquireK. (2006) From content to context: Videogames as designed experience. Educational Researcher35(8): 19–29.
65.
SwailW. S. (2002) Higher education and the new demographics: Questions for policy. Change34(4): 14–23.
66.
TrotterA. (2005) Despite allure, using digital games for learning seen as no easy task. Education Week25(10): 1–19.
67.
U.S. Department of Education, National Center for Education Statistics. (2016). Digest of Education Statistics, 2014 (NCES 2016-006), Chapter 3.
68.
VlachopoulosD.MakriA. (2017) The effect of games and simulations on higher education: A systematic literature review. International Journal of Educational Technology in Higher Education14(22): 1–33. doi:10.1186/s41239-017-0062-1.
69.
VogelJ. J.VogelD. S.Cannon-BowersJ. A. N.BowersC. A.MuseK.WrightM. (2006) Computer gaming and interactive simulations for learning: A meta-analysis. Journal of Educational Computing Research34(3): 229–243.
WorleyK. (2011) Educating college students of the net generation. Adult Learning22(3): 31–39. doi:10.1177/104515951102200305.
73.
WoutersP.Van NimwegenC.Van OostendorpH.Van Der SpekE. D. (2013) A meta-analysis of the cognitive and motivational effects of serious games. Journal of Educational Psychology105(2): 249–265. doi:10.1037/a0031311.
