This study explored youth with Autism Spectrum Disorder (ASD) learning social competence in the context of innovative 3D virtual learning environment and the effects of gaming as a central element of the learning experience. The empirical study retrospectively compared the social interactions of 11 adolescents with ASD in game-and nongame-based 3D collaborative learning activities in the same social competence training curriculum. We employed a learning analytics approach - association rule mining to uncover the associative rules of verbal social interaction and nonverbal social interaction contributors from the large dataset of the coded social behaviors. By comparing the rules across the game and nongame activities, we found a significant difference in youth with ASD’s social performance. The results of the group comparison study indicated that the co-occurrence of verbal and nonverbal behaviors is much stronger in the game-based learning activities. The game activities also yielded more diverse social interaction behavior patterns. On the other hand, in the nongame activities, students’ social interaction behavior patterns are much more limited. Furthermore, the impact of game design principles on learning is then discussed in this paper.
Abirached, B., Zhang, Y., & Park, J. H. (2012, June). Understanding user needs for serious games for teaching children with autism spectrum disorders emotions. In EdMedia+ Innovate Learning (pp. 1054–1063). Association for the Advancement of Computing in Education (AACE).
2.
Agrawal, R., Imielinski, T., & Swami, A. (1993). Database mining: A performance perspective. IEEE transactions on knowledge and data engineering, 5(6), 914–925.
3.
Ambady, N., & Rosenthal, R. (1992). Thin slices of expressive behavior as predictors of interpersonal consequences: A meta-analysis. Psychological bulletin, 111(2), 256.
4.
AndreasK.TsiatsosT.TerzidouT.PomportsisA. (2010). Fostering collaborative learning in second life: Metaphors and affordances. Computers & Education, 55(2), 603–615. https://doi.org/10.1016/j.compedu.2010.02.021
5.
Argyle, M. (1990). The biological basis of rapport. Psychological Inquiry, 1(4), 297–300.
6.
BarabS.ThomasM.DodgeT.CarteauxR.TuzunH. (2005). Making learning fun: Quest Atlantis, a game without guns. Educational Technology Research and Development, 53(1), 86–107.
7.
BernsA.Gonzalez-PardoA.CamachoD. (2013). Game-like language learning in 3-D virtual environments. Computers & Education, 60(1), 210–220. https://doi.org/10.1016/j.compedu.2012.07.001
8.
BozantaA.KutluB.NowlanN.ShirmohammadiS. (2016). Effects of serious games on perceived team cohesiveness in a multi-user virtual environment. Computers in Human Behavior, 59, 380–388. https://doi.org/10.1016/j.chb.2016.02.042
9.
Burgoon, J. K., & Buller, D. B. (1994). Interpersonal deception: III. Effects of deceit on perceived communication and nonverbal behavior dynamics. Journal of Nonverbal Behavior, 18(2), 155–184.
10.
ChenC.-H.LeeI.-J.LinL.-Y. (2016). Augmented reality-based video-modeling storybook of nonverbal facial cues for children with autism spectrum disorder to improve their perceptions and judgments of facial expressions and emotions. Computers in Human Behavior, 55, 477–485. https://doi.org/10.1016/j.chb.2015.09.033
11.
ChengM.-T.LinY.-W.SheH.-C. (2015). Learning through playing virtual age: Exploring the interactions among student concept learning, gaming performance, in-game behaviors, and the use of in-game characters. Computers & Education, 86, 18–29. https://doi.org/10.1016/j.compedu.2015.03.007
12.
ChengY.YeJ. (2010). Exploring the social competence of students with autism spectrum conditions in a collaborative virtual learning environment—The pilot study. Computers & Education, 54(4), 1068–1077.
13.
DalgarnoB.LeeM. J. W. (2010). What are the learning affordances of 3‐D virtual environments?British Journal of Educational Technology, 41(1), 10–32. https://doi.org/10.1111/j.1467-8535.2009.01038.x
14.
DasguptaA.BuckinghamN.GračaninD.HandosaM.TasoojiR. (2018). A mixed reality based social interactions testbed: A game theory approach. In J. Y. C. Chen & G. Fragomeni (Eds.), Virtual, augmented and mixed reality: Applications in health, cultural heritage, and industry (pp. 40–56). Springer International Publishing. https://doi.org/10.1007/978-3-319-91584-5_4
15.
Denwattana, N., & Getta, J. R. (2001, January). A parameterised algorithm for mining association rules. In Proceedings 12th Australasian Database Conference. ADC 2001 (pp. 45–51). IEEE.
16.
DickeyM. D. (2005). Three‐dimensional virtual worlds and distance learning: Two case studies of active worlds as a medium for distance education. British Journal of Educational Technology, 36(3), 439–451. https://doi.org/10.1111/j.1467-8535.2005.00477.x
17.
DuCharmeR.GullottaT. P. (2003). Asperger syndrome: A guide for professionals and families. Springer.
18.
Fabri, M., & Moore, D. (2005). The use of emotionally expressive avatars in collaborative virtual environments. Virtual Social Agents, 88, 151.
19.
GallupJ.LittleM.SerianniB.KocaozO. (2017). The potential of virtual environments to support soft-skill acquisition for individuals with autism. The Qualitative Report, 22(9), 2509–2532.
20.
Gantman, A., Kapp, S. K., Orenski, K., & Laugeson, E. A. (2012). Social skills training for young adults with high-functioning autism spectrum disorders: A randomized controlled pilot study. Journal of Autism and Developmental Disorders, 42(6), 1094–1103.
21.
Georgescu, A. L., Kuzmanovic, B., Roth, D., Bente, G., & Vogeley, K. (2014). The use of virtual characters to assess and train non-verbal communication in high-functioning autism. Frontiers in human neuroscience, 8, 807.
22.
GohD. H.AngR. P.TanH. C. (2008). Strategies for designing effective psychotherapeutic gaming interventions for children and adolescents. Computers in Human Behavior, 24(5), 2217–2235. https://doi.org/10.1016/j.chb.2007.10.007
23.
Granic, I., Lobel, A., & Engels, R. C. (2014). The benefits of playing video games. American psychologist, 69(1), 66.
24.
GrossardC.GrynspanO.SerretS.JouenA.-L.BaillyK.CohenD. (2017). Serious games to teach social interactions and emotions to individuals with autism spectrum disorders (ASD). Computers & Education, 113(Supplement C), 195–211. https://doi.org/10.1016/j.compedu.2017.05.002
25.
HamariJ.ShernoffD. J.RoweE.CollerB.Asbell-ClarkeJ.EdwardsT. (2016). Challenging games help students learn: An empirical study on engagement, flow and immersion in game-based learning. Computers in Human Behavior, 54, 170–179. https://doi.org/10.1016/j.chb.2015.07.045
26.
HessT.GunterG. (2013). Serious game‐based and nongame‐based online courses: Learning experiences and outcomes. British Journal of Educational Technology, 44(3), 372–385. https://doi.org/10.1111/bjet.12024
27.
Hipp, J., Güntzer, U., & Nakhaeizadeh, G. (2000). Algorithms for association rule mining—a general survey and comparison. ACM sigkdd explorations newsletter, 2(1), 58–64.
28.
Hopson, J. (2001). Behavioral game design. Gamasutra, April, 27, 2001.
29.
Hornik, K., Grün, B., & Hahsler, M. (2005). arules-A computational environment for mining association rules and frequent item sets. Journal of statistical software, 14(15), 1–25.
30.
HullettK.NagappanN.SchuhE.HopsonJ. (2012). Empirical analysis of user data in game software development. Proceedings of the 2012 ACM-IEEE International Symposium on Empirical Software Engineering and Measurement, 89–98. https://doi.org/10.1145/2372251.2372265
31.
KeF. (2016). Designing and integrating purposeful learning in game play: A systematic review. Educational Technology Research and Development, 64(2), 219–244. https://doi.org/10.1007/s11423-015-9418-1
32.
KeF.ImT. (2013). Virtual-reality-based social interaction training for children with high-functioning autism. The Journal of Educational Research, 106(6), 441–461. https://doi.org/10.1080/00220671.2013.832999
33.
KeF.MoonJ. (2018). Virtual collaborative gaming as social skills training for high-functioning autistic children. British Journal of Educational Technology, 49(4), 728–741. https://doi.org/10.1111/bjet.12626
34.
KetelhutD. J. (2007). The impact of student self-efficacy on scientific inquiry skills: An exploratory investigation in River City, a multi-user virtual environment. Journal of Science Education and Technology, 16(1), 99–111.
35.
LaffeyJ. M.SchmidtM.StichterJ.SchmidtC.GogginsS. (2009). iSocial: A 3D VLE for youth with autism. Proceedings of the 9th International Conference on Computer Supported Collaborative Learning, 2, 112–114.
36.
LaffeyJ. M.StichterJ.GalyenK. (2014). Distance learning for students with special needs through 3D virtual learning. International Journal of Virtual and Personal Learning Environments, 5(2), 15–27. https://doi.org/10.4018/ijvple.2014040102
37.
LamerasP.ArnabS.DunwellI.StewartC.ClarkeS.PetridisP. (2017). Essential features of serious games design in higher education: Linking learning attributes to game mechanics. British Journal of Educational Technology, 48(4), 972–994. https://doi.org/10.1111/bjet.12467
38.
LanY.-J.HsiaoI. Y. T.ShihM.-F. (2018). Effective learning design of game-based 3D virtual language learning environments for special education students. Journal of Educational Technology & Society, 21(3), 213–227.
39.
MorfordZ. H.WittsB. N.KillingsworthK. J.AlavosiusM. P. (2014). Gamification: The Intersection between behavior analysis and game design technologies.The Behavior Analyst, 37(1), 25–40. https://doi.org/10.1007/s40614-014-0006-1
40.
Merceron, A., & Yacef, K. (2004). Mining student data captured from a web-based tutoring tool: Initial exploration and results. Journal of Interactive Learning Research, 15(4), 319–346.
41.
Miles, J., & Shevlin, M. (2001). Applying regression and correlation: A guide for students and researchers. Sage.
42.
Minaei-Bidgoli, B., Tan, P. N., & Punch, W. F. (2004, December). Mining interesting contrast rules for a web-based educational system. In 2004 International Conference on Machine Learning and Applications, 2004. Proceedings. (pp. 320–327). IEEE.
43.
Myles, B. S., & Simpson, R. L. (2001). Understanding the Hidden Curriculum: An Essential Social Skill for Children and Youth with Asperger Syndrome. Intervention in School and Clinic, 36(5), 279–286. https://doi.org/10.1177/105345120103600504
44.
NelsonB. C.ErlandsonB. E. (2008). Managing cognitive load in educational multi-user virtual environments: Reflection on design practice. Educational Technology Research and Development, 56(5), 619–641.
45.
Oladipupo, O. O., & Oyelade, O. J. (2010). Knowledge discovery from students' result repository: association rule mining approach. International Journal of Computer Science and Security, 4(2), 199–207.
46.
ParsonsS. (2015). Learning to work together: Designing a multi-user virtual reality game for social collaboration and perspective-taking for children with autism. International Journal of Child-Computer Interaction, 6, 28–38. https://doi.org/10.1016/j.ijcci.2015.12.002
47.
ParsonsS.MitchellP. (2002). The potential of virtual reality in social skills training for people with autistic spectrum disorders. Journal of Intellectual Disability Research: JIDR, 46(Pt 5), 430–443.
48.
ParsonsS.MitchellP.LeonardA. (2005). Do adolescents with autistic spectrum disorders adhere to social conventions in virtual environments?Autism, 9(1), 95–117. https://doi.org/10.1177/1362361305049032
49.
PellasN. (2014). The influence of computer self-efficacy, metacognitive self-regulation and self-esteem on student engagement in online learning programs: Evidence from the virtual world of Second Life. Computers in Human Behavior, 35, 157–170. https://doi.org/10.1016/j.chb.2014.02.048
50.
Raihan, M., Islam, Md. T., Ghosh, P., Hassan, Md. M., Angon, J. H., & Kabiraj, S. (2020). Human Behavior Analysis using Association Rule Mining Techniques. 2020 11th International Conference on Computing, Communication and Networking Technologies (ICCCNT), 1–5. https://doi.org/10.1109/ICCCNT49239.2020.9225662
51.
Risi, S., Lord, C., Gotham, K., Corsello, C., Chrysler, C., Szatmari, P., Cook, E. H., Leventhal, B. L., & Pickles, A. (2006). Combining Information From Multiple Sources in the Diagnosis of Autism Spectrum Disorders. Journal of the American Academy of Child & Adolescent Psychiatry, 45(9), 1094–1103. https://doi.org/10.1097/01.chi.0000227880.42780.0e
52.
Romero, C., Ventura, S., & De Bra, P. (2004). Knowledge discovery with genetic programming for providing feedback to courseware authors. User Modeling and User-Adapted Interaction, 14(5), 425–464.
53.
Rutten, A., Cobb, S., Neale, H., Kerr, S., Leonard, A., Parsons, S., & Mitchell, P. (2003). The AS interactive project: Single-user and collaborative virtual environments for people with high-functioning autistic spectrum disorders. The Journal of Visualization and Computer Animation, 14(5), 233–241. https://doi.org/10.1002/vis.320
54.
Rutter, M., Le Couteur, A., & Lord, C. (2003). Autism diagnostic interview, revised. Western Psych Services.
55.
SadlerT. D.RomineW. L.MenonD.FerdigR. E.AnnettaL. (2015). Learning biology through innovative curricula: A comparison of game‐ and nongame‐based approaches. Science Education, 99(4), 696–720. https://doi.org/10.1002/sce.21171
56.
Salen, K., TekinbaŞ, K. S., & Zimmerman, E. (2004). Rules of Play: Game Design Fundamentals. MIT Press.
57.
SailerM.HenseJ. U.MayrS. K.MandlH. (2017). How gamification motivates: An experimental study of the effects of specific game design elements on psychological need satisfaction. Computers in Human Behavior, 69, 371–380. https://doi.org/10.1016/j.chb.2016.12.033
58.
SilvaS. D.NetoF. M.LimaR. M.MacedoF. T.SantoJ. R.SilvaW. L. (2017). Knowledgemon hunter: A serious game with geolocation to support learning of children with autism and learning difficulties. In 2017 19th symposium on virtual and augmented reality (SVR) (pp. 293–296). https://doi.org/10.1109/SVR.2017.45
59.
Standen, P. J., & Brown, D. J. (2006). Virtual reality and its role in removing the barriers that turn cognitive impairments into intellectual disability. Virtual Reality, 10(3), 241–252.
60.
Stichter, J. P., Herzog, M. J., Visovsky, K., Schmidt, C., Randolph, J., Schultz, T., & Gage, N. (2010). Social competence intervention for youth with Asperger syndrome and high-functioning autism: An initial investigation. Journal of autism and developmental disorders, 40(9), 1067–1079.
61.
StichterJ. P.LaffeyJ.GalyenK.HerzogM. (2013). iSocial: Delivering the social competence intervention for adolescents (SCI-A) in a 3D virtual learning environment for youth with high functioning autism.Journal of Autism and Developmental Disorders, 44(2), 417–430. https://doi.org/10.1007/s10803-013-1881-0
62.
Tan, M., & Wu, M. (2018). An association rule model of course recommendation in MOOCs: Based on edX platform. European Scientific Journal, ESJ, 14(25), 284–292.
63.
TewC.Giraud-CarrierC.TannerK.BurtonS. (2014). Behavior-based clustering and analysis of interestingness measures for association rule mining. Data Mining and Knowledge Discovery, 28(4), 1004–1045. https://doi.org/10.1007/s10618-013-0326-x
64.
WangX.LaffeyJ.XingW.GalyenK.StichterJ. (2017). Fostering verbal and non-verbal social interactions in a 3D collaborative virtual learning environment: A case study of youth with autism spectrum disorders learning social competence in iSocial. Educational Technology Research and Development, 1–25. https://doi.org/10.1007/s11423-017-9512-7
65.
WangX.XingW.LaffeyJ. M. (2018). Autistic youth in 3D game-based collaborative virtual learning: Associating avatar interaction patterns with embodied social presence. British Journal of Educational Technology, 49(4), 742–760. https://doi.org/10.1111/bjet.12646
66.
WarburtonS. (2009). Second Life in higher education: Assessing the potential for and the barriers to deploying virtual worlds in learning and teaching. British Journal of Educational Technology, 40(3), 414–426. https://doi.org/10.1111/j.1467-8535.2009.00952.x
67.
Willis, J., & Todorov, A. (2006). First impressions: Making up your mind after a 100-ms exposure to a face. Psychological science, 17(7), 592–598.
68.
WhyteE. M.SmythJ. M.ScherfK. S. (2015). Designing serious game interventions for individuals with autism.Journal of Autism and Developmental Disorders, 45(12), 3820–3831. https://doi.org/10.1007/s10803-014-2333-1
69.
Zaiane, O. R. (2002). Building a recommender agent for e-learning systems. International Conference on Computers in Education, 2002. Proceedings., 55–59 vol.1. https://doi.org/10.1109/CIE.2002.1185862
