In an increasingly connected world, it’s essential to have efficient teams. Training is a common method used to maintain or improve team performance. However, implementing high quality team training can be costly and require a significant amount of time and effort. An Intelligent Tutoring System (ITS) designed for a team, or an Intelligent Team Tutoring System (ITTS), can provide a solution that would reduce the cost, time, and effort required to implement high quality training. Few studies have examined the influence that feedback delivered by an ITTS has on an individual’s perception of their performance and their team’s performance. This within-subjects study, in which 117 participants (39 teams) completed a virtual shopping mall task, addresses this gap. Results indicate that user interface (UI) designers should display either Individual feedback or Team feedback, not both, to give users a correct perception of their performance and their team’s performance.
Get full access to this article
View all access options for this article.
References
1.
Archer-KathJ.JohnsonD. W.JohnsonR. T. (1994), 10. Individual versus Group Feedback in Cooperative Groups. The Journal of Social Psychology, 134(5), 681–694. doi: 10.1080/00224545.1994.9922999
2.
AustinJ.KesslerM. L.RiccobonoJ. E.BaileyJ. S. (1996). Using Feedback and Reinforcement to Improve the Performance and Safety of a Roofing Crew. Journal of Organizational Behavior Management, 16(2), 49–75. doi: 10.1300/J075v16n02{\_}04
3.
BillingsD. R. (2012, 3). Efficacy of Adaptive Feedback Strategies in Simulation-Based Training. Military Psychology, 24(2), 114–133. doi: 10.1080/08995605.2012.672905
4.
Cannon-BowersJ. a.SalasE. (1998). Team Performance and Training in Complex Environments: Recent Findings From Applied Research. Current Directions in Psychological Science, 7(3), 83–87. doi: 10.1111/1467-8721.ep10773005
5.
DeShonR. P.KozlowskiS. W. J.SchmidtA. M.MilnerK. R.Wiech- mannD. (2004, 12). A Multiple-Goal, Multilevel Model of Feedback Effects on the Regulation of Individual and Team Performance. The Journal of applied psychology, 89(6), 1035–56. doi: 10.1037/0021-9010.89.6.1035
6.
DriskellJ. E.SalasE.DriskellT. (2018, 5). Foundations of team- work and collaboration. American Psychologist, 73(4), 334–348. doi: 10.1037/amp0000241
7.
GabelicaC.BosscheP. V. D.SegersM.GijselaersW. (2012, 6). Feedback, a powerful lever in teams: A review. Educational Research Review, 7(2), 123–144. doi: 10.1016/j.edurev.2011.11.003
8.
GilbertS. B.DorneichM.WaltonJ.WinerE. (2018). Five Lenses on Team Tutor Challenges: A Multidisciplinary Approach. In JohnstonJ.SottilareR.SinatraA. M.BurkeC. S. (Eds.), Building intelligent tutoring systems for teams (pp. 247–277). Bingley, UK: Emerald Publishing.
9.
GraesserA. C.HuX.SottilareR. A. (2018). Intelligent tutoring systems. In FischerF.Hmelo-SilverC. E.GoldmanS. R.ReimannP. (Eds.), International handbook of the learning sciences (pp. 246–255). New York: Routledge.
10.
HartS. G.StavelandL. E. (1988). Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research. Advances in Psychology, 52, 139–83.
11.
IlgenD. R.FisherC. D.TaylorM. S. (1979). Consequences of Individual Feedback on Behavior in Organizations. Journal of Applied Psychology, 64(4), 349–371. doi: 10.1037//0021-9010.64.4.349
12.
KalyugaS. (2007, 10). Expertise Reversal Effect and Its Implications for Learner-Tailored Instruction. Educational Psychology Review, 19(4), 509–539. doi: 10.1007/s10648-007-9054-3
13.
KoedingerK. R.AlevenV.HockenberryM.McLarenB. M.HeffernanN. (2004). Opening the door to non-programmers: Authoring intelligent tutor behavior by demonstration. In Proceedings of the seventh international conference of intelligent tutoring systems. Maceio, Brazil.
14.
MorelandR. L.MyaskovskyL. (2000, 5). Exploring the Performance Benefits of Group Training: Transactive Memory or Improved Communication?Organizational Behavior and Human Decision Processes, 82(1), 117–133. doi: 10.1006/obhd.2000.2891
15.
Scott-YoungC. M.SamsonD. (2006, 8). Modeling Team Efficacy in Project Management: an explorartory study. Academy of Management Proceedings, 2006(1), D1-D6. doi: 10.5465/ambpp.2006.27175183
16.
ShalliceT.BurgessP. W. (1991). Deficits in Strategy Application Following Frontal Lobe Damage in Man. Brain, 114, 727–741.
17.
ShannonC. E. (1948, 7). A Mathematical Theory of Communication. Bell System Technical Journal, 27(3), 379–423. doi: 10.1002/j.1538-7305.1948.tb01338.x
18.
SiegelS.CastellanN. JJr.. (1988). Nonparametric statistics for the behavioral sciences, 2nd ed.New York, NY, England: Mcgraw-Hill Book Company.
19.
SivunenA. (2006). Strengthening Identification with the Team in Virtual Teams: The Leaders’ Perspective. Group Decision and Negotiation, 15(4), 345–366. doi: 10.1007/s10726-006-9046-6
20.
Smith-JentschK. A.SalasE.BakerD. p. (1996, 12). Training Team Performance-Related Assertiveness. Personnel Psychology, 49(4), 909–936. doi: 10.1111/j.1744-6570.1996.tb02454.x
21.
SuhH.LeeS. (2006). Collaborative Learning Agent for Promoting Group Interaction. ETRI Journal, 28(4), 461–474. doi: 10.4218/etrij.06.0105.0235
22.
TindaleR. S. (1989). Group vs Individual Information Processing : The Effects of Outcome Feedback on Decision Making. Organizational Behavior and Human Decision Processes, 44, 454–473.
23.
WalterF.Van Der VegtG. S. (2009, 8). Harnessing Positive Mood for Team Learning Facilitation: the role of perceived team feedback. Academy of Management Proceedings, 2009(1), 1–6. doi: 10.5465/ambpp.2009.44243035
24.
WaltonJ.BonnerD.WalkerK.MaterS.DorneichM.GilbertS. B.WestR. (2015). The Team Multiple Errands Test: A Platform to Evaluate Distributed Teams. In Proceedings of the 18th acm conference companion on computer supported cooperative work & social computing - cscw’15 companion (pp. 247–250). New York, New York, USA: ACM Press. doi: 10.1145/2685553.2699018
25.
WaltonJ.GilbertS. B.WinerE.DorneichM.BonnerD. (2015). Evaluating Distributed Teams with the Team Multiple Errands Test. In Proceedings of interservice/industry training, simulation, and education conference (i/itsec).
