Do training methods differentially impact task performance? This paper discusses a set of meta-analytic studies being conducted as part of an ongoing research project to identify evidence-based guidelines for training the complex cognitive skills involved in technology related task domains. Given an emphasis on complex cognitive tasks and training transfer, our current focus is on training methods for effectively managing learner effort and workload during training. In this paper we identify six prominent training methods and present a deeper look at the results for two different meta-analysis strategies. Small to moderate overall beneficial effects were found for three of the six training strategies (adaptive training, error prevention (training wheels) and scaffolding). No benefit was found for learner control and exploratory learning. An overall cost for part task training was associated with its failure to train a time sharing skill. The modest benefit for error prevention was amplified for cognitive skills.
Get full access to this article
View all access options for this article.
References
1.
AlligerG. M.TannenbaumS. I.. (1997). A Meta-Analysis of the Relations Among Training Criteria. Personnel Psychology50(2), 341-358.
2.
AlvarezK.SalasE.GarofanoC. M. (2004). An integrated model of training evaluation and effectiveness. Human Resource Development Review, 3(4), 385-416.
3.
ArthurW.Jr.BennettW.Jr.. (2003). Effectiveness of Training in Organizations: A Meta-Analysis of Design and Evaluation Features. Journal of Applied Psychology88(2), 234-245.
4.
AzevedoR.BernardR. M. (1995). A meta-analysis of the effects of feedback in computer-based instruction. Journal of Educational Computing Research13(2), 111-127.
5.
BaldwinT.T.FordJ.K. (1988). Transfer of training: A review and directions for future research. Personnel Psychology, 41, 63-105.
6.
BellBradford S.KozlowskiSteve W. J. (2008). Active learning: Effects of core training design elements on self-regulatory processes, learning, and adaptability. Journal of Applied Psychology, 93(2), 296-316
7.
BjorkR. A. (1999). Assessing our own competence: Heuristics and illusions. In GopherD.KoriatA. (Eds.), Attention and performance XVII. Cognitive regulation of performance: Interaction of theory and application (pp. 435-459). Cambridge, MA: MIT Press.
8.
BlumeB.FordJ.BaldwinT.HuangJ. (2009). Transfer of Training: A Meta Analytic Review. Journal of Management, 36(4), 1065-1105.
9.
BorensteinM.HedgesL.HigginsJ.RothsteinH. (2009). Introduction to Meta-Analysis. John Wiley & Sons, Ltd.
10.
BriggsG.NaylorJ. (1962). The Relative Efficiency of Several Training Methods as a Function of Transfer Task Complexity. Journal of Experimental Psychology, 64(5), 505-512.
11.
CarrollJ. (1990). The Nurnberg Funnel: Designing minimalist instruction for practical computer skills. Cambridge Ma. MIT Press.
FontanaF. E.MazzardoO.FurtadoO.Jr.GallagherJ. D. (2009). Whole and part practice: A meta-analysis. Perceptual and Motor Skills, 109(2), 517-530.
14.
FreitagE.T.SullivanH.J. (1995). Matching Learning Preference to Amount of Instruction: An Alternative Form of Learner Control. Educational Technology Research and Development, 43(2), 5-14.
15.
FriendC.L.ColeC.L. (1990). Learner Control in Computer-based Instruction: A Current Literature Review. Educational Technology, 20, 47-49.
16.
HigginsJPTGreenS (editors). Cochrane Handbook for Systematic Reviews of InterventionsVersion 5.0.2 [updated September 2009]. The Cochrane Collaboration, 2009. Available from www.cochranehandbook.org
17.
KeithN.FreseM. (2008). Effectiveness of Error Management Training: A Meta-Analysis. Journal of Applied Psychology93(1), 59-69.
18.
KellyC.R. (1969a). Adaptive and Automated Research Techniques from Engineering Psychology. American Psychologist, 24(3), 293-297.
19.
KellyC.R. (1969b). What is Adaptive Training?Human Factors, 11(6), 547-556.
20.
KraigerK.JerdenE. (2007). A meta-analytic investigation of learner control: Old findings and new directions. In FioreS.M.SalasE. (Eds.), Toward a science of distributed learning (pp. 65-90). Washington, DC: American Psychological Association.
21.
ManeA.ColesM.WickensC.D.DonchinE. (1983). The use of additive factors methodology in the analysis of a skill. Proceedings of the 27th Annual Meeting of the Human Factors Society. Santa Monica, CA: Human Factors Society
22.
ManeAAdamsJDonchinE. (1989) Adaptive and part-whole training in the acquisition of a complex perceptual-motor skill. Acta Psychologica, 71179-196.
23.
MeansB.ToyamaY.MurphyR.BakiaM.JonesK. (2009). Evaluation of Evidence-Based Practices in Online Learning: A Meta-Analysis and Review of Online Learning Studies, US Department of Education.
24.
NaylorJ.BriggsG. (1963). Effects of Task Complexity and Task Organization on the Relative Efficiency of Part and Whole Training Methods. Journal of Experimental Psychology, 65(3), 217-224.
25.
PaasF.RenklA.SwellerJ. (2003). Cognitive Load Theory and Instructional Design: Recent Developments. Educational Psychologist, 38(1), 1-4.
26.
PaasF.Van GogT. (2009). Principles for designing effective and efficient training of complex cognitive skills. In DursoF. T. (Ed.), Reviews of human factors and ergonomics, 5 (pp 166-194). Human Factors and Ergonomics Society.
27.
PeaR.D. (2004). The Social and Technological Dimensions of Scaffolding and Related Theoretical Concepts for Learning, Education, and Human Activity. The Journal of the Learning Sciences, 13(3), 423-451.
28.
RenklA.StarkR.GruberH.MandlH. (1998). Learning from worked-out examples: The effects of example variability and elicited self-explanations. Contemporary Educational Psychology, 23, 90-108.
29.
RosenthalR. (1991). Meta-Analytic Procedures for Social Research. Rev Ed. Sage Publications, Inc., Beverly Hills, CA.
30.
SchmidtR. A.BjorkR. A. (1992). New conceptualizations of practice: Common principles in three paradigms suggest new concepts for training. Psychological Science, 3, 207-217.
31.
SitzmannT.KraigerK.StewartD.WisherR. (2006). The comparative effectiveness of web-based and classroom instruction: A meta-analysis. Personnel Psychology, 59 (3), 623-664.
32.
SlameckaN.J.GrafP. (1978). The Generation Effect: Delineation of a Phenomenon. Journal of Experimental Psychology: Human Learning and Memory, 4(6), 592-604.
33.
SwellerJ. (1988). Cognitive Load During Problem Solving: Effects on Learning. Cognitive Science, 12(2), 257-285.
34.
TannenbaumS. I.MathieuJ. E.SalasE.Cannon-BowersJ. A. (1991). Meeting trainees’ expectations: The influence on the development of commitment, self-efficacy, and motivation. Journal of Applied Psychology, 76, 759–769.
35.
Van MerriёnboerJ.J.G.KesterL.PaasF. (2006). Teaching complex rather than simple tasks: balancing intrinsic and germane load to enhance transfer of learning. Applied Cognitive Psychology20, 343-352.
36.
WightmanD.LinternG. (1985). Part task training for tracking and manual control. Human Factors, 27, 267-284.
37.
WoodM.E. (1970). Continuously Adaptive versus Discrete Changes of Task Difficulty in the Training of a Complex Perceptual-Motor Task. AFHRL-TR-70-30, Air Force Human Resources Laboratory Air Force Systems Command, Williams Air Force.
