Staffing reduction initiatives and more complicated military operations lead to a higher cognitive workload in command and control (C2) environments. Extending automation with adaptive capabilities can aid the human in overcoming cognitive workload challenges. At present, most adaptive automation research has focused on laboratory experiments and only limited research has aimed to implement and validate adaptive automation in a real-world setting. The objective of the present study was to investigate the effects of adaptive automation in precisely such a setting, extending the scientific knowledge base of adaptive systems with an evaluation of a real-world adaptive task. Implementing adaptive automation in a real-world C2 setting required extending current adaptive automation theories with an object-oriented task model and a hybrid triggering mechanism. The extended model was evaluated with eight naval officers using a high-fidelity C2 environment and showed an overall efficiency effect of 60%. Furthermore, no negative side effects of adaptive automation have been found, and the data show that the scenarios were manipulated correctly. In addition, the positive efficiency effects appear most strongly in the more complicated asymmetrical scenarios (65%). This latter conclusion shows that adaptive automation can be a valuable contribution to future C2 systems.
Get full access to this article
View all access options for this article.
References
1.
ArcherR. D.LockettJ. F.(1997).WinCrew—a tool for analyzing performance, mental workload and functional allocation among operators In Proceedings of the First International Conference on Allocation and Functions (ALLFN′97; pp. 157–165) Galway, Ireland: IEA Press
2.
ArciszewskiH. F. R.de GreefT. E.van DelftJ. H.(2009).Adaptive automation in a naval combat management systemIEEE Transactions on Systems, Man, and Cybernetics—Part A: Systems and Humans, 39(6), 1188–1199
3.
BaileyN. R.ScerboM. W.FreemanF. G.MikulkaP. J.ScottL. A.(2006).Comparison of a brain-based adaptive system and a manual adaptable system for invoking automationHuman Factors, 48, 693–709
4.
5.
BillingsC. E.WoodsD. D.(1994).Concerns about adaptive automation in aviation systems In MoulouaM.ParasuramanR. (Eds.), Human performance in automated systems: Current research and trends (pp. 24–29). Mahwah, NJ: Erlbaum
6.
7.
BowersC. A.JentschF.SalasE.BraunC. C.(1998).Analyzing communication sequences for team training needs assessmentHuman Factors, 40, 672–679
8.
BoydJ. R.(1987).An organic design for command and control. A discourse on winning and losing. Unpublished lecture notes
9.
ByrneE. A.ParasuramanR.(1996).Psychophysiology and adaptive automationBiological Psychology, 42(3), 249–268
10.
ClamannM.KaberD.(2003).Authority in adaptive automation applied to various stages of human-machine system information processing In Proceedings of the Human Factors and Ergonomics Society 47th Annual Meeting (pp. 543–547). Santa Monica, CA: SAGE Publications
11.
ClamannM. P.WrightM. C.KaberD. B.(2002).Comparison of performance effects of adaptive automation applied to various stages of human-machine system information processing In Proceedings of the Human Factors and Ergonomics Society 46th Annual Meeting (pp. 342–346). Santa Monica, CA: SAGE Publications
12.
CohenJ.(1992).A power primerPsychological Bulletin, 112, 115–159
13.
de GreefT. E.ArciszewskiH. F. R.(2009).Triggering adaptive automation in naval command and control In CongS. (Ed.), Frontiers in adaptive control (pp. 165–188). Vienna: I-Tech
14.
EndsleyM.KirisE.(1995).The out-of-the-loop performance problem and level of control in automationHuman Factors, 37, 381–394
15.
EndsleyM. R.(1987).The application of human factors to the development of expert systems for advanced cockpits In Proceedings of the Human Factors Society 31st Annual Meeting (pp. 1388–1392). Santa Monica, CA: SAGE Publications
16.
EndsleyM. R.KaberD. B.(1999).Level of automation effects on performance, situation awareness and workload in a dynamic control taskErgonomics, 42, 462–492
17.
18.
GrabowskiM.SanbornS. D.(2003).Human performance and embedded intelligent technology in safety-critical systemsInternational Journal of Human-Computer Studies, 58, 637–670
19.
GrootjenM.NeerincxM. A.WeertJ. C. M.(2006, October).Task-based interpretation of operator state information for adaptive support. Paper presented at the Human Factors and Ergonomics Society 50th Annual Meeting, San Francisco, CA
20.
HancockP.ChignellM.LowenthalA.(1985).An adaptive human-machine system In Proceedings of the IEEE Conference on Systems, Man and Cybernetics (pp. 627–629). New York: Association for Computing Machinery
21.
HilburnB.JornaP. G.ByrneE. A.ParasuramanR.(1997).The effect of adaptive air traffic control (ATC) decision aiding on controller mental workload In MoulouaM.KoonceJ.HopkinV. D. (Eds.), Human-automation interaction: Research and practice (pp. 84–91). Mahwah, NJ: Erlbaum
22.
HilburnB.MolloyR.WongD.ParasuramanR.(1993).Operator versus computer control of adaptive automation In Proceedings of the Seventh International Symposium on Aviation Psychology (pp. 161–166). Columbus, OH: Ohio State University
23.
24.
InagakiT.(2000a).Situation-adaptive autonomy for time-critical takeoff decisionsInternational Journal of Modelling and Simulation, 20(2), 175–180
25.
InagakiT.(2000b, July 30–August 4). Situation-adaptive autonomy: Dynamic trading of authority between human and automation In Proceedings of the XIVth Triennial Congress of the International Ergonomics Association and 44th Annual Meeting of the Human Factors and Ergonomics Society (Vol. 3, pp. 13–16). Santa Monica, CA: SAGE Publications
26.
KaberD. B.EndsleyM.(2004).The effects of level of automation and adaptive automation on human performance, situation awareness and workload in a dynamic control taskTheoretical Issues in Ergonomics Science, 5(2), 113–153
27.
KaberD. B.OnalE.EndsleyM.(1999).Level of automation effects on telerobot performance and human operator situation awareness and subjective workload In ScerboM.MoulouaM. (Eds.), Automation technology and human performance: Current research and trends (pp. 165–170). Mahwah, NJ: Erlbaum
28.
KaberD. B.PerryC. M.SegallN.McClernonC. K.PrinzelL. J.III(2006).Situation awareness implications of adaptive automation for information processing in an air traffic control-related taskInternational Journal of Industrial Ergonomics, 36, 447–462
29.
KaberD. B.RileyJ. M.(1999).Adaptive automation of a dynamic control task based on secondary task workload measurementInternational Journal of Cognitive Ergonomics, 3(3), 169–187
30.
KaberD. B.WrightM. C.PrinzelL. J.ClamannM. P.(2005).Adaptive automation of human-machine system information-processing functionsHuman Factors, 47, 730–741
31.
KankiB. G.FolkV. G.IrwinC. M.(1991).Communication variations and aircrew performanceInternational Journal of Aviation Psychology, 1(2), 149–162
32.
33.
KleinG.WoodsD. D.BradshawJ. M.HoffmanR. R.FeltovichP. J.(2004).Ten challenges for marking automation a “team player” in joint human-agent activityIEEE Intelligent Systems, 19(6), 91–95
34.
LeeJ. D.(2006).Human factors and ergonomics in automation design In SalvendyG. (Ed.), Handbook of human factors and ergonomics (pp. 1571–1596). Hoboken, NJ: Wiley
35.
LeeJ. D.SanquistT. F.(2000).Augmenting the operator function model with cognitive operations: Assessing the cognitive demands of technological innovation in ship navigationIEEE Transactions on Systems, Man and Cybernetics—Part A: Systems and Humans, 30, 273–285
36.
MorayN.InagakiT.ItohM.(2000).Adaptive automation, trust, and self-confidence in fault management of time-critical tasksJournal of Experimental Psychology: Applied, 6(1), 44–57
37.
NeerincxM. A.(2003).Cognitive task load design: Model, methods and examples In HollnagelE. (Ed.), Handbook of cognitive task design (pp. 283–305). Mahwah, NJ: Erlbaum
38.
39.
40.
ParasuramanR.MoulouaM.MolloyR.(1996).Effects of adaptive task allocation on monitoring of automated systemsHuman Factors, 38, 665–679
41.
ParasuramanR.MoulouaM.MolloyR.HilburnB.(1993).Adaptive function allocation reduces performance costs of static automation In Proceedings of the Seventh International Symposium on Aviation Psychology (pp. 175–185). Columbus, OH: Ohio State University
42.
ParasuramanR.RileyV.(1997).Humans and automation: Use, misuse, disuse, abuseHuman Factors, 39, 230–253
43.
ParasuramanR.SheridanT. B.WickensC. D.(2000).A model for types and levels of human interaction with automationIEEE Transactions on Systems, Man, and Cybernetics—Part A: Systems and Humans, 30, 286–297
44.
PrinzelL.FreemanF.ScerboM.MikulkaP.PopeA.(2003).Effects of a psychophysiogical system for adaptive automation on performance, workload and event-related potential P300 componentHuman Factors, 45, 601–614
45.
PrinzelL. J.FreemanF. G.ScerboM. W.MikulkaP. J.PopeA. T.(2000).A closed-loop system for examining psychophysiological measures for adaptive task allocationInternational Journal of Aviation Psychology, 10, 393–410
46.
47.
RouseW. B.(1988).Adaptive aiding for human/computer controlHuman Factors, 30, 431–443
48.
RouseW. B.(1994).Twenty years of adaptive aiding: Origins of the concept and lessons learned In MoulouaM.ParasuramanR. (Eds.), Human performance in automated systems: Current research and trends (pp. 28–32). Mahwah, NJ: Erlbaum
49.
SarterN. B.WoodsD. D.(2000).Team play with a powerful and independent agent: A full-mission simulation studyHuman Factors, 42, 390–402
ScerboM.(1996).Theoretical perspectives on adaptive automation In ParasuramanR.MoulouaM. (Eds.), Automation and human performance: Theory and applications (pp. 37–63). Mahwah, NJ: Erlbaum
52.
ScerboM.(2001).Adaptive automation In KarwowskiW. (Ed.), International encyclopedia of ergonomics and human factors (pp. 1077–1079). London: Taylor & Francis
53.
54.
SperandioJ. C.(1971).Variations of operator's strategies and regulating effects on workloadErgonomics, 14, 571–577
55.
TraftonJ. G.MonkC. A.(2008).Task interruptions In Boehm-DavisD. A. (Ed.), Reviews of human factors and ergonomics (vol. 3, pp. 111–126). Santa Monica, CA: SAGE Publications
56.
57.
VeltmanJ. A.GaillardA. W. K.(1998).Physiological workload reactions to increasing levels of task difficultyErgonomics, 41, 656–669
58.
VeltmanJ. A.JansenC.(2004, March).The adaptive operator. Paper presented at the Human Performance, Situation Awareness and Automation Technology Conference, Daytona Beach, FL
59.
WickensC. D.(1984).Processing resources in attention In ParasuramanR.DaviesD. R. (Eds.), Varieties of attention (pp. 63–101). Orlando, FL: Academic Press
60.
WilsonG. F.RussellC. A.(2007).Performance enhancement in an uninhabited air vehicle task using psychophysiologically determined adaptive aidingHuman Factors, 49, 1005–1018
61.
WoodsD. D.TittleJ.FeilM.RoeslerA.(2004).Envisioning human-robot coordination in future operationsIEEE Transactions on Systems, Man and Cybernetics—Part C: Applications and Reviews, 34, 210–218
