Understanding Cognitive Strategy With Adaptive Automation in Dual-Task Performance Using Computational Cognitive Models

Abstract

The objectives of this study were to investigate the effects of advance auditory cuing of control mode changes in an adaptively automated system on human performance and to explain cognitive behaviors at mode changes by using a computational cognitive model. A dual-task piloting simulation, involving tracking and tactical decision making, was developed to collect human performance data with auditory cuing or no cuing of mode transitions in the tactical task. Computational GOMS (goal, operators, methods, and selection) language models were coded to simulate user behavior on the basis of expectation of increased memory transactions (between long-term and working stores) at mode transitions. The models were applied to the same task simulation and scenarios performed by the humans. Human performance data did not reveal differences between cued and no-cue trials possibly because of distraction from the tracking (secondary loading) task. Comparison of results for human and model output demonstrated the model to be descriptive of the pattern of human performance across conditions but not accurate in predicting timing of memory use in preparing for manual control. A refined GOMS language model was coded on the basis of a modified assumption that memory stores are used on an ad hoc basis after high-workload mode transitions and with consideration of human parallel processing in dual-task performance. Results revealed the refined model to have greater plausibility for representing actual behavior. The manner of operator use of memory stores for controlling an adaptive system provides insight into the impact of cuing of mode transitions and a basis for future systems design.

Keywords

auditory cues flight simulation adaptive automation manual control deficits mode transitions cognitive models

Get full access to this article

View all access options for this article.

References

Anderson

J. R.

Bothell

Byrne

M. D.

Douglass

Lebiere

Qin

(2004). An integrated theory of the mind. Psychological Review, 111, 1036–1060.

Bailey

N. R.

Scerbo

M. W.

Freeman

F. G.

Mikulka

P. J.

Scott

L. A.

(2006). Comparison of a brain-based adaptive system and a manual adaptable system for invoking automation. Human Factors, 48, 693–709.

Ballas

J. A.

Heitmeyer

C. L.

Perez

M. A.

(1992). Evaluating two aspects of direct manipulation in advanced cockpits. In Proceedings of the CHI ’92 Conference on Human Factors in Computing Systems (pp. 127–134). New York, NY: Addison-Wesley.

Billings

C. E.

Woods

D. D.

(1994). Concerns about adaptive automation in aviation systems. In Mouloua

Parasuraman

(Eds.), Human performance in automated systems: Current research and trends (pp. 264–269). Hillsdale, NJ: Lawrence Erlbaum.

Card

S. K.

Moran

T. P.

Newell

(1983). The psychology of human-computer interaction. Hillsdale, NJ: Lawrence Erlbaum.

Endsley

M. R.

Kaber

D. B.

(1999). Level of automation effects on performance, situation awareness and workload in a dynamic control task. Ergonomics, 42, 462–492.

Gray

W. D.

John

B. E.

Atwood

M. E.

(1993). Project Ernestine: A validation of GOMS for prediction and explanation of real-world task performance. Human-Computer Interaction, 8, 237–309.

Hadley

G. A.

Prinzel

L. J.

Freeman

F. G.

Mikulka

P. J.

(1999). Behavioral, subjective and psychophysiological correlates of various schedules of short-cycle automation. In Scerbo

M. W.

Mouloua

(Eds.), Automation technology and human performance (pp. 139–143). Mahwah, NJ: Lawrence Erlbaum.

John

B. E.

Vera

(1992). A GOMS analysis of a graphic, machine-paced, highly interactive task. In Proceedings of CHI ‘92 (pp. 626–633). New York: ACM.

10.

Kaber

D. B.

Riley

J. M.

(1999). Adaptive automation of a dynamic control task based on secondary task workload measurement. International Journal of Cognitive Ergonomics, 3, 169–187.

11.

Kaber

D. B.

Wang

Kim

S.-H.

(2006). Computational cognitive modeling of operator behavior in telerover navigation. In Proceedings of the 2006 IEEE International Conference on System, Man, and Cybernetics (pp. 3210–3125). Taipei, Taiwan.

12.

Kaber

D. B.

Wang

Kim

S.-H.

(2011). Computational cognitive modeling of human-robot interaction using a GOMS methodology. In Wang

(Ed.), Mixed reality and human robot interaction (pp. 53–75). Dordrecht, Netherlands: Springer.

13.

Kaber

D. B.

Wright

M. C.

(2003). Automation-state changes and sensory cueing in telerobot control. In Proceeding of the XVth Triennial Congress of the International Ergonomics Association (CD-ROM). Seoul, Korea.

14.

Kessel

C. J.

Wickens

C. D.

(1982). The transfer of failure-detection skills between monitoring and controlling dynamic systems. Human Factors, 24, 49–60.

15.

Kieras

D. E.

(1997). A guide to GOMS model usability evaluation using NGOMSL. In Helander

Landauer

T. K.

Prabhu

(Eds.), Handbook of human-computer interaction (pp. 733–766). Amsterdam, Netherlands: Elsevier Science.

16.

Kieras

D. E.

(1998). A guide to GOMS model usability evaluation using GOMSL and GLEAN3 (Tech. Rep. No. 38, TR-98/ARPA-2). Ann Arbor: University of Michigan, Electrical Engineering and Computer Science Department.

17.

Kieras

D. E.

Meyer

D. E.

(1995). Predicting human performance in dual-task tracking and decision making with computational models using the EPIC architecture. In Proceedings of the 1995 International Symposium on Command and Control Research and Technology (pp. 1–12). Washington, DC: National Defense University.

18.

Kieras

D. E.

Wood

S. D.

Abotel

Hornof

(1995). GLEAN: A computer-based tool for rapid GOMS model usability evaluation of user interface designs. In UIST95, Proceedings of the ACM Symposium on User Interface Software and Technology (pp. 91–100). New York, NY: ACM.

19.

Newman

W. M.

Lamming

M. G.

(1995). Interactive System Design. Reading, MA: Addison-Wesley.

20.

Olson

J. R.

Olson

G. M.

(1990). The growth of cognitive modeling in human-computer interaction since GOMS. Human-Computer Interaction, 5, 221–265.

21.

Parasuraman

Mouloua

Molloy

(1996). Effects of adaptive task allocation on monitoring of automated systems. Human Factors, 38, 665–679.

22.

Parasuraman

Sheridan

T. B.

Wickens

C. D.

(2000). A model of types and levels of human interaction with automation. IEEE Transactions on Systems, Man & Cybernetics, 30, 286–297.

23.

Sarter

N. B.

Woods

D. D.

(1995). How in the world did we ever get into that mode? Mode error and awareness in supervisory control. Human Factors, 37, 5–19.

24.

Sklar

A. E.

Sarter

N. B.

(1999). Good vibrations: Tactile feedback in support of attention allocation and human-automation coordination in event-driven domains. Human Factors, 41, 534–552.

25.

Soar Technology. (2005). EGLEAN science and technology report: The first six months. Ann Arbor, MI: Author.

26.

Trafton

J. G.

Altmann

E. M.

Brock

D. P.

Mintz

F. E.

(2003). Preparing to resume an interrupted task: Effects of prospective goal encoding and retrospective rehearsal. International Journal of Human-Computer Studies, 58, 583–603.

27.

Wickens

C. D.

(1992). Engineering psychology and human performance. Columbus, OH: Merrill.