Computational GOMSL Modeling towards Understanding Cognitive Strategy in Dual-Task Performance with Automation

Abstract

The objective of this study was to assess the use of a computational cognitive model for describing human performance with an adaptively automated system, with and without advance cueing of control mode transitions. A dual-task piloting simulation was developed to collect human performance data under auditory cueing or no cueing of automated or manual control. GOMSL models for simulating user behavior were constructed based on a theory of increased memory transactions at mode transitions. The models were applied to the same task simulation and scenarios performed by the humans. Comparison of results on human and model output demonstrated the model to be generally descriptive of performance; however, it was not accurate in predicting timing of memory use in preparing for manual control. Interestingly, the human data didn't reveal differences between cued and no cue trials. A refined GOMSL model was developed by modifying assumptions on the timing and manner of memory use, and considering human parallel processing in dual-task performance. Results revealed the refined model to be more plausible for representing behavior. Computational cognitive modeling appears to be a viable approach to represent operator performance in adaptive systems.

Get full access to this article

View all access options for this article.

References

Agre

P. E.

Chapmen

D.P.

(1987). Pengi: An implementation of a theory of activity, in proceeding of the Sixth National Conference on Artificial Intelligence (AAAI-87), Milan: Morgan Kaufmann, 268–272.

Ballas

J.A.

Heitmeyer

C.L.

Perez

M.A

(1992). Evaluating two aspects of direct manipulation in advanced cockpits. In Bauersfeld

Bennet

Lynch

(Eds.), Proceedings of the CHI ′92 Conference on Human Factors in Computing Systems, New York: Addison-Wesley.

Card

S.K.

Moran

T.P.

Newell

(1983). The psychology of human-computer interaction. Hillsdale, NJ: Erlbaum.

Gray

W.D.

John

B.E.

Atwood

M.E

(1993). Project Ernestine: A validation of GOMS for prediction and explanation of real-world task performance. Human-Computer Interaction, 8(3), 237–309.

John

B.E.

Vera

A.H.

(1992). A GOMS analysis of a graphic, machine-paced highly interactive task, in Proceedings of the CHI′92 Conference on Human Factors in Computing Systems, New York: Addison-Wesley, 626–633.

Kaber

D.B.

Wright

M.C.

(2003). Automation-state changes and sensory cueing in telerobot control. In Proceeding of the XVth Triennial Congress of the International Ergonomics Association (CD-ROM). Seoul, Korea, August 24–29.

Kaber

D. B.

Perry

C. M.

Kim

S-H.

(2006a). Investigation of manual control performance deficits in adaptive automation and a cognitive modeling explanation. (Final Rep.: NASA Langley Research Center Grant#NNL05AA20G). Hampton, VA: NASA Langley Research Center.

Kaber

D.B.

Wang

Kim

S-H.

(2006b). Computational Cognitive Modeling of Operator Behavior in Telerover Navigation. In Proc. Of the 2006 IEEE International Conference on System, Man, and Cybernetics, Taipei, Taiwan, October 8–11.

Kessel

C.J.

Wickens

C.D.

(1982). The transfer of failure-detection skills between monitoring and controlling dynamic systems. Human Factors, 24(1), 49 60.

10.

Kieras

D.E.

(1997). A guide to GOMS model usability evaluation using NGOMSL, in Handbook of human-computer interaction, Helander

Landauer

T.K.

Prabhu

, Eds. Amsterdam: Elsevier Science, 733–766.

11.

Kieras

D.E.

(1998). A guide to GOMS model usability evaluation using GOMSL and GLEAN3. University of Michigan, Electrical Engineering and Computer Science Department, Ann Arbor, MI, Tech. Rep. No. 38, TR-98/ARPA-2.

12.

Kieras

D.E.

Meyer

D.E.

(1995). Predicting human performance in dual-task tracking and decision making with computational models using the EPIC architecture, in the Proceedings of the 1995 International Symposium on Command and Control Research and Technology, Washington, D.C.: National Defense University.

13.

Kieras

D.E.

Meyer

D.E.

Ballas

J.A.

Lauber

E.J.

(1999). Modern computational perspectives on executive mental processes and cognitive control: Where to from here? (EPIC Report: No. 12, RT-99/ONR-EPIC-12). Washington, D.C.: Office of Naval Research.

14.

Olson

J. R.

Olson

G. M.

(1990). The growth of cognitive modeling in human-computer interaction since GOMS. Human-Computer Interaction, 5, 221 265.

15.

Sarter

N. B.

Woods

D. D.

(1995). How in the world did we ever get into that mode? Mode error and awareness in supervisory control. Human Factors, 37, 5 19.

16.

Soar Technology (2005). EGLEAN Science and Technology Report: The first six months, AUTHOR, Ann Arbor, MI.

17.

Trafton

J.G.

Altmann

E.M.

Brock

D.P.

Mintz

F.E.

(2003). Preparing to resume an interrupted task: Effects of prospective goal encoding and retrospective rehearsal. International Journal of Human-Computer Studies, 58, 583 603.