Objective: In this article, I present the ideas and trends that have given rise to the use of cognitive architectures in human factors and provide a cognitive engineering—oriented taxonomy of these architectures and a snapshot of their use for cognitive engineering. Background: Architectures of cognition have had a long history in human factors but a brief past. The long history entails a 50-year preamble, whereas the explosion of work in the current decade reflects the brief past. Understanding this history is key to understanding the current and future prospects for applying cognitive science theory to human factors practice. Method: The review defines three formative eras in cognitive engineering research: the 1950s, 1980s, and now. Results: In the first era, the fledging fields of cognitive science and human factors emphasized characteristics of the dancer, the limited capacity or bounded rationality view of the mind, and the ballroom, the task environment. The second era emphasized the dance (i.e., the dynamic interaction between mental operations and task environment). The third era has seen the rise of cognitive architectures as tools for choreographing the dance of mental operations within the complex environments posed by human factors practice. Conclusions: Hybrid architectures present the best vector for introducing cognitive science theories into a renewed engineering-based human factors. Application: The taxonomy provided in this article may provide guidance on when and whether to apply a cognitive science or a hybrid architecture to a human factors issue.
Get full access to this article
View all access options for this article.
References
1.
Altmann, E.M., & Gray, W.D. (2008, in press). An integrated model of cognitive control in task switching. Psychological Review, 115.
2.
Altmann, E.M., & Trafton, J.G. (2002). Memory for goals: An activation-based model. Cognitive Science, 26, 39-83.
3.
Anderson, J.R. (1983). The architecture of cognition. Cambridge, MA: Harvard University Press.
4.
Anderson, J.R. (2007). How can the human mind occur in the physical universe?New York: Oxford University Press .
5.
Anderson, J.R., Conrad, F.G., & Corbett, A.T. (1989). Skill acquisition and the LISP Tutor. Cognitive Science, 13, 467-505.
6.
Anderson, J. R., & Lebiere, C. (Eds.). (1998). Atomic components of thought . Hillsdale, NJ: Erlbaum.
7.
Anderson, J.R., & Lebiere, C. (2003). The Newell Test for a theory of cognition. Behavioral & Brain Sciences, 26, 587-640.
8.
Byrne, M.D. (2001). ACT-R/PM and menu selection: Applying a cognitive architecture to HCI. International Journal of Human-Computer Studies, 55, 41-84.
9.
Byrne, M.D., & Bovair, S. (1997). A working memory model of a common procedural error. Cognitive Science, 21, 31-61.
10.
Byrne, M.D., & Davis, E.M. (2006). Task structure and postcompletion error in the execution of a routine procedure. Human Factors, 48, 627-638.
11.
Byrne, M.D., & Gray, W.D. (2003). Returning human factors to an engineering discipline: Expanding the science base through a new generation of quantitative methods - Preface to the special section. Human Factors, 45, 1-4.
12.
Byrne, M.D., & Kirlik, A. (2005). Using computational cognitive modeling to diagnose possible sources of aviation error. International Journal of Aviation Psychology, 15, 135-155.
13.
Card, S.K., Moran, T.P., & Newell, A. (1980a). Computer text editing: An information processing analysis of a routine cognitive skill. Cognitive Psychology , 12, 32-74.
14.
Card, S.K., Moran, T.P., & Newell, A. (1980b). The keystroke-level model for user performance time with interactive systems. Communications of the ACM, 23, 396-410.
15.
Card, S.K., Moran, T.P., & Newell, A. (1983). The psychology of human-computer interaction. Hillsdale, NJ: Erlbaum.
16.
Clark, A. (2007). Curing cognitive hiccups: A defense of the extended mind. Journal of Philosophy, 104, 163-192.
17.
Elman, J.L., Bates, E.A., Johnson, M.H., Karmiloff-Smith,A., Parisi, D., & Plunkett, K. (1996). Rethinking innateness: A connectionist perspective on development. Cambridge, MA: MIT Press.
18.
Fisk, A.D., & Schneider, W. (1981). Control and automatic processing during tasks requiring sustained attention: A new approach to vigilance. Human Factors, 23, 737-750.
19.
Fitts, P.M. (1954). The information capacity of the human motor system in controlling the amplitude of movement. Journal of Experimental Psychology, 47, 381-391.
Fu, W.-T., Bothell, D., Douglass, S., Haimson, C., Sohn, M.H., & Anderson, J. (2006). Toward a real-time model-based training system . Interacting with Computers, 18, 1215-1241.
22.
Fu, W.-T., & Pirolli, P. (2007). SNIF-ACT: A cognitive model of user navigation on the World Wide Web. Human-Computer Interaction, 22, 355-412.
23.
Gluck, K.A., Ball, J.T., & Krusmark, M.A. (2007). Cognitive control in a computational model of the predator pilot. In W. D. Gray (Ed.), Integrated models of cognitive systems (pp. 13-28). New York: Oxford University Press.
24.
Gray, W.D. (2000). The nature and processing of errors in interactive behavior. Cognitive Science, 24, 205-248.
25.
Gray, W.D. (2007a). Composition and control of integrated cognitive systems. In W. D. Gray (Ed.), Integrated models of cognitive systems (pp. 3-12). New York: Oxford University Press.
26.
Gray, W. D. (Ed.). (2007b). Integrated models of cognitive systems. New York: Oxford University Press.
27.
Gray, W.D., & Boehm-Davis, D.A. (2000). Milliseconds matter: An introduction to microstrategies and to their use in describing and predicting interactive behavior. Journal of Experimental Psychology: Applied, 6, 322-335.
28.
Gray, W.D., John, B.E., & Atwood, M.E. (1993). Project Ernestine: Validating a GOMS analysis for predicting and explaining real-world performance. Human-Computer Interaction, 8, 237-309.
29.
Gray, W.D., Schoelles, M.J., & Myers, C.W. (2002). Computational cognitive models ISO ecologically optimal strategies. In Proceedings of the Human Factors and Ergonomics Society 46th Annual Meeting (pp. 492-496). Santa Monica, CA: Human Factors and Ergonomics Society .
30.
Gray, W.D., Schoelles, M.J., & Myers, C.W. (2003). Meeting Newell's other challenge: Cognitive architectures as the basis for cognitive engineering. Behavioral & Brain Sciences, 26, 609-610.
31.
Gray, W.D., Schoelles, M.J., & Veksler, V.D. (2004). Simborgs: Towards the building of simulated human users for interactive systems design. In Proceedings of the Human Factors and Ergonomics Society 48th Annual Meeting (pp. 362-366). Santa Monica, CA: Human Factors and Ergonomics Society .
32.
Gunzelmann, G., Gluck, K.A., Kershner, J., Van Dongen, H.P.A., & Dinges, D.F. (2007). Understanding decrements in knowledge access resulting from increased fatigue. In D. S. McNamara & J. G. Trafton (Eds.), Proceedings of the 29th Annual Meeting of the Cognitive Science Society (pp. 329-334). Austin, TX: Cognitive Science Society.
33.
Gunzelmann, G., Gluck, K.A., Price, S., Van Dongen, H.P.A., & Dinges, D.F. (2007). Decreased arousal as a result of sleep deprivation . In W. D. Gray (Ed.), Integrated models of cognitive systems (pp. 243-253). New York: Oxford University Press.
34.
Hornof, A.J. (2001). Visual search and mouse-pointing in labeled versus unlabeled two-dimensional visual hierarchies. ACM Transactions on Computer-Human Interaction, 8, 171-197.
35.
John, B.E. (1990). Extensions of GOMS analyses to expert performance requiring perception of dynamic visual and auditory information. In Proceedings of the ACM CHI '90 Conference on Human Factors in Computing Systems (pp. 107-115). New York: ACM Press.
36.
Jones, R.M., Laird, J.E., Nielsen, P.E., Coulter, K.J., Kenny, P., & Koss, F.V. (1999). Automated intelligent pilots for combat might simulation. AI Magazine, 20, 27-41.
37.
Kieras, D.E. (2007). Control of cognition. In W. D. Gray (Ed.), Integrated models of cognitive systems (pp. 327-355). New York: Oxford University Press.
38.
Kieras, D.E., & Meyer, D.E. (1997). An overview of the EPIC architecture for cognition and performance with application to human-computer interaction. Human-Computer Interaction, 12, 391-438.
39.
Kieras, D.E., Meyer, D.E., Ballas, J.A., & Lauber, E.J. (2000). Modern computational perspectives on executive mental processes and cognitive control: Where to from here? In S. Monsell & J. Driver (Eds.), Control of cognitive processes: Attention and performance XVIII (pp. 681-712). Cambridge, MA: MIT Press.
40.
Kirwan, B., & Ainsworth, L. K. (Eds.). (1992). A guide to task analysis . Washington, DC: Taylor & Francis .
41.
Klapp, S.T., & Netick, A. (1988). Multiple resources for processing and storage in short-term memory. Human Factors, 30, 617-632.
42.
Langley, P., Laird, J.E., & Rogers, S. (2006). Cognitive architectures: Research issues and challenges . Retrieved April 28, 2008, from http://cll.stanford.edu/~langley/papers/final.arch.pdf
43.
Laughery, K.R., Lebiere, C., & Archer, S. (2006). Modeling human performance in complex systems . In G. Salvendy (Ed.), Handbook of human factors (pp. 967-996). New York: Wiley.
44.
Lebiere, C.,Archer, R., Warwick, W., & Schunk, D. (2005). Integrating modeling and simulation into a general-purpose tool. In Proceedings of the 11th International Conference on Human-Computer Interaction [CD-ROM]. Mahwah, NJ: Erlbaum.
45.
Lewis, R.L., Vasishth, S., & Van Dyke, J.A. (2006). Computational principles of working memory in sentence comprehension. Trends in Cognitive Sciences, 10, 447-454.
46.
Liu, Y., Feyen, R., & Tsimhoni, O. (2006). Queueing network-model human processor (QN-MNP): A computational architecture for multitask performance in human-machine systems . ACM Transactions on Computer-Human Interaction, 13, 37-70.
47.
Logan, G.D. (1988). Automaticity, resources, and memory: Theoretical controversies and practical implications. Human Factors, 30, 583-598.
48.
McClelland, J. L., & Rumelhart, D. E. (Eds.). (1986). Parallel distributed processing: Explorations in the microstructure of cognition (Vol. 2). New York: MIT Press/Bradford .
49.
Monsell, S., & Driver, J. (Eds.). (2000). Control of cognitive processes: Attention and performance XVIII. Cambridge, MA: MIT Press.
50.
Morrison, J.E. (2003). A review of computer-based human behavior representations and their relation to military simulations (P-3845). Alexandria, VA: Institute for Defense Analysis.
51.
Myers, C.W., Neth, H., Schoelles, M.J., & Gray, W.D. (2004). The simBorg approach to modeling a dynamic decision-making task. In Proceedings of the 6th International Conference on Cognitive Modeling (pp. 372-373). Pittsburgh, PA: Erlbaum.
52.
Newell, A. (1973). You can't play 20 questions with nature and win: Projective comments on the papers of this symposium. In W. G. Chase (Ed.), Visual information processing (pp. 283-308). New York: Academic Press.
53.
Newell, A. (1990). Unified theories of cognition. Cambridge, MA: Harvard University Press.
54.
Newell, A., & Card, S.K. (1985). The prospects for psychological science in human-computer interaction. Human-Computer Interaction, 1, 209-242.
55.
Newell, A., & Simon, H.A. (1972). Human problem solving. Englewood Cliffs, NJ: Prentice Hall.
56.
Norman, D.A. (1981). Comments on cognitive engineering, the need for clear "system images," and the safety of nuclear power plants. In Conference Record for 1981 IEEE Standards Workshop on Human Factors and Nuclear Safety (pp. 91-92, 211-212). New York: IEEE.
57.
Norman, D.A. (1982). Steps toward a cognitive engineering: Design rules based on analyses of human error. In Proceedings of the 1982 Conference on Human Factors in Computing Systems (pp. 378-382). Gaithersburg, MD: ACM Press.
58.
Norman, D.A. (1986). Cognitive engineering. In D. A. Norman & S. W. Draper (Eds.), User centered system design: New perspectives on human-computer interaction (pp. 31-61). Hillsdale, NJ: Erlbaum.
59.
O'Reilly, R.C., & Munakata, Y. (2000). Computational explorations in cognitive neuroscience: Understanding the mind by simulating the brain. Cambridge, MA: MIT Press.
60.
Peebles, D., & Cheng, P.C.H. (2003). Modeling the effect of task and graphical representation on response latency in a graph reading task. Human Factors , 45, 28-46.
61.
Pew, R.W. (2007). Some history of human performance modeling. In W. D. Gray (Ed.), Integrated models of cognitive systems (pp. 29-44). New York: Oxford University Press.
62.
Pew, R. W., & Mavor, A. S. (Eds.). (1998). Modeling human and organizational behavior: Application to military simulations. Washington, DC: National Academy Press.
63.
Pirolli, P. (2007). Information foraging theory: Adaptive interaction with information. New York: Oxford University Press.
64.
Polson, M.C., & Friedman, A. (1988). Task-sharing within and between hemispheres: A multiple-resources approach. Human Factors, 30, 633-643.
65.
Ritter, F.E., & Bibby, P. (in press). Modeling how, when, and what learning happens in a diagrammatic reasoning task. Cognitive Science.
66.
Ritter, F.E., Reifers, A.L., Klein, L.C., & Schoelles, M.J. (2007). Lessons from defining theories of stress for cognitive architectures. In W. D. Gray (Ed.), Integrated models of cognitive systems (pp. 254-262). New York: Oxford University Press.
67.
Ritter, F.E., Shadbolt, N.R., Elliman, D., Young, R., Gobet, F., & Baxter, G.D. (2003). Techniques for modeling human and organizational behaviour in synthetic environments: A supplementary review. Wright-Patterson Air Force Base, OH: Human Systems Information Analysis Center.
68.
Rumelhart, D. E., & McClelland, J. L. (Eds.). (1986). Parallel distributed processing: Explorations in the microstructure of cognition (Vol. 1). New York: MIT Press/ Bradford.
69.
Salvucci, D.D. (2006). Modeling driver behavior in a cognitive architecture . Human Factors, 48, 362-380.
70.
Schneider, W. (1985). Training high-performance skills: Fallacies and guidelines. Human Factors, 27, 285-300.
71.
Schneider, W., & Chein, J.M. (2003). Controlled & automatic processing: Behavior, theory, and biological mechanisms. Cognitive Science, 27, 525-559.
72.
Schneider, W., & Detweiler, M. (1988). The role of practice in dual-task performance: Toward workload modeling in a connectionist/ control architecture. Human Factors, 30, 539-566.
73.
Schoelles, M.J., & Gray, W.D. (2001). Decomposing interactive behavior. In Proceedings of the Twenty-Third Annual Conference of the Cognitive Science Society (pp. 898-903). Mahwah, NJ: Erlbaum .
74.
Schweickert, R., Fisher, D.L., & Proctor, R.W. (2003). Steps toward building mathematical and computer models from cognitive task analyses. Human Factors, 45, 77-103.
75.
Shepard, R.N. (1963). Analysis of proximities as a technique for the study of information-processing in man. Human Factors, 5, 33-48.
76.
Shepherd, A. (1998). HTA as a framework for task analysis. Ergonomics, 41, 1537-1552.
77.
Shepherd, A. (2001). Hierarchical task analysis. New York: Taylor & Francis.
78.
Simon, H.A. (1956). Rational choice and the structure of the environment . Psychological Review, 63, 129-138.
79.
Simon, H.A. (1969). The sciences of the artificial. Cambridge, MA: MIT Press.
80.
Sohn, M.H., Douglass, S.A., Chen, M.C., &Anderson, J.R. (2005). Characteristics of fluent skills in a complex, dynamic problem-solving task. Human Factors, 47, 742-752.
81.
Sperling, G. (1963). Amodel for visual memory tasks. Human Factors, 5, 19-31.
82.
St. Amant, R., Horton, T.E., & Ritter, F.E. (2007). Model-based evaluation of expert cell phone menu interaction. ACM Transactions on Computer-Human Interaction , 14. Retrieved from http://doi.acm.org/10.1145/1229855.1229856
83.
Taatgen, N.A., & Lee, F.J. (2003). Production composition: A simple mechanism to model complex skill acquisition. Human Factors, 45, 61-76.
84.
Tambe, M., Johnson, W.L., Jones, R.M., Koss, F., Laird, J.E., Rosenbloom, P.S., et al. (1995). Intelligent agents for interactive simulation environments. AI Magazine, 16, 15-39.
85.
Wickens, C.D., & Liu, Y.L. (1988). Codes and modalities in multiple resources: A success and a qualification. Human Factors, 30, 599-616.
86.
Wickens, C.D., Mountford, S.J., & Schreiner, W. (1981). Multiple resources, task-hemispheric integrity, and individual differences in time-sharing. Human Factors , 23, 211-229.
87.
Wickens, C.D., Sandry, D.L., & Vidulich, M. (1983). Compatibility and resource competition between modalities of input, central processing, and output. Human Factors, 25, 227-248.
88.
Wickens, C.D., Sebok, A., Bagnall, T., & Kamienski, J. (2007). Modeling situation awareness supported by advanced flight deck displays. In Proceedings of the Human Factors and Ergonomics Society 51st Annual Meeting (pp. 794-798). Santa Monica, CA: Human Factors and Ergonomics Society .
89.
Witus, G., & Ellis, R.D. (2003). Computational modeling of foveal target detection . Human Factors, 45, 47-60.
90.
Wray, R.E., & Jones, R.M. (2006). Considering Soar as an agent architecture. In R. Sun (Ed.), Cognition and multi-agent interaction: From cognitive modeling to social simulation (pp. 53-78). New York: Cambridge University Press.
91.
Wray, R.E., Laird, J.E., Nuxoll, A., Stokes, D., & Kerfoot, A. (2005). Synthetic adversaries for urban combat training . AI Magazine, 26, 82-92.
92.
Wu, C.S., & Liu, Y. (2006a). Queueing network-model of a real-time psychophysiological index of mental workload: P300 amplitude in event-related potential (ERP) . In Proceedings of the Human Factors and Ergonomics Society 50th Annual Meeting (pp. 1117-1121). Santa Monica, CA: Human Factors and Ergonomics Society.
93.
Wu, C.S., & Liu, Y. (2006b). Queueing network modeling of driver workload and performance. In Proceedings of the Human Factors and Ergonomics Society 50th Annual Meeting (pp. 2368-2372). Santa Monica, CA: Human Factors and Ergonomics Society.
94.
Wu, C.S., Tsimhoni, O., & Liu, Y. (2007). Development of an adaptive workload management system using the queueing network-model human processor. In Proceedings of the Human Factors and Ergonomics Society 51st Annual Meeting (pp. 1540-1544). Santa Monica, CA: Human Factors and Ergonomics Society.
95.
Zachary, W., Ryder, J., Stokes, J., Glenn, F., Mentec, J.-C. L., & Santarelli, T. (2005). A COGNET/iGEN cognitive model that mimics human performance and learning in a simulated work environment . In K. A. Gluck & R. W. Pew (Eds.), Modeling human behavior with integrated cognitive architectures: Comparison, evaluation, and validation (pp. 113-175). Mahwah, NJ: Erlbaum.
96.
Zachary, W., Ryder, J.M., & Hicinbothom, J.H. (1998). Cognitive task analysis and modeling of decision making in complex environments. In J. A. Cannon-Bowers & E. Salas (Eds.), Making decisions under stress: Implications for individual and team training (pp. 315-344). Washington, DC: American Psychological Association.
