Cognitive task and work analyses are approaches to the analysis and support of cognitive work (rather than primarily physical or perceptual activities). Although a variety of methods exist for performing cognitive task and work analyses, they share a common goal of providing information about two mutually reinforcing perspectives. One perspective focuses on the fundamental characteristics of the work domain and the cognitive demands they impose. The other focuses on how current practitioners respond to the demands of the domain. This includes a description of the knowledge and skills practitioners have developed to operate effectively as well as any limitations in knowledge and strategies that contribute to performance problems. This chapter provides a broad survey of cognitive task analysis and cognitive work analysis methods. Some of the methods highlight techniques for knowledge gathering, whereas others focus on aspects of analysis and representation. Still other techniques emphasize process outputs, such as formal (computational) models of cognitive activities or design artifacts and associated rationales. In this chapter we review specific cognitive task and work analysis methods and describe through illustration how these methods can be adapted to meet specific project objectives and pragmatic constraints.
Get full access to this article
View all access options for this article.
References
1.
AndersonJ. R.BothellD.ByrneM. D.DouglassS.LebiereC.QuinY. (2004). An integrated theory of the mind. Psychological Review, 111, 1036–1060.
2.
AndersonJ. R.LebiereC. (1998). The atomic components of thought. Mahwah, NJ: Erlbaum.
3.
AnnettJ. (2003). Hierarchical task analysis. In HollnagelE. (Ed.), Handbook of cognitive task design (pp. 17–35). Mahwah, NJ: Erlbaum.
4.
AnnettJ.CunninghamD.Mathias-JonesP. (2000). A method for measuring team skills. Ergonomics, 43, 1076–1094.
5.
BainbridgeL.SandersonP. (1995). Verbal protocol analysis. In WilsonJ. R.CorlettE. N. (Eds.), Evaluation of human work (pp. 169–201). London: Taylor & Francis.
6.
BanajiM.CrowderR. (1989). The bankruptcy of everyday memory. American Psychologist, 44, 1185–1193.
7.
BaxterG. D.MonkA. F.TanK.DearP. R. F.NewellS. J. (2005). Using cognitive task analysis to facilitate the integration of decision support systems into the neonatal intensive care unit. Artificial Intelligence in Medicine, 35, 243–257.
8.
BeyerH.HoltzblattK. (1998). Contextual design: Defining customer-centered systems. New York: Morgan Kaufmann.
9.
BisantzA. M.DruryC. G. (2005). Applications of archival and observational data. In WilsonJ. R.CorlettN. (Eds.), Evaluation of human work (3rd ed., pp. 61–82). Boca Raton, FL: Taylor & Francis.
10.
BisantzA. M.LittleE.RogovaG. (2004). On the integration of cognitive work analysis within a multi-source information fusion development methodology. In Proceedings of the Human Factors and Ergonomics Society 48th Annual Meeting (pp. 494–498). Santa Monica, CA: SAGE Publications.
11.
BisantzA. M.RothE. M.BrickmanB.GosbeeL.HettingerL.McKinneyJ. (2003). Integrating cognitive analyses in a large-scale system design process. International Journal of Human-Computer Studies, 58, 177–206.
12.
BisantzA. M.VicenteK. J. (1994). Making the abstraction hierarchy concrete. International Journal of Human-Computer Studies, 40, 83–117.
13.
BlombergJ.GiacomiJ.MosherA.Swenton-WallP. (1993). Ethnographic field methods and their relationship to design. In ShilerD.NamiokaA. (Eds.), Participatory design: Principles and practices (pp. 123–157). Mahwah, NJ: Erlbaum.
14.
BodkerK.KensingF.SimonsenJ. (2004). Participatory IT design: Designing for business and workplace realities. Cambridge, MA: MIT Press.
15.
Boehm-DavisD. A.HoltR. W.ChongR.HansbergerJ. T. (2004). Using cognitive modeling to understand crew behavior. In Proceedings of the Human Factors and Ergonomics Society 48th Annual Meeting (pp. 99–103). Santa Monica, CA: SAGE Publications.
16.
BooherH. R. (2003). Handbook of human system integration. Hoboken, NJ: Wiley.
17.
BurnsC. M.BisantzA. M.RothE. M. (2004). Lessons from a comparison of work domain models: Representational choices and their implications. Human Factors, 46, 711–727.
BurnsC. M.KuoJ.NgS. (2003). Ecological interface design: A new approach for visualizing network management. Computer Networks: The International Journal of Computer and Telecommunications Networking43(3), 369–388.
20.
ByrneM. D.BovairS. (1997). A working memory model of a common procedural error. Cognitive Science, 21, 31–61.
21.
ByrneM. D.KirlikA. (2005). Using computational cognitive modeling to diagnose possible sources of aviation error. International Journal of Aviation Psychology, 15, 135–155.
22.
CameronC. A.BeemsterboerP. L.JohnsonL. A.MislevyR. J.SteinbergL. S.BreyerF. J. (2000). A cognitive task analysis for dental hygiene. Journal of Dental Education, 64(5), 333–351.
23.
CardS.MoranT.NewellA. (1983). The psychology of human-computer interaction. Hillsdale, NJ: Erlbaum.
24.
CarrollJ. M. (1995). Scenario-based design: Envisioning work and technology in system development. New York: Wiley.
25.
CarrollJ. M. (1997). Scenario-based design. In HelanderM.LandauerT. K.PrabhuP. V. (Eds.), Handbook of human-computer interaction (pp. 383–405). Amsterdam: Elsevier Science.
26.
CarrollJ. M. (2000). Making use: Scenario-based design of human-computer interactions. Cambridge, MA: MIT Press.
27.
ChaseW. G.SimonH. A. (1973). Perception in chess. Cognitive Psychology, 4, 55–81.
28.
ChiM. T. H.FeltovichP. J.GlaserR. (1981). Categorization and representations of physics problems by experts and novices. Cognitive Science, 5, 121–152.
29.
ChiM. T. H.GlaserR.FarrM. L. (Eds.) (1988). The nature of expertise. Mahwah, NJ: Erlbaum.
ChowR.VicenteK. J. (2002). A field study of emergency ambulance dispatching: Implications for decision support. In Proceedings of the Human Factors and Ergonomics Society 46th Annual Meeting (pp. 313–317). Santa Monica, CA: SAGE Publications.
32.
ChrenkaJ.HuttonR. J. B.KlingerD. W.AnastasiD. (2001). The cognimeter: Focusing cognitive task analysis in the cognitive function model. In Proceedings of the Human Factors and Ergonomics Society 45th Annual Meeting (pp. 1738–1742). Santa Monica, CA: SAGE Publications.
33.
ChuR. W.MitchellC. M.JonesP. M. (1995). Using the operator function model and OFMspert as the bases for an intelligent tutoring system: Towards a tutor/aid paradigm for operators of supervisory control systems. IEEE Transactions on Systems, Man, and Cybernetics, 25, 1054–1075.
34.
ClementA.Van den BesselaarP. (1993). A retrospective look at participatory design projects. Communications of the ACM, 36(4), 29–37.
35.
Cognitive Systems Engineering Center. (2004). Cognitive Systems Engineering Tool for Analysis (Version 1.0) [Computer software]. Pittsburgh, PA: ManTech International.
36.
CookeN. J. (1994). Varieties of knowledge elicitation techniques. International Journal of Human-Computer Studies, 41, 801–849.
37.
CookeN. J. (2005). Measuring team knowledge. In StantonN.HedgeA.BrookhuisK.SalasE.HendrickH. (Eds.), Handbook of human factors and ergonomics methods (pp. 52.51–52.55). Boca Raton, FL: CRC Press.
38.
CrandallB.KleinG. A.HoffmanR. R. (2006). Working minds: A practitioner's guide to cognitive task analysis. Cambridge, MA: MIT Press.
39.
D'AmicoA.WhitleyK.TesoneD.O'BrienB.RothE. (2005). Achieving cyber defense situational awareness: A cognitive task analysis of information assurance analysts. In Proceedings of the Human Factors and Ergonomics Society 49th Annual Meeting (pp. 229–233). Santa Monica, CA: SAGE Publications.
40.
DekkerS. W. A. (2002). The field guide to human error investigation. London: Ashgate.
41.
DekkerS. W. A.WoodsD. D. (1999). To intervene or not to intervene: The dilemma of management by exception. Cognition, Technology & Work, 1, 86–96.
42.
DeutschS. (1998). Interdisciplinary foundations for multiple-task human performance modeling in OMAR. In Proceedings of the 20th Annual Meeting of the Cognitive Science Society (pp. 303–308). Mahwah, NJ: Erlbaum.
43.
DeutschS.PewR. (2004). Examining new flight deck technology using human performance modeling. In Proceedings of the Human Factors and Ergonomics Society 48th Annual Meeting (pp. 108–112). Santa Monica, CA: SAGE Publications.
44.
DominguezC. (2001). Expertise and metacognition in laparoscopic surgery: A field study. In Proceedings of the Human Factors and Ergonomics Society 45th Annual Meeting (pp. 1298–1302). Santa Monica, CA: SAGE Publications.
45.
EgglestonR. G. (2003). Work-centered design: A cognitive engineering approach to system design. In Proceedings of the Human Factors and Ergonomics Society 47th Annual Meeting (pp. 263–267). Santa Monica, CA: SAGE Publications.
46.
ElmW. C.PotterS. S.GualtieriJ. W.EasterJ. R.RothE. M. (2003). Applied cognitive work analysis: A pragmatic methodology for designing revolutionary cognitive affordances. In HollnagelE. (Ed.), Handbook of cognitive task design (pp. 357–382). Mahwah, NJ: Erlbaum.
47.
EndsleyM.BolteB.JonesD. G. (2003). Designing for situation awareness: An approach to user-centered design. New York: Taylor and Francis.
48.
EricssonK. A.SimonH. A. (1993). Protocol analysis: Verbal reports as data. Cambridge, MA: MIT Press.
49.
FairbanksR. J.BisantzA. M.SunmM. (2007). Emergency department communication links and patterns. Annals of Emergency Medicine, 50, 396–406.
50.
FlachJ. M.DominguezC. (1995). Use-centered design: Integrating the user, instrument, and goal. Ergonomics in Design, 3(3), 19–24.
51.
FlanaganJ. C. (1954). The critical incident technique. Psychological Bulletin, 51, 327–358.
52.
FoyleD. C.GoodmanA.HooeyB. L. (2003). An overview of the NASA aviation safety program (AvSP) system-wide accident prevention (SWAP) human performance modeling (HPM) element. In FoyleD. C.GoodmanA.HooeyB. L. (Eds.), Proceedings of the 2003 Conference on Human Performance Modeling of Approach and Landing with Augmented Displays (pp. 1–13). Moffett Field, CA: NASA.
53.
FoyleD. C.HooeyB. L.ByrneM. D.CorkerK. M.DeutschS.LebiereC., et al. (2005). Human performance models of pilot behavior. In Proceedings of the Human Factors and Ergonomics Society 49th Annual Meeting (pp. 1109–1113). Santa Monica, CA: SAGE Publications.
54.
GilbrethF.GilbrethL. (1919). Applied motion study. London: Sturgis and Walton.
55.
GlaserR.StraussA. (1967). The discovery of grounded theory: Strategies for qualitative research. New York: Aldine.
56.
GongR.KierasD. E. (1994). A validation of the GOMS model methodology in the development of a specialized, commercial software application. In Proceedings of CHI (pp. 351–357). New York: Association for Computing Machinery.
57.
GormanM. E.MilitelloL. G.SwierengaS. J.WalkerJ. L. (2004). Internet searching by ear: Decision flow diagrams for sightless Internet users. In Proceedings of the Human Factors and Ergonomics Society 48th Annual Meeting (pp. 243–247). Santa Monica, CA: SAGE Publications.
58.
GrayW. D. (Ed.) (2007). Integrated models of cognitive systems. New York: Oxford University Press.
59.
GrayW. D.AltmannE. M. (2001). Cognitive modeling and human-computer interaction. In KarwowskiW. (Ed.), International encyclopedia of ergonomics and human factors (Vol. 1, pp. 387–391). New York: Taylor & Francis.
60.
GrayW. D.Boehm-DavisD. A. (2000). Milliseconds matter: An Introduction to microstrategies and to their use in describing and predicting interactive behavior. Journal of Experimental Psychology: Applied, 6, 322–335.
61.
GrayW. D.JohnD. E.AtwoodM. E. (1993). Project Ernestine: Validating a GOMS analysis for predicting and explaining real-world task performance. Human-Computer Interaction, 8, 237–309.
62.
GrayW. D.KirschenbaumS. S. (2000). Analyzing a novel expertise: An unmarked road. In SchraagenJ. M. C.ChipmanS. F.ShalinV. L. (Eds.), Cognitive task analysis (pp. 275–290). Mahwah, NJ: Erlbaum.
63.
GreenbaumJ.KyngM. (1991). Design at work: Cooperative design of computer systems. Mahwah, NJ: Erlbaum.
64.
HallE. P.GottS. P.PokornyR. A. (1995). A procedural guide to cognitive task analysis: The PARI methodology. Brooks Air Force Base, TX: Air Force Materiel Command.
65.
HammersleyM.AtkinsonP. (1983). Ethnography principles in practice. London: Tavistock.
66.
HarderR.HigleyH. (2004). Application of thinklets to team cognitive task analysis. In Proceedings of the 37th Hawaii International Conference on System Science (pp. 1–9). New York: Institute of Electrical and Electronics Engineers.
67.
HendrickH. W. (2007). Macroergonomics: The analysis and design of work systems. In Boehm-DavisD. (Ed.), Reviews of human factors and ergonomics (Vol. 3, pp. 44–78). Santa Monica, CA: SAGE Publications.
68.
HendrickH. W.KleinerB. M. (2001). Macroergonomics: An introduction to work system design. Santa Monica, CA: SAGE Publications.
69.
HocJ. M.LeplatJ. (1983). Evaluation of different modalities of verbalization in a sorting task. International Journal of Man-Machine Studies, 18, 283–306.
70.
HoffmanR. (1987, Summer). The problem of extracting the knowledge of experts from the perspective of experimental psychology. AI Magazine, 8, 53–67.
71.
HoffmanR.CoffeyJ. W.FordK. M.NovakJ. D. (2006). A method for eliciting, preserving, and sharing the knowledge of forecasters. Weather and Forecasting, 21, 416–428.
72.
HoffmanR.CrandallB.ShadboltN. (1998). Use of the critical decision method to elicit expert knowledge: A case study in the methodology of cognitive task analysis. Human Factors, 40, 254–276.
73.
HoffmanR.HanesL. F. (2003). The boiled frog problem. IEEE: Intelligent Systems, 68–71.
74.
HoffmanR.LinternG. (2006). Eliciting and representing the knowledge of experts. In EricssonK. A.CharnessN.FeltovichP.HoffmanR. (Eds.), Cambridge handbook of expertise and expert performance (pp. 203–222). New York: Cambridge University Press.
75.
HutchinsS. G.PirolliP.CardS. (2003). Use of critical analysis method to conduct a cognitive task analysis of intelligence analysts. In Proceedings of the Human Factors and Ergonomics Society 47th Annual Meeting (pp. 478–482). Santa Monica, CA: SAGE Publications.
76.
HuttonR. J. B.MillerT. E.ThordsenM. L. (2003). Decision-centered design: Leveraging cognitive task analysis in design. In HollnagelE. (Ed.), Handbook of cognitive task design (pp. 383–416). Mahwah, NJ: Erlbaum.
77.
Institute for Human and Machine Cognition. (2006). CmapTools knowledge modeling kit. Retrieved November 6, 2006, from http://cmap.ihmc.us/.
78.
ItohJ.SakumaA.MontaK. (1995). An ecological interface for supervisory control of BWR nuclear power plants. Control Engineering Practice, 3, 231–259.
79.
JentschF.BowersC. (2005). Team communication analysis. In StantonN.HedgeA.BrookhuisK.SalasE.HendrickH. (Eds.), Handbook of human factors and ergonomics methods (pp. 50.51–50.55). Boca Raton, FL: CRC Press.
80.
JohnB. E.KierasD. E. (1996). Using GOMS for user interface design and evaluation: Which technique? ACM Transactions on Computer-Human Interaction, 3, 287–319.
81.
JohnsonS.HealeyA.EvansJ.MurphyM.CrawshawM.GouldD. (2006). Physical and cognitive task analysis in interventional radiology. Clinical Radiology, 61(1), 97–103.
82.
KierasD. E. (1998). A guide to GOMS model usability evaluation using NGOMSL. In HelanderM. (Ed.), Handbook of human-computer interaction (pp. 391–438). Amsterdam: Elsevier.
83.
KierasD. E. (2003). Model-based evaluation. In JackoJ.SearsA. (Eds.), Handbook for human-computer interaction (pp. 1139–1151). Mahwah, NJ: Erlbaum.
84.
KierasD. E.MeyerD. E. (1997). An overview of the EPIC architecture for cognition and performance with application to human-computer interaction. Human-Computer Interaction, 12, 391–438.
85.
KierasD. E.MeyerD. E. (2000). The role of cognitive task analysis in the application of predictive models of human performance. In SchraagenJ. M. C.ChipmanS. F.ShalinV. L. (Eds.), Cognitive task analysis (pp. 237–260). Mahwah, NJ: Erlbaum.
86.
KierasD. E.WoodsD.MeyerD. E. (1997). Predictive engineering models based on the EPIC architecture for a multimodal high-performance human-computer interaction task. Transactions on Computer-Human Interaction, 4, 230–275.
87.
KirschenbaumS. S. (2004). The role of comparison in weather forecasting: Evidence from two hemispheres. In Proceedings of the Human Factors and Ergonomics Society 48th Annual Meeting (pp. 306–310). Santa Monica, CA: SAGE Publications.
88.
KirwanB.AinsworthL. K. (1992). A guide to task analysis. London: Taylor & Francis.
89.
KleinG. A. (1992). Using knowledge elicitation to preserve corporate memory. In HoffmanR. R. (Ed.), The psychology of expertise: Cognitive research and empirical AI (pp. 170–190). Mahwah, NJ: Erlbaum.
90.
KleinG. A. (1998). Sources of power: How people make decisions. Cambridge, MA: MIT Press.
91.
KleinG. A. (2000). Cognitive task analysis of teams. In SchraagenJ. M.ChipmanS. F.ShalinV. L. (Eds.), Cognitive task analysis (pp. 417–429). Mahwah, NJ: Erlbaum.
92.
KleinG. A.ArmstrongA. A. (2005). Critical decision method. In StantonN.HedgeA.BrookhuisK.SalasE.HendrickH. (Eds.), Handbook of human factors and ergonomics methods (pp. 35.31–35.38). Boca Raton, FL: CRC Press.
93.
KleinG. A.ArmstrongA. A.WoodsD. D.GokulachandraM.KleinH. (2000). Cognitive wavelength: The role of common ground in distributed replanning (Tech. Rep. AFRL-HE-WP-TR-2001–0029). Wright-Patterson Air Force Base, OH: U.S. Air Force Research Laboratory.
94.
KleinG. A.CalderwoodR.Clinton-CiroccoA. (1986). Rapid decision making on the fire-ground. In Proceedings of the Human Factors and Ergonomics Society 30th Annual Meeting (pp. 576–580). Santa Monica, CA: SAGE Publications.
95.
KleinG. A.CalderwoodR.MacGregorD. (1989). Critical decision method for eliciting knowledge. IEEE Transactions on Systems, Man, and Cybernetics, 19, 462–472.
96.
KleinG. A.OrasanuJ.CalderwoodR.ZsambokC. E. (Eds.) (1993). Decision making in action: Models and methods. Norwood, NJ: Ablex.
KlingerD. W.GomesM. G. (1993). A cognitive systems engineering application for interface design. In Proceedings of the Human Factors and Ergonomics Society 37th Annual Meeting (pp. 16–20). Santa Monica, CA: SAGE Publications.
99.
KlingerD. W.HahnB. B. (2003). Handbook of team CTA. Fairborn, OH: Klein Associates.
100.
KlingerD. W.HahnB. B. (2005). Team decision requirement exercise: Making team decision requirements explicit. In StantonN.HedgeA.BrookhuisK.SalasE.HendrickH. (Eds.), Handbook of human factors and ergonomics methods (pp. 52.51–52.55). Boca Raton, FL: CRC Press.
101.
LairdJ. E.NewellA.RosenbloomP. S. (1987). SOAR: An architecture for general intelligence. Artificial Intelligence, 33(1), 1–64.
102.
LaugheryK. R.CorkerK. M. (1997). Computer modeling and simulation of human/system performance. In SalvendyG. (Ed.), Handbook of human factors (2nd ed., pp. 1375–1408). New York: Wiley.
103.
LebiereC.BiefeldE.ArcherR.ArcherS.AllenderL.KelleyT. D. (2002). IMPRINT/ACT-R: Integration of a task network modeling architecture with a cognitive architecture and its application to human error modeling. In ChinniM. J. (Ed.), 2002 Military, government and aerospace simulation (Vol. 34, pp. 13–19). San Diego, CA: Society for Modeling and Simulation International.
104.
LeeJ. D.SanquistT. F. (2000). Augmenting the operator function model with cognitive operations: Assessing the cognitive demands of technological innovation in ship navigation. IEEE Transactions on Systems, Man, and Cybernetics–-Part A: Systems and Humans, 30, 273–285.
105.
LeplatJ. (1986). The elicitation of expert knowledge. In HollnagelE.ManciniG.WoodsD. D. (Eds.), Intelligent decision support (pp. 107–122). New York: Springer-Verlag.
106.
LincolnY. S.GubaE. G. (1985). Naturalistic inquiry. Newbury Park, CA: Sage.
107.
LinternG. (2006). A functional workspace for military analysis of insurgent operations. International Journal of Industrial Ergonomics, 36, 409–422.
108.
LukeT.Brook-CarterN.ParkesA. M.GrimesE.MillsA. (2006). An investigation of train driver visual strategies. Cognition, Technology & Work, 8, 15–29.
109.
MacMillanJ.PaleyM. J.EntinE. B.EntinE. E. (2005). Questionnaires for distributed assessment of team mutual awareness. In StantonN.HedgeA.BrookhuisK.SalasE.HendrickH. (Eds.), Handbook of human factors and ergonomics methods (pp. 51.51–51.59). Boca Raton, FL: CRC Press.
110.
MeansB.GottS. P. (1988). Cognitive task analysis as a basis for tutor development: Articulating abstract knowledge representations. In PsotkaL. D. M. J.MutterS. A. (Eds.), Intelligent tutoring systems: Lessons learned (pp. 35–57). Mahwah, NJ: Erlbaum.
111.
MilesM. B.HubermanA. M. (1984). Qualitative data analysis. Newbury Park, CA: Sage.
112.
MilitelloL. G.HuttonR. J. B. (1998). Applied cognitive task analysis (ACTA): A practitioner's toolkit for understanding cognitive task demands. Ergonomics, 41, 1618–1641.
113.
MillerA.XiaoY. (2006). Multi-level strategies to achieve resilience for an organisation operating at capacity: A case study at a trauma centre. Cognition, Technology & Work, 9, 51–66.
114.
MillerC. A.VicenteK. J. (2001). Comparison of display requirements generated via hierarchical task and abstraction-decomposition space analysis techniques. International Journal of Cognitive Ergonomics, 5, 335–356.
115.
MillerJ. E.PattersonE. S.WoodsD. D. (2006). Elicitation by critiquing as a cognitive task analysis methodology. Cognition, Technology & Work, 8, 90–102.
116.
MitchellC. M. (1987). GT-MSOCC: A domain for research on human-computer interaction and decision aiding in supervisory control systems. IEEE Transactions on Systems, Man, and Cybernetics, 17, 553–572.
117.
MitchellC. M.MillerR. A. (1986). A discrete control model of operator function: A methodology for information display design. IEEE Transactions on Systems, Man, and Cybernetics, SMC-16, 343–357.
118.
MuellerM. J.HaslwanterJ.DaytonT. (1997). Participatory practices in the software lifecycle. In HelanderM.LandauerT. K.PrabhuP. V. (Eds.), Handbook of human-computer interaction (pp. 256–296). Amsterdam: Elsevier Science/North Holland.
119.
MumawR. J.RothE. M.VicenteK. J.BurnsC. M. (2000). There is more to monitoring a nuclear power plant than meets the eye. Human Factors, 42, 36–55.
120.
NaikarN. (2006). Beyond interface design: Further applications of cognitive work analysis. International Journal of Industrial Ergonomics, 36, 423–438.
121.
NaikarN.PearceB.DrummD.SandersonP. (2003). Designing teams for first-of-a-kind complex systems using the initial phases of cognitive work analysis: A case study. Human Factors, 42, 202–217.
122.
NarayananS.WalchliS. E.ReddyN.BalachandranR. (1997). Model-based design of an information retrieval system for a university library. International Journal of Cognitive Ergonomics, 1, 149–167.
123.
NehmeC. E.ScottS. D.CummingsM. L.FurushoC. Y. (2006). Generating requirements for futuristic heterogeneous unmanned systems. In Proceedings of the Human Factors and Ergonomics Society 50th Annual Meeting (pp. 235–239). Santa Monica, CA: SAGE Publications.
124.
NisbettR. E.WilsonT. D. (1977). Telling more than we can know: Verbal reports on mental processes. Psychological Review, 84, 231–259.
125.
O'HaraJ. M.RothE. M. (2005). Operational concepts, teamwork, and technology in commercial nuclear power stations. In BowersC.SalasE.JentschF. (Eds.), Creating high-tech teams: Practical guidance on work performance and technology (pp. 139–159). Washington, DC: American Psychological Association.
126.
O'HareD.WigginsM.WilliamsA.WongW. (1998). Cognitive task analyses for decision-centered design and training. Ergonomics, 41, 1698–1718.
127.
OsgaG. A. (2003). Human-centered shipboard systems and operations. In BooherH. R. (Ed.), Handbook of human systems integration (pp. 743–793). Hoboken, NJ: Wiley.
128.
PattersonE. S.CookR. I.RenderM. L. (2002). Improving patient safety by identifying side effects from introducing bar coding in medication administration. Journal of the American Informatics Association, 9, 540–553.
129.
PattersonE. S.RothE. M.WoodsD. D. (2001). Predicting vulnerability in computer-supported inferential analysis under data overload. Cognition, Technology & Work, 3, 224–237.
130.
PattersonE. S.RothE. M.WoodsD. D.ChowR.GomesJ. O. (2004). Handoff strategies in settings with high consequences for failure: Lessons for health care operations. International Journal for Quality in Health Care, 16, 125–132.
131.
PattersonE. S.WoodsD. D. (2001). Shift changes, updates, and the on-call architecture in space shuttle mission control. Computer-Supported Cooperative Work, 10, 317–346.
132.
PewR.MavorA. S. (Eds.) (1998). Modeling human and organizational behavior: Application to military simulations. Washington, DC: National Academy Press.
133.
PewR. W.MavorA. S. (Eds.) (2007). Human-system integration in the system development process: A new look. (Committee on Human-System Design Support for Changing Technology). Washington, DC: Committee on Human Factors, Division of Behavioral and Social Sciences and Education, National Research Council, National Academies Press.
134.
PfautzJ.RothE. M. (2006). Using cognitive engineering for system design and evaluation: A visualization aid for stability and support operations. International Journal of Industrial Ergonomics, 36(5), 389–407.
135.
PotterS. S.GualtieriJ. W.ElmW. C. (2003). Case studies: Applied cognitive work analysis in the design of innovative decision support. In HollnagelE. (Ed.), Handbook of cognitive task design (pp. 653–678). Mahwah, NJ: Erlbaum.
136.
PotterS. S.RothE. M.WoodsD.ElmW. C. (2000). Bootstrapping multiple converging cognitive task analysis techniques for system design. In SchraagenJ. M.ChipmanS. F.ShalinV. L. (Eds.), Cognitive task analysis (pp. 317–340). Mahwah, NJ: Erlbaum.
137.
RabyM.McGeheeD. V.LeeJ. D.NourseG. E. (2000). Defining the interface for a snowplow lane-tracking device using a systems-based approach. In Proceedings of the XIVth Triennial Congress of the International Ergonomics Association and 44th Annual Meeting of the Human Factors and Ergonomics Society (pp. 3.369–3.372). Santa Monica, CA: SAGE Publications.
138.
RasmussenJ. (1983). Skills, rules, and knowledge; Signals, signs, and symbols, and other distractions in human performance models. IEEE Transactions on Systems, Man, and Cybernetics, SMC-13, 257–266.
139.
RasmussenJ. (1986). Information processing and human-machine interaction: An approach to cognitive engineering. New York: North-Holland.
140.
RasmussenJ.PejtersenA. M.GoodsteinL. P. (1994). Cognitive systems engineering. New York: Wiley.
141.
RitterF. E.ShadboltN. R.EllimanD.YoungR. M.GobetF.BaxterG. D. (2003). Techniques for modeling human performance in synthetic environments: A supplementary review. Wright-Patterson Air Force Base, OH: Human Systems Information Analysis Center.
142.
RitterF. E.YoungR. M. (2001). Embodied models as simulated users: Introduction to this special issue on using cognitive models to improve interface design. International Journal of Human-Computer Studies, 55, 1–14.
143.
RothE. M.ChristianC. K.GustafsonM. L.SheridanT.DwyerK.GandhiT. K., et al. (2004). Using field observations as a tool for discovery: Analyzing cognitive and collaborative demands in the operating room. Cognition, Technology & Work, 6, 148–157.
144.
RothE. M.MalschN.MulterJ.CoplenM. (1999). Understanding how train dispatchers manage and control trains: A cognitive task analysis of a distributed team planning task. In Proceedings of the Human Factors and Ergonomics Society 43rd Annual Meeting (pp. 218–222). Santa Monica, CA: SAGE Publications.
145.
RothE. M.MulterJ. (2005). Fostering shared situation awareness and on-track safety across distributed teams in railroad operations. In Proceedings of the Human Factors and Ergonomics Society 49th Annual Meeting (pp. 529–533). Santa Monica, CA: SAGE Publications.
146.
RothE. M.MulterJ.RaslearT. (2006). Shared situation awareness as a contributor to high reliability performance in railroad operations. Organization Studies, 27, 967–987.
147.
RothE. M.PattersonE. S. (2005). Using observational study as a tool for discovery: Uncovering cognitive and collaborative demands and adaptive strategies. In MontgomeryH.LipshitzR.BrehmerB. (Eds.), How professionals make decisions (pp. 379–393). Mahwah, NJ: Erlbaum.
148.
RothE. M.ScottR.DeutschS.KuperS.SchmidtV.StilsonM., et al. (2006). Evolvable work-centered support systems for command and control: Creating systems users can adapt to meet changing demands. Ergonomics, 49, 688–705.
149.
RothE. M.StilsonM.ScottR.WhitakerR.KazmierczakT.Thomas-MeyersG., et al. (2006). Work-centered design and evaluation of a C2 visualization aid. In Proceedings of the Human Factors and Ergonomics Society 49th Annual Meeting (pp. 332–336). Santa Monica, CA: SAGE Publications.
150.
RothE. M.WoodsD. D. (1988). Aiding human performance: 1. Cognitive analysis. Le Travail Humain, 41, 39–64.
151.
RothE. M.WoodsD. D. (1989). Cognitive task analysis: An approach to knowledge acquisition for intelligent system design. In GuidaG.TassoC. (Eds.), To pics in expert system design (pp. 233–264). Amsterdam: Elsevier Science.
152.
RothE. M.WoodsD. D.PopleH. E. (1992). Cognitive simulation as a tool for cognitive task analysis. Ergonomics, 36, 1163–1198.
153.
SalasE.PriestH. (2005). Team training. In StantonN.HedgeA.BrookhuisK.SalasE.HendrickH. (Eds.), Handbook of human factors and ergonomics (pp. 44.41–44.47). Boca Raton, FL: CRC Press.
154.
SalvendyG. (2001). Handbook of industrial engineering: Technology and operations management. New York: Wiley.
155.
SandersonP. M. (2003). Cognitive work analysis. In CarrollJ. M. (Ed.), HCI models, theories, and frameworks: Toward a multi-disciplinary science (pp. 225–264). San Francisco: Morgan Kaufmann.
SandersonP. M.WatsonM. O. (2005). From information content to auditory display with ecological interface design: Prospects and challenges. In Proceedings of the Human Factors and Ergonomics Society 49th Annual Meeting (pp. 259–263). Santa Monica, CA: SAGE Publications.
158.
SchaafstalA.SchraagenJ. M.van BerloM. (2000). Cognitive task analysis and innovation of training: The case of structured troubleshooting. Human Factors, 42, 75–86.
SeagullF. J.XiaoY. (2001). Using eye-tracking video data to augment knowledge elicitation in cognitive task analysis. In Proceedings of the Human Factors and Ergonomics Society 45th Annual Meeting (pp. 400–403). Santa Monica, CA: SAGE Publications.
162.
SeamsterT. L.ReddingR. E.KaempfG. L. (1997). Applied cognitive task analysis in aviation. Burlington, VT: Ashgate.
163.
SellieC. N. (1992). Predetermined motion-time systems and the development and use of standard data. In SalvendyG. (Ed.), Handbook of industrial engineering (2nd ed., pp. 1639–1698). New York: Wiley.
164.
ShepherdA.KontogiannisT. (1998). Strategic task performance: A model to facilitate the design of instruction. International Journal of Cognitive Ergonomics, 2, 349–372.
165.
ShepherdA.StammersR. B. (2005). Task analysis. In WilsonJ.CorlettE. N. (Eds.), Evaluation of human work (3rd ed., pp. 129–158). Boca Raton, FL: CRC Press.
166.
ShryaneN. M.WestermanS. J.CrawshawC. M.HockeyG. R. J.SauerJ. (1998). Task analysis for the investigation of human error in safety-critical software design: A convergent methods approach. Ergonomics, 41, 1719–1736.
167.
SimonH. A. (1981). The sciences of the artificial (2nd ed.). Cambridge, MA: Cambridge University Press.
168.
SkiltonW.CameronS.SandersonP. M. (1998). Supporting cognitive work analysis with the Work Domain Analysis Workbench (WDAW). In Proceedings of the Computer Interaction Conference, Australasian (pp. 260–267). Los Alamitos, CA: IEEE Computer Society.
169.
AmantR.St.HortonT. E.RitterF. E. (2007). Model-based evaluation of expert cell phone menu interaction. ACM Transactions on Human-Computer Interaction, 14, 1–24.
170.
StanardT.LewisW. R.CoxD. A.MalekD. A.KleinJ.MatzR. (2004). An exploratory qualitative study of computer network attacker cognition. In Proceedings of the Human Factors and Ergonomics Society 48th Annual Meeting (pp. 401–405). Santa Monica, CA: SAGE Publications.
171.
StantonN. A. (2001). Hierarchical task analysis. In KarwowskiW. (Ed.), International encyclopedia of ergonomics and human factors (pp. 3183–3190). Boca Raton, FL: CRC Press.
172.
TangZ.ZhangJ.JohnsonT. R.BernstamE.TindallD. (2004). Integrating task analysis in software usability evaluation: A case study. In Proceedings of the Human Factors and Ergonomics Society 48th Annual Meeting (pp. 1741–1745). Santa Monica, CA: SAGE Publications.
173.
TaylorF. W. (1911). The principles of scientific management. New York: Norton.
174.
TseliosN. K.AvourisN. M. (2003). Cognitive task modelling for system design and evaluation in non-routine task domains. In HollnagelE. (Ed.), Handbook of cognitive task design (pp. 303–330). Mahwah, NJ: Erlbaum.
175.
VicenteK. J. (1990). A few implications of an ecological approach to human factors. Human Factors Society Bulletin, 33(11), 1–4.
176.
VicenteK. J. (1999). Cognitive work analysis. Mahwah, NJ: Erlbaum.
177.
VicenteK. J. (2002). Ecological interface design: Progress and challenges. Human Factors, 44, 62–78.
178.
VicenteK. J.RasmussenJ. (1992). Ecological interface design: Theoretical foundations. IEEE Transactions on Systems, Man, and Cybernetics, SMC-22, 589–606.
179.
WattsJ. C.WoodsD. D.CorbanJ. M.PattersonE. S.KerrR. L.LaDessaC. H. (1996). Voice loops as cooperative aids in space shuttle mission control. Proceedings of the 1996 ACM Conference on Computer Supported Cooperative Work (pp. 48–56). New York: ACM.
180.
WeirC. R.NebekerJ. J. R.HickenB. L.CampoR.DrewsF.LeBarB. (2007). A cognitive task analysis of information management strategies in a computerized provider order entry environment. Journal of the American Medical Informatics Association, 14(1), 65–75.
181.
WoodsD. D. (1993). Process tracing methods for the study of cognition outside of the experimental psychology laboratory. In KleinG. A.OrasanuJ.CalderwoodR.ZsambokC. E. (Eds.), Decision-making in action: Models and methods (pp. 228–251). Norwood, NJ: Ablex.
182.
WoodsD. D.DekkerS. W. A. (2000). Anticipating the effects of technological change: A new era of dynamics for human factors. Theoretical Issues in Ergonomics Science, 1, 272–282.
183.
WoodsD. D.HollnagelE. (1987). Mapping cognitive demands in complex problem-solving worlds. International Journal of Man-Machine Studies, 26, 257–275.
184.
WoodsD. D.HollnagelE. (2006). Joint cognitive systems: Patterns in cognitive systems engineering. Boca Raton, FL: CRC Press.
185.
YinR. (1989). Case study research: Design and methods. Newbury Park, CA: Sage.
186.
ZacharyW.RyderJ.RossL.WeilandM. (1992). Intelligent human-computer interaction in real time, multitasking process control and monitoring systems. In HelanderM.NagamachiM. (Eds.), Human factors in design for manufacturability (pp. 377–402). New York: Taylor & Francis.
