Human Supervisory Control Challenges in Network-Centric Operations

Abstract

Network-centric operations (NCOs), envisioned for future command and control systems in military and civilian settings, must be supported by sophisticated automated systems, so human-computer interactions are an important aspect of overall system performance. This chapter identifies 10 human supervisory control challenges that could significantly impact operator performance in NCOs: information overload, attention allocation, decision biases, supervisory monitoring of operators, distributed decision making through team coordination, trust and reliability, the role of automation, adaptive automation, multimodal technologies, and accountability. NCOs will bring increases in the number of information sources, volume of information, and operational tempo with significant uncertainty, all of which will place higher cognitive demands on operators. Thus, it is critical that NCO research focuses not only on technological innovations but also on the strengths and limitations of human-automation interaction in a complex system.

Get full access to this article

View all access options for this article.

References

Alberts

D. S.

Garstka

J. J.

Stein

F. P.

(2000). Network centric warfare: Developing and leveraging information superiority (2nd ed.). Washington, DC: Command and Control Research Program.

Altmann

E. M.

Trafton

J. G.

(2004, August). Task interruption: Resumption lag and the role of cues. Paper presented at the 26th Annual Conference of the Cognitive Science Society, Chicago, IL.

Andreassi

J. L.

(2000). Psychophysiology: Human behavior and physiological response (4th ed.). Mahwah, NJ: Erlbaum.

Arkin

(2007). Governing lethal behavior: Embedding ethics in a hybrid deliberative/reactive robot architecture (No. GIT-GVU-07–11). Atlanta, GA: Georgia Tech Mobile Robot Laboratory.

Atoyan

Duquet

J.-R.

Robert

J.-M.

(2006). Trust in new decision aid systems. In Proceedings of the 18th International Conference of the Association Francophone d'Interaction Homme-Machine (pp. 115–122). Montreal: Association of Francophone d'Interaction Homme-Machine.

Baker

Entin

See

Baker

B. S.

Downes-Martin

Cecchetti

(2004, June). Organizational structure and dynamic information awareness in command teams. Paper presented at the 2004 International Command and Control Research and Technology Symposium, San Diego, CA. Available from http://dodccrp.org/events/2004_CCRTS/CD/foreword.htm.

Bayrak

Grabowski

M. R.

(2006). Network performance impacts on operators in safety-critical systems. International Journal of Information Technology and Decision Making, 5(1), 173–194.

Bennett

K. B.

(1992). Graphical displays: Implications for divided attention, focused attention, and problem solving. Human Factors, 34, 513–533.

Berka

Levendowski

D. J.

Cvetinovic

M. M.

Davis

Lumicao

M. N.

Zivkovic

V. T.

, et al. (2004). Realtime analysis of EEG indexes of alertness, cognition, and memory acquired with a wireless EEG headset. International Journal of Human-Computer Interaction, 17(2), 151–170.

10.

Billings

C. E.

(1997). Aviation automation: The search for a human-centered approach. Mahwah, NJ: Erlbaum.

11.

Bisantz

A. M.

Pfautz

Stone

Roth

E. M.

Thomas-Meyers

Fouse

(2006, October). Assessment of display attributes for displaying meta-information on maps. In Proceedings of the Human Factors and Ergonomics Society 50th Annual Meeting (pp. 289–293). Santa Monica, CA: SAGE Publications.

12.

Blackhurst

O'Grady

(2004). Network-based approach to modeling uncertainty in a supply chain. International Journal of Production Research, 42, 1639–1658.

13.

Bolstad

C. A.

Endsley

M. R.

(2000). The effect of task load and shared displays on team situation awareness. In Proceedings of the XIVth Triennial Congress of the International Ergonomics Association and 44th Annual Meeting of the Human Factors and Ergonomics Society (pp. 1.189–1.192). Santa Monica, CA: SAGE Publications.

14.

Boussemart

Cummings

M. L.

(2008). Behavioral recognition and prediction of an operator supervising multiple heterogeneous unmanned vehicles. In Proceedings of the First Conference on Humans Operating Unmanned Systems (HUMOUS′08), Brest, France. Available from http://conferences.telecom-bretagne.eu/humous08/papers.

15.

Buchin

(2009). Assessing the impact of automated path planning aids in the maritime community. Cambridge: Massachusetts Institute of Technology.

16.

Burke

J. L.

Prewett

M. S.

Gray

A. A.

Yang

Stilson

F. R. B.

Coovert

M. D.

, et al. (2006). Comparing the effects of visual-auditory and visual-tactile feedback on user performance: A meta-analysis. In Proceedings of the 8th International Conference on Multimodal Interfaces (pp. 108–117). New York: ACM Press.

17.

Buttigieg

M. A.

Sanderson

P. M.

(1991). Emergent features in visual display design for two types of failure detection tasks. Human Factors, 33, 631–651.

18.

Byrne

M. D.

Pew

R. W.

(2009). A history and primer of human performance modeling. In Durso

F. T.

(Ed.), Reviews of human factors and ergonomics (Vol. 5, pp. 225–263). Santa Monica, CA: SAGE Publications.

19.

Carroll

J. M.

Neale

D. C.

Isenhour

P. L.

Rosson

M. B.

McCrickard

D. S.

(2003). Notification and awareness: Synchronizing task-oriented collaborative activity. International Journal of Human-Computer Studies, 58, 605–632.

20.

Carroll

J. M.

Rosson

M. B.

(1987). Paradox of the active user. In Carroll

J. M.

(Ed.), Interfacing thought: Cognitive aspects of human-computer interaction (pp. 80–111). Cambridge, MA: MIT Press.

21.

Caterinicchia

(2003, June 23). DoD chat use exploded in Iraq. Federal Computer Week. Retrieved on September 3, 2010, from http://fcw.com/articles/2003/06/23/dod-chat-use-exploded-in-iraq.aspx?sc_lang=en.

22.

Cellier

Eyrolle

(1992). Interference between switched tasks. Ergonomics, 35, 25–36.

23.

Conejo

Wickens

C. D.

(1997). The effects of highlighting validity and feature type on air-to-ground target acquisition performance (No. ARL-97–11/NAWCONR-97–1). Savoy, IL: Institute of Aviation.

24.

Cooke

Kiekel

P. A.

Salas

Stout

R. J.

Bowers

Cannon-Bowers

J. A.

(2003). Measuring team knowledge: A window to the cognitive underpinnings of team performance. Group Dynamics: Theory, Research and Practice, 7, 179–199.

25.

Crandall

J. W.

Cummings

M. L.

(2007). Identifying predictive metrics for supervisory control of multiple robots. IEEE Transactions on Robotics, 23, 942–951.

26.

Crandall

J. W.

Goodrich

M. A.

Olsen

D. R.

Jr. Nielsen

C. W.

(2005). Validating human-robot interaction schemes in multitasking environments. IEEE Transactions on Systems, Man, and Cybernetics, Part A: Systems and Humans, 35, 438–449.

27.

Cummings

M. L.

(2004a). Creating moral buffers in weapon control interface design. IEEE Technology and Society, 23(3), 28–33.

28.

Cummings

M. L.

(2004b). The need for command and control instant message adaptive interfaces: Lessons learned from Tactical Tomahawk human-in-the-loop simulations. Cyberpsychology and Behavior, 7, 653–661.

29.

Cummings

M. L.

(2006). Automation and accountability in decision support system interface design. Journal of Technology Studies, 32, 23–31.

30.

Cummings

M. L.

Bruni

(2009). Collaborative human computer decision making. In Nof

(Ed.), Handbook of automation (pp. 437–447). New York: Springer.

31.

Cummings

M. L.

Brzezinski

A. S.

Lee

J. D.

(2007). The impact of intelligent aiding for multiple unmanned aerial vehicle schedule management. IEEE Intelligent Systems, 22, 52–59.

32.

Cummings

M. L.

Guerlain

(2004). Using a chat interface as an embedded secondary tasking tool. In Vincenzi

D. A.

Mouloua

Hancock

P. A.

(Eds.), Human performance, situation awareness and automation: Current research and trends. HPSAA II (Vol. 1, pp. 240–248). London: Routledge.

33.

Cummings

M. L.

Guerlain

(2007). Developing operator capacity estimates for supervisory control of autonomous vehicles. Human Factors, 49, 1–15.

34.

Cummings

M. L.

Mitchell

P. J.

(2007). Operator scheduling strategies in supervisory control of multiple UAVs. Aerospace Science and Technology, 11, 339–348.

35.

Cummings

M. L.

Mitchell

P. J.

(2008). Predicting controller capacity in remote supervision of multiple unmanned vehicles. IEEE Transactions on Systems, Man, and Cybernetics, Part A: Systems and Humans, 38, 451–460.

36.

Cummings

M. L.

Morales

(2005). UAVs as tactical wing-men: Control methods and pilots' perceptions. Unmanned Systems, 23(1), 25–27.

37.

Cummings

M. L.

Nehme

C. E.

(2010). Modeling the impact of workload in network centric supervisory control settings. In Kornguth

Steinberg

Matthews

M. D.

(Eds.), Neurocognitive and physiological factors during high-tempo operations (pp. 23–40). Surrey, UK: Ashgate.

38.

Cummings

M. L.

Nehme

C. E.

Crandall

J. W.

(2007). Predicting operator capacity for supervisory control of multiple UAVs. In Chahk

J. S.

Jain

L. C.

Mizutani

Sato-Ilic

(Eds.), Studies in computational intelligence (pp. 11–37). New York: Springer.

39.

Dekker

A. H.

(2002). C4ISR architectures, social network analysis and the FINC methodology: An experiment in military organisational structure. Edinburgh, South Australia: Defence Sciences and Technology Organization.

40.

Department of Defense. (2001). Network centric warfare: Department of Defense report to Congress. Washington DC: Office of the Secretary of Defense.

41.

de Vries

Midden

Bouwhuis

(2003). The effects of errors on system trust, self-confidence, and the allocation of control in route planning. International Journal of Human-Computer Studies, 58, 719–735.

42.

Dickson

B. T.

(2005). The cognitive cockpit—A test-bed for augmented cognition. In Schmorrow

(Ed.), Foundations of augmented cognition (pp. 479–485). Mahwah, NJ: Erlbaum.

43.

Diethe

T. R.

Dickson

B. T.

Schmorrow

Raley

(2004). Toward an augmented cockpit. In Vincenzi

D. A.

Mouloua

Hancock

P. A.

(Eds.), Human performance, situation awareness and automation: Current research and trends. HPSAA II (Vol. 1, pp. 65–69). London: Routledge.

44.

Dixon

S. R.

Wickens

Chang

(2005). Mission control of multiple unmanned aerial vehicles: A workload analysis. Human Factors, 47, 479–487.

45.

Dixon

S. R.

Wickens

C. D.

McCarley

J. S.

(2007). On the independence of compliance and reliance: Are automation false alarms worse than misses? Human Factors, 49, 564–572.

46.

Donchin

Kramer

A. F.

Wickens

C. D.

(1986). Applications of brain event-related potentials to problems in engineering psychology. In Coles

M. G. H.

Donchin

Porges

(Eds.), Psychophysiology: Systems, processes, and applications (pp. 702–718). Middletown, NJ: Till & Till.

47.

Donmez

Cummings

M. L.

Graham

H. D.

(2009). Auditory decision aiding in supervisory control of multiple unmanned aerial vehicles. Human Factors, 51, 718–729.

48.

Draper

Calhoun

Ruff

Williamson

Barry

(2003). Manual versus speech input for unmanned aerial vehicle control station operations (No. A842634). Wright-Patterson Air Force Base, OH: Air Force Research Laboratory.

49.

Dudfield

H. J.

Macklin

Fearnley

Simpson

Hall

(2001). Big is better? Human factors issues of large screen displays with military command teams. In Proceedings of People in Control (PIC′01): International Conference on Human Interfaces in Control Rooms, Cockpits and Command Centres (pp. 304–309). DOI:10.1049/cp:20010480.

50.

Dzindolet

M. T.

Peterson

S. A.

Pomranky

R. A.

Pierce

L. G.

Beck

H. P.

(2003). The role of trust in automation reliance. International Journal Human-Computer Studies, 58, 697–718.

51.

Endsley

M. R.

(1995). Toward a theory of situation awareness in dynamic systems. Human Factors, 37, 32–64.

52.

Endsley

M. R.

Jones

W. M.

(2001). A model of inter-and intrateam situation awareness: Implications for design, training, and measurement. In McNeese

Salas

Endsley

M. R.

(Eds.), New trends in cooperative activities: Understanding system dynamics in complex environments (pp. 46–67). Santa Monica, CA: SAGE Publications.

53.

Fabiani

Gratton

Coles

M. G. H.

(2000). Event-related brain potentials. In Cacioppo

J. T.

Tassinary

L. G.

Berntson

G. G.

(Eds.), Handbook of psychophysiology (pp. 53–84). Cambridge, UK: Cambridge University Press.

54.

Finger

Bisantz

A. M.

(2002). Utilizing graphical formats to convey uncertainty in a decision making task. Theoretical Issues in Ergonomic Science, 1, 1–25.

55.

Fiore

S. M.

Schooler

J. W.

(2004). Process mapping and shared cognition: Teamwork and the development of shared problem models. In Salas

Fiore

S. M.

Cannon-Bowers

J. A.

(Eds.), Team cognition: Understanding the factors that drive process and performance (pp. 133–152). Washington, DC: American Psychological Association.

56.

Fisher

C. S.

(2008). Real-time, multi-agent system graphical user interface. Cambridge: Massachusetts Institute of Technology.

57.

Fiske

S. T.

Taylor

S. E.

(1991). Social cognition (2nd ed.). New York: McGraw-Hill.

58.

Gao

Lee

J. D.

Zhang

(2006). A dynamic model of interaction between reliance on automation and cooperation in multi-operator multi-automation situations. International Journal of Industrial Ergonomics, 36, 512–526.

59.

Gempler

K. S.

Wickens

C. D.

(1998). Display of predictor reliability on a cockpit display of traffic information (No. ARL-98–6/ROCKWELL-98–1). Savoy, IL: Institute of Aviation.

60.

Gibson

J. J.

(1979). The ecological approach to visual perception. Boston: Houghton Mifflin.

61.

Gopher

Armony

Greenspan

(2000). Switching tasks and attention policies. Journal of Experimental Psychology: General, 129, 308–339.

62.

Gorman

Cooke

Pederson

Connor

DeJoode

(2005). Awareness of situation by teams (CAST): Measuring team situation awareness of a communication glitch. In Proceedings of the Human Factors and Ergonomics Society 49th Annual Meeting (pp. 274–277). Santa Monica, CA: SAGE Publications.

63.

Grossman

(1998, June). The morality of bombing: Psychological responses to “distant punishment.” Paper presented at the Center for Strategic and International Studies, Dueling Doctrines and the New American Way of War Symposium, Washington, DC. Retrieved September 3, 2010, from http://www.killology.com/art_bombing.htm.

64.

Guerlain

(2000). Interactive advisory systems. In Proceedings of the Human Performance, Situation Awareness and Automation: User-Centered Design for the New Millennium (pp. 166–171).

65.

Guerlain

Bullemer

(1996). User-initiated notification: A concept for aiding the monitoring activities of process control operators. In Proceedings of the Human Factors and Ergonomics Society 40th Annual Meeting (pp. 283–287). Santa Monica, CA: SAGE Publications.

66.

Hankins

T. C.

Wilson

G. F.

(1998). A comparison of heart rate, eye activity, EEG and subjective measures of pilot mental workload during flight. Aviation, Space, and Environmental Medicine, 69, 360–367.

67.

Hess

E. H.

Polt

J. M.

(1964). Pupil size in relation to mental activity during simple problem solving. Science, 132, 349–350.

68.

Hilburn

Jorna

P. G.

Byrne

E. A.

Parasuraman

(1997). The effect of adaptive air traffic control (ATC) decision aiding on controller mental workload. In Mustapha

Koonce

J. M.

Hopkin

V. D.

(Eds.), Human-automation interaction: Research and practice (pp. 84–91). Mahwah, NJ: Erlbaum.

69.

Histon

J. M.

Hansman

R. J.

Gottlieb

Kleinwaks

Yenson

Delahaye

, et al. (2002). Structural considerations and cognitive complexity in air traffic control. In Proceedings of the 19th IEEE/AIAA Digital Avionics Systems Conference (vol. 1, pp. 1C2–1–1C2–13). Los Alamitos, CA: IEEE.

70.

Hutchins

(1995). How a cockpit remembers its speed. Cognitive Science, 19, 265–288.

71.

Johansen

(1988). Groupware: Computer support for business teams. New York: Free Press.

72.

Just

M. A.

Carpenter

P. A.

Keller

T. A.

Emery

Zajac

Thulborn

K. R.

(2001). Interdependence of nonoverlapping cortical systems in dual cognitive tasks. NeuroImage, 14, 417–426.

73.

Kaber

D. B.

Endsley

M. R.

(2004). The effects of level of automation and adaptive automation on human performance, situation awareness and workload in a dynamic control task. Theoretical Issues in Ergonomics Science, 5, 113–153.

74.

Kaber

D. B.

Endsley

M. R.

Onal

(2000). Design of automation for telerobots and the effect on performance, operator situation awareness and subjective workload. Human Factors and Ergonomics in Manufacturing, 10, 409–430.

75.

Karau

S. J.

Williams

K. D.

(1993). Social loafing: A meta-analytic review and theoretical integration. Journal of Personality and Social Psychology, 65, 681–706.

76.

Klein

(1989). Recognition-primed decisions. Advances in Man-Machine Research, 5, 47–92.

77.

Klein

Woods

D. D.

Bradshaw

J. M.

Hoffman

R. R.

Feltovich

P. J.

(2004). Ten challenges for making automation a “team player” in joint human-agent activity. IEEE Intelligent Systems, 19(6), 91–95.

78.

Kramer

(1991). Physiological metrics of mental workload: A review of recent progress. In Damos

D. L.

(Ed.), Multiple task performance (pp. 279–328). Washington, DC: Taylor & Francis.

79.

Kramer

A. F.

Weber

(2000). Applications of psychophysiology to human factors. In Cacioppo

J. T.

Tassinary

L. G.

Berntson

G. G.

(Eds.), Handbook of psychophysiology (2nd ed., pp. 794–814). New York: Cambridge University Press.

80.

Kramer

(1994). Some organizing principles for representing data with sound. In Kramer

(Ed.), Auditory display: Sonification, audification and auditory interfaces (pp. 185–222). Reading, MA: Addison Wesley.

81.

Laughery

K. R.

Corker

(1997). Computer modeling and simulation of human/system performance. In Salvendy

(Ed.), Handbook of human factors and ergonomics (pp. 1375–1408). New York: Wiley.

82.

Laughery

K. R.

Wogalter

M. S.

(2006). Designing effective warnings. In Williges

R. C.

(Ed.), Reviews of human factors and ergonomics (Vol. 2, pp. 241–271). Santa Monica, CA: SAGE Publications.

83.

Layton

Smith

P. J.

McCoy

C. E.

(1994). Design of a cooperative problem-solving system for en-route flight planning: An empirical evaluation. Human Factors, 36, 94–119.

84.

Lee

J. D.

Moray

(1992). Trust, control strategies and allocation of function in human-machine systems. Ergonomics, 35, 1243–1270.

85.

Lee

J. D.

Moray

(1994). Trust, self confidence, and operators' adaptation to automation. International Journal of Human-Computer Studies, 40, 153–184.

86.

Lee

J. D.

See

K. A.

(2004). Trust in technology: Designing for appropriate reliance. Human Factors, 46, 50–80.

87.

Levchuk

G. M.

Levchuk

Y. N.

Luo

Pattipati

K. R.

Kleinman

D. L.

(2002). Normative design of organizations: Part I. Mission planning. IEEE Transactions on Systems, Man, and Cybernetics, Part A: Systems and Humans, 32, 346–359.

88.

Levchuk

G. M.

Levchuk

Pattipati

K. R.

(2004, June). Networks of decision-making and communicating agents: A new methodology for design and evaluation of organizational strategies and heterarchical structures. Paper presented at the 2004 International Command and Control Research and Technology Symposium, San Diego, CA.

89.

Liu

(1997). Queuing network modeling of human performance of concurrent spatial and verbal tasks. IEEE Transactions on Systems, Man, and Cybernetics, 27, 195–207.

90.

Loeb

R. G.

Fitch

W. T.

(2002). A laboratory evaluation of an auditory display designed to enhance intraoperative monitoring. Anesthesia and Analgesia, 94, 362–368.

91.

Lord

C. G.

Ross

Lepper

(1979). Biased assimilation and attitude polarization: The effects of prior theories on subsequently considered evidence. Journal of Personality and Social Psychology, 47, 1231–1243.

92.

Maglio

P. P.

Campbell

C. S.

(2000). Tradeoffs in displaying peripheral information. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2000; pp. 241–248). New York: Association for Computing Machinery.

93.

Manzey

(2008). Misuse of automated decision aids: Complacency, automation bias and the impact of training experience. International Journal of Human-Computer Studies, 66, 688–699.

94.

McCormick

E. J.

(1976). Human factors in engineering and design (4th ed.). New York: McGraw-Hill.

95.

McFarlane

D. C.

(2002). Comparison of four primary methods for coordinating the interruption of people in human-computer interaction. Human-Computer Interaction, 17, 63–139.

96.

McGuirl

J. M.

Sarter

N. B.

(2003). How are we doing? Presenting system confidence information to support trust calibration and adaptive function allocation. In Proceedings of the Human Factors and Ergonomics Society 47th Annual Meeting (pp. 538–542). Santa Monica, CA: SAGE Publications.

97.

Miller

C. A.

Parasuraman

(2007). Designing for flexible interaction between humans and automation: Delegation interfaces for supervisory control. Human Factors, 49, 57–75.

98.

Miller

(1991). Channel interaction and the redundant-targets effect in bimodal divided attention. Journal of Experimental Psychology: Human Perception and Performance, 17, 160–169.

99.

Miyata

Norman

D. A.

(1986). Psychological issues in support of multiple activities. In Norman

D. A.

Draper

S. W.

(Eds.), User centered system design: New perspectives on human computer interaction (pp. 265–284). Hillsdale, NJ: Erlbaum.

100.

Moray

Dessouky

M. I.

Kijowski

B. A.

(1991). Strategic behavior, workload, and performance in task scheduling. Human Factors, 33, 607–629.

101.

Moray

Inagaki

Itoh

(2000). Adaptive automation, trust, and self-confidence in fault management of time-critical tasks. Journal of Experimental Psychology: Applied, 6, 44–58.

102.

Mosier

K. L.

Skitka

L. J.

(1996). Human decision makers and automated decision aids: Made for each other? In Parasuraman

Mouloua

(Eds.), Automation and human performance: Theory and applications (pp. 201–220). Mahwah, NJ: Erlbaum.

103.

Muir

B. M.

(1987). Trust between humans and machines, and the design of decision aids. International Journal of Man-Machine Studies, 27, 527–539.

104.

Muir

B. M.

Moray

(1996). Trust in automation: Part II. Experimental studies of trust and human intervention in a process control simulation. Ergonomics, 39, 429–460.

105.

Nehme

C. E.

Cummings

M. L.

(2006). Audio decision support for supervisory control of unmanned vehicles (HAL2006–06). Cambridge, MA: Massachusetts Institute of Technology.

106.

Norman

D. A.

(1988). The design of everyday things. New York: Doubleday.

107.

Orden

K. F.

Limbert

Makeig

Jung

T.-P.

(2001). Eye activity correlates of workload during a visuospatial memory task. Human Factors, 43, 111–121.

108.

Parasuraman

Bahri

Deaton

J. E.

Morrison

J. G.

Barnes

(1992). Theory and design of adaptive automation in adaptive systems (Progress Rep. No. NAWCADWAR-92033–60). Warminster, PA: Naval Air Warfare Center, Aircraft Division.

109.

Parasuraman

Barnes

Cosenzo

(2007). Adaptive automation for human-robot teaming in future command and control systems. International Journal of Command and Control, 1(2), 43–68.

110.

Parasuraman

Cosenzo

de Visser

(2009). Adaptive automation for human supervision of multiple uninhabited vehicles: Effects on change detection, situation awareness, and mental workload. Military Psychology, 21, 270–297.

111.

Parasuraman

Galster

Squire

Furukawa

Miller

(2005). A flexible delegation-type interface enhances system performance in human supervision of multiple robots: Empirical studies with RoboFlag. IEEE Transactions on Systems, Man, and Cybernetics, 35, 481–493.

112.

Parasuraman

Riley

(1997). Humans and automation: Use, misuse, disuse, abuse. Human Factors, 39, 230–253.

113.

Parasuraman

Sheridan

T. B.

Wickens

C. D.

(2000). A model for types and levels of human interaction with automation. IEEE Transactions on Systems, Man, and Cybernetics, Part A: Systems and Humans, 30, 286–297.

114.

Perrow

(1984). Normal accidents: Living with high-risk technologies. Princeton, NJ: Princeton University Press.

115.

Perzanowski

Schultz

A. C.

Adams

Marsh

(2000). Using a natural language and gesture interface for unmanned vehicles. Washington, DC: Navy Center for Applied Research in Artificial Intelligence.

116.

Pfautz

Roth

Bisantz

A. M.

Thomas-Myers

Llinas

Fouse

(2006, June). The role of metainformation in C2 decision-support systems. Paper presented at the Command and Control Research and Technology Symposium, San Diego, CA.

117.

Polich

(1991). P300 in clinical applications: Meaning, method, and measurement. American Journal of EEG Technology, 31, 201–231.

118.

Pope

A. T.

Bogart

E. H.

Bartolome

(1995). Biocybernetic system evaluates indices of operator engagement. Biological Psychology, 40, 187–196.

119.

Price

Miller

Entin

Rubineau

(2001, June). Collaborative planning and coordinated team performance. Paper presented at the 6th International Command and Control Research and Technology Symposium, Annapolis, MD. Retrieved September 3, 2010, from http://www.dodccrp.org/events/6th_ICCRTS/Tracks/Papers/Track4/123_tr4.pdf.

120.

Prinzel

L. J.

III Freeman

F. G.

Scerbo

M. W.

Mikulka

P. J.

Pope

A. T.

(2003). Effects of a psychophysiological system for adaptive automation on performance, workload, and the event-related potential P300 component. Human Factors, 45, 601–613.

121.

Rovira

McGarry

Parasuraman

(2007). Effects of imperfect automation on decision making in a simulated command and control task. Human Factors, 49, 76–87.

122.

Ruff

Narayanan

Draper

M. H.

(2002). Human interaction with levels of automation and decision-aid fidelity in the supervisory control of multiple simulated unmanned air vehicles. Presence, 11, 335–351.

123.

Rugg

M. D.

Coles

M. G. H.

(Eds.) (1995). Electrophysiology of mind: Event-related brain potentials and cognition. New York: Oxford University Press.

124.

Sanderson

P. M.

Flach

J. M.

Buttigieg

M. A.

Casey

E. J.

(1989). Object displays do not always support better integrated task performance. Human Factors, 31, 183–198.

125.

Sarter

N. B.

(2006). Multimodal information presentation: Design guidance and research challenges. International Journal of Industrial Ergonomics, 36, 439–445.

126.

Sarter

N. B.

Schroeder

(2001). Supporting decision making and action selection under time pressure and uncertainty: The case of in-flight icing. Human Factors, 43, 573–583.

127.

Savla

Nehme

C. E.

Frazzoli

Temple

(2008, August). On efficient cooperative strategies between UAVs and humans in a dynamic environment. Paper presented at the AIAA Conference on Guidance, Navigation, and Control, Honolulu, Hawaii.

128.

Schmidt

D. K.

(1978). A queuing analysis of the air traffic controller's workload. IEEE Transactions on Systems, Man, and Cybernetics, 8, 492–498.

129.

Schumann

Godthelp

Farber

Wontorra

(1993). Breaking up open-loop steering control actions the steering wheel as an active control device. In Gale

A. G.

(Ed.), Vision in vehicles IV (pp. 321–332). Amsterdam: North-Holland.

130.

Scott

S. D.

Carpendale

M. S. T.

Habelski

(2005). Storage bins: Mobile storage for collaborative tabletop displays. IEEE Computer Graphics and Applications, 25, 58–65.

131.

Scott

S. D.

Sasangohar

Cummings

M. L.

(2009, March). Investigating supervisory-level activity awareness displays for command and control operations. In Proceedings of HSIS 2009: Human Systems Integration Symposium, Annapolis, MD.

132.

Scott

S. D.

Wan

Rico

Furusho

Cummings

M. L.

(2007, March). Aiding team supervision in command and control operations with large-screen displays. In Proceedings of HSIS 2007: ASNE Human Systems Integration Symposium, Annapolis, MD.

133.

Shapiro

Varian

H. R.

(1999). Information rules: A strategic guide to the network economy. Boston: Harvard Business School Press.

134.

Sheridan

T. B.

(1992). Telerobotics, automation and human supervisory control. Cambridge, MA: MIT Press.

135.

Sheridan

T. B.

(1996). Speculations on future relations between humans and automation. In Parasuraman

Mouloua

(Eds.), Automation and human performance (pp. 449–460). Mahwah, NJ: Erlbaum.

136.

Sheridan

T. B.

Parasuraman

(2006). Human-automation interaction. In Nickerson

R. S.

(Ed.), Reviews of human factors and ergonomics (Vol. 1, pp. 89–129). Santa Monica, CA: SAGE Publications.

137.

Sheridan

T. B.

Vamos

Aida

(1983). Adapting automation to man, culture and society. Automatica, 19, 605–612.

138.

Sheridan

T. B.

Verplank

W. L.

(1978). Human and computer control of undersea teleoperators (Man-Machine Systems Laboratory Rep.). Cambridge, MA: MIT.

139.

Simon

H. A.

Hogarth

Piott

C. R.

Raiffa

Schelling

K. A.

Thaier

, et al. (1986). Decision making and problem solving. Washington, DC: National Academy Press.

140.

Simon

Rousseau

Angue

J. C.

(1993, October). Quantitative analysis of mental workload influence on eye scanning movements. In Conference Proceedings, International Conference on Systems, Man and Cybernetics, 1993. “Systems Engineering in the Service of Humans” (pp. 707–712). Los Alamitos, CA: IEEE.

141.

Skitka

L. J.

Mosier

K. L.

(2000). Automation bias and errors: Are crews better than individuals? International Journal of Aviation Psychology, 10, 85–97.

142.

Skitka

L. J.

Mosier

K. L.

Burdick

M. D.

(1999). Does automation bias decision-making? International Journal of Human-Computer Studies, 51, 991–1006.

143.

Skitka

L. J.

Mosier

K. L.

Burdick

M. D.

(2000). Accountability and automation bias. International Journal of Human-Computer Studies, 52, 701–717.

144.

Sklar

A. E.

Sarter

N. B.

(1999). Good vibrations: Tactile feedback in support of attention allocation and human-automation coordination in event-driven domains. Human Factors, 41, 543–552.

145.

Smith

McCoy

Layton

(1997). Brittleness in the design of cooperative problem-solving systems: The effects on user performance. IEEE Transactions on Systems, Man, and Cybernetics, Part A: Systems and Humans, 27, 360–371.

146.

Somervell

Srinivasan

Vasnaik

Woods

(2001, March). Measuring distraction and awareness caused by graphical and textual displays in the periphery. Paper presented at the 39th Annual ACM Southeast Conference, Athens, GA.

147.

Squire

Trafton

Parasuraman

(2006). Human control of multiple unmanned vehicles: Effects of interface type on execution and task switching times. In Proceedings of the 1st ACM SIGCHI/SIGART Conference on Human-Robot Interaction (pp. 2–32). New York: Association for Computing Machinery.

148.

Stanney

K. M.

Schmorrow

Johnston

Fuchs

Jones

Hale

, et al. (2006). Augmented cognition: An overview. In Durso

F. T.

(Ed.), Reviews of human factors and ergonomics (Vol. 4, pp. 89–129). Santa Monica, CA: SAGE Publications.

149.

Sterman

J. D.

(1989). Misperceptions of feedback in dynamic decision-making. Organizational Behavior and Human Decision Processes, 43, 301–335.

150.

Strogatz

S. H.

(2001). Exploring complex networks. Nature, 410, 268–276.

151.

Suzuki

Jansson

(2003). An analysis of driver's steering behaviour during auditory or haptic warnings for the designing of lane departure warning system. JSAE Review, 24, 65–70.

152.

Tenney

Y. J.

Pew

R. W.

(2006). Situation awareness catches on. What? So what? Now what? In Williges

R. C.

(Ed.), Reviews of human factors and ergonomics (Vol. 2, pp. 1–34). Santa Monica, CA: SAGE Publications.

153.

Tetlock

P. E.

Boettger

(1989). Accountability: A social magnifier of the dilution effect. Journal of Personality and Social Psychology, 57, 388–398.

154.

32nd Army Air and Missile Defense Command. (2003). Patriot missile defense operations during Operation Iraqi Freedom. Washington, DC: U.S. Army.

155.

Trafton

J. G.

Monk

C. A.

(2008). Task interruptions. In Boehm-Davis

D. A.

(Ed.), Reviews of human factors and ergonomics (Vol. 3, pp. 111–126). Santa Monica, CA: SAGE Publications.

156.

Tulga

M. K.

Sheridan

T. B.

(1980). Dynamic decisions and work load in multitask supervisory control. IEEE Transactions on Systems, Man, and Cybernetics, 10, 217–232.

157.

Tvaryanas

A. P.

(2004). Visual scan patterns during simulated control of an uninhabited aerial vehicle (UAV). Aviation, Space, and Environmental Medicine, 75, 531–538.

158.

Tversky

Kahneman

(1974). Judgment under uncertainty: Heuristics and biases. Science, 185, 1124–1131.

159.

Veltman

J. A.

Gaillard

A. W. K.

(1998). Physiological workload reactions to increasing levels of task difficulty. Ergonomics, 41, 656–669.

160.

Vicente

Rasmussen

(1992). Ecological interface design: Theoretical foundations. IEEE Transactions on Systems, Man, and Cybernetics, 22, 589–606.

161.

Watson

Sanderson

(2004). Sonification supports eyes-free respiratory monitoring and task timesharing. Human Factors, 46, 497–517.

162.

Watts

D. J.

(2004). The “new” science of networks. Annual Review of Sociology, 30, 243–270.

163.

Wickens

C. D.

(2002). Multiple resources and performance prediction. Theoretical Issues in Ergonomics Science, 3, 159–177.

164.

Wickens

C. D.

Hollands

J. G.

(2000). Engineering psychology and human performance (3rd ed.). Upper Saddle River, NJ: Prentice Hall.

165.

Wickens

C. D.

Lee

J. D.

Liu

Becker

S. E. G.

(2004). An introduction to human factors engineering (2nd ed.). Upper Saddle River, NJ: Pearson Education.

166.

Wiener

E. L.

(1984). Vigilance and inspection. In Warm

J. S.

(Ed.), Sustained attention in human performance (pp. 207–246). Chichester, UK: Wiley.

167.

Wiener

E. L.

(1987). Application of vigilance research: Rare, medium or well done. Human Factors, 29, 725–736.

168.

Wilson

G. F.

Russell

C. A.

(2003). Real-time assessment of mental workload using psychophysiological measures and artificial neural networks. Human Factors, 45, 635–643.

169.

Wickens

C. D.

Rantanen

(2004). Imperfect conflict alerting systems for the cockpit display of traffic information (No. AHFD-04–8/NASA-04–2). Savoy, IL: Institute of Aviation, Aviation Human Factors Division.

170.

Zsambok

C. E.

Beach

R. B.

Klein

(1992). Literature review of analytical and naturalistic decision making. San Diego, CA: Naval Command, Control and Ocean Surveillance Center.