Detecting Occurrences of the “Substitution Myth”: A Systems Engineering Template for Modeling the Supervision of Automation

Abstract

Current usages of model-based systems engineering allow naïve substitutions of humans by machines. Human factors / ergonomics researchers have rejected such substitutions as the “substitution myth,” for if work is reallocated from a human to a machine, then there is work incurred to ensure that the machine is working properly—it must be supervised. We construct a template for what automation should look like when the need for supervision is taken into account. The template can be applied to understand the arrangements for supervising automation in systems as they are and to explore the options for systems that are being designed. We consider examples from electronic warfare self-protection and the command and control of sensor-weapon systems in the land domain.

Keywords

automation function allocation substitution myth systems engineering

Get full access to this article

View all access options for this article.

References

Ackroyd

R. J.

(2002). U.S. Patent No. US7269851 B2. Washington, DC: U.S. Patent and Trademark Office.

Alterman

(2000). Rethinking autonomy. Minds and Machines, 10(1), 15–30. doi:10.1023/a:1008351215377

Annett

Duncan

K. D.

Stammers

R. B.

Gray

M. J.

(1971). Task analysis (Information Paper No. 6). London, England: Her Majesty’s Stationery Office.

Bainbridge

(1983). Ironies of automation. Automatica, 19(6), 775–779. doi:10.1016/0005-1098(83)90046-8

Balfe

Wilson

J. R.

Sharples

Clarke

(2011). Development of design principles for automated systems in transport control. Ergonomics, 55(1), 37–54. doi:10.1080/00140139.2011.636456

Bolton

M. L.

Bass

E. J.

(2009, October). Enhanced operator function model: A generic human task behavior modeling language. Paper presented at the SMC 2009, San Antonio, TX.

Bradshaw

J. M.

Hoffman

R. R.

Johnson

Woods

D. D.

(2013). The seven deadly myths of “autonomous systems.” IEEE Intelligent Systems, 28(3), 54–61. doi:10.1109/MIS.2013.70

Branlat

Woods

D. D.

(2010, November). How do systems manage their adaptive capacity to successfully handle disruptions? A resilience engineering perspective. Paper presented at Complex Adaptive Systems, Arlington, VA.

Bruseberg

(2008). Human views for MODAF as a bridge between human factors integration and systems engineering. Journal of Cognitive Engineering and Decision Making, 2(3), 220–248. doi:10.1518/155534308x377090

10.

Challenger

Clegg

C. W.

Shepherd

(2013). Function allocation in complex systems: Reframing an old problem. Ergonomics, 56(7), 1051–1069. doi:10.1080/00140139.2013.790482

11.

Chua

Z. K.

Feigh

K. M.

(2011, October). Integrating human factors principles into systems engineering. Paper presented at the Digital Avionics Systems Conference, Seattle, WA.

12.

Elm

W. C.

Gualtieri

J. W.

McKenna

B. P.

Tittle

J. S.

Peffer

J. E.

Szymczak

S. S.

Grossman

J. B.

(2008). Integrating cognitive systems engineering throughout the systems engineering process. Journal of Cognitive Engineering and Decision Making, 2(3), 249–273. doi:10.1518/155534308x377108

13.

Feigh

K. M.

Pritchett

A. R.

(2014). Requirements for effective function allocation: A critical review. Journal of Cognitive Engineering and Decision Making, 8(1), 23–32. doi:10.1177/1555343413490945

14.

Grote

(2009). Management of uncertainty: Theory and application in the design of systems and organizations. Dordrecht, Netherlands: Springer.

15.

Handley

H. A. H.

(2012). Incorporating the NATO human view in the DoDAF 2.0 meta model. Systems Engineering, 15(1), 108–117. doi:10.1002/sys.20206

16.

Hardman

Colombi

(2012). An empirical methodology for human integration in the SE technical processes. Systems Engineering, 15(2), 172–190. doi:10.1002/sys.20201

17.

Hew

P. C.

(2014). Artificial moral agents are infeasible with foreseeable technologies. Ethics and Information Technology, 16(3), 197–206. doi:10.1007/s10676-014-9345-6

18.

Jane’s. (2010a). AN/ALE-47 threat adaptive countermeasures dispenser system (TACDS). London, UK: IHS, Jane’s Avionics.

19.

Jane’s. (2010b). Raytheon Phalanx Mk 15 CIWS. London, UK: IHS, Jane’s Electro-Optic Systems.

20.

Jane’s. (2012a). AN/ALE-50(V) towed decoy system. London, UK: IHS, Jane’s Radar and Electronic Warfare Systems.

21.

Jane’s. (2012b). AN/ALQ-184(V)C4ISR & mission systems: Air. London, UK: IHS, Jane’s.

22.

Jane’s. (2012c). AN/ALR-67(V)3C4ISR & mission systems: Air. London, UK: IHS, Jane’s.

23.

Long

Scott

(2011). A primer for model-based systems engineering. Blacksburg, VA: Vitech.

24.

Long

J. E.

(1995). Relationships between common graphical representations used in systems engineering. Paper presented at the INCOSE International Symposium, St. Louis, MO. http://dx.doi.org/10.1002/j.2334-5837.1995.tb01965.x

25.

Michael

D. H.

Philip

D. J.

Peter

C. W.

(2003). Relating the automation of functions in multiagent control systems to a system engineering representation. In Handbook of cognitive task design (pp. 503–524). Boca Raton, FL: CRC Press.

26.

Moody

van Hillegersberg

(2009). Evaluating the visual syntax of UML: An analysis of the cognitive effectiveness of the UML family of diagrams. In Gašević

Lämmel

Van Wyk

(Eds.), Software language engineering: First International Conference, SLE 2008, Toulouse, France, September 29–30, 2008—Revised selected papers (pp. 16–34). Berlin, Germany: Springer Berlin Heidelberg.

27.

Moody

D. L.

(2009). The “physics” of notations: Toward a scientific basis for constructing visual notations in software engineering. IEEE Transactions on Software Engineering, 35(6), 756–779. doi:10.1109/TSE.2009.67

28.

Naikar

(2013). Work domain analysis: Concepts, guidelines, and cases. Boca Raton, FL: CRC Press.

29.

Naval Air Systems Command. (1999). Electronic warfare and radar systems handbook (NAWCWPNS TP 8347). Naval Air Station Patuxent River, MD: Naval Air Warfare Center.

30.

Neri

(2006). Introduction to electronic defense systems. Raleigh, NC: SciTech.

31.

O’Hara

Higgins

Fleger

Barnes

(2010). Guidance for human-system interfaces to automatic systems. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 54(4), 403–407. doi:10.1177/154193121005400428

32.

Owen

Raj

(2003). BPMN and business process management: Introduction to the new business process modeling standard. New York, NY: Popkin Software.

33.

Parasuraman

Barnes

Cosenzo

(2007). Adaptive automation for human-robot teaming in future command and control systems. International C2 Journal, 1(2).

34.

Parasuraman

Riley

(1997). Humans and automation: Use, misuse, disuse, abuse. Human Factors, 39(2), 230–253. doi:10.1518/001872097778543886

35.

Parasuraman

Sheridan

T. B.

Wickens

C. D.

(2000). A model for types and levels of human interaction with automation. IEEE Transactions on Systems, Man and Cybernetics, Part A: Systems and Humans, 30(3), 286–297. doi:10.1109/3468.844354

36.

Pew

R. W.

(2008). Some new perspectives for introducing human-systems integration into the system development process. Journal of Cognitive Engineering and Decision Making, 2(3), 165–180. doi:10.1518/155534308x377063

37.

Pew

R. W.

Mavor

A. S.

(Eds.). (2007). Human-system integration in the system development process: A new look. Washington, DC: National Academies Press.

38.

Piaszczyk

(2011). Model based systems engineering with Department of Defense Architectural Framework. Systems Engineering, 14(3), 305–326. doi:10.1002/sys.20180

39.

Pritchett

A. R.

(2009). Aviation automation: General perspectives and specific guidance for the design of modes and alerts. Reviews of Human Factors and Ergonomics, 5(1), 82–113. doi: 10.1518/155723409x448026

40.

Sarter

N. B.

Woods

D. D.

Billings

C. E.

(1997). Automation surprises. In Salvendy

(Ed.), Handbook of human factors and ergonomics (pp. 1926–1943). New York, NY: Wiley.

41.

Scerbo

M. W.

(2007). Adaptive automation. In Parasuraman

Rizzo

(Eds.), Neuroergonomics: The brain at work (pp. 239–252). New York, NY: Oxford University Press.

42.

Sheridan

T. B.

(1992). Telerobotics, automation, and human supervisory control. Cambridge, MA: MIT Press.

43.

Sheridan

T. B.

Van Cott

H. P.

Woods

D. D.

Pew

R. W.

Hancock

P. A.

(1998). Allocating functions rationally between humans and machines. Ergonomics in Design: The Quarterly of Human Factors Applications, 6(3), 20–25. doi:10.1177/106480469800600305

44.

Stanton

N. A.

(2006). Hierarchical task analysis: Developments, applications, and extensions. Applied Ergonomics, 37(1), 55–79. doi:http://dx.doi.org/10.1016/j.apergo.2005.06.003

45.

Steinhauser

N. B.

Pavlas

Hancock

P. A.

(2009). Design principles for adaptive automation and aiding. Ergonomics in Design: The Quarterly of Human Factors Applications, 17(2), 6–10. doi:10.1518/106480409x435943

46.

Tomayko

J. E.

(1987). Computers in spaceflight: The NASA experience. Washington, DC: NASA.

47.

Treadwell

Naikar

(2014). The application of work domain analysis to defining Australia’s air combat capability (DSTO-TR-2958). Fairbairn, Australia: Defence Science and Technology Organisation.

48.

U.S. Department of Defense. (2015). DoDAF architecture framework Version 2.02: Change 1. Retrieved from http://dodcio.defense.gov/Library/DoDArchitectureFramework.aspx

49.

Viikki

Palviainen

(2011, August–September). Integrating human-centered design into software development: An action research study in the automation industry. Paper presented at the 37th EUROMICRO Conference on Software Engineering and Advanced Applications, Oulu, Finland.

50.

Wallace

Dugger

Bost

J. R.

Hamburger

Hendrikse

E. J.

Peacock

(2002). Improving the consideration of human factors in system design. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 46(23), 1895–1899. doi:10.1177/154193120204602306

51.

Wiley

R. G.

(1993). Electronic intelligence: The analysis of radar signals (2nd ed.). Boston, MA: Artech House.

52.

Winters

J. J.

Perry

A. A.

White

G. D.

(1999). Improving the integration of human factors inputs to system design. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 43(19), 1055–1059. doi:10.1177/154193129904301909

53.

Woods

D. D.

Branlat

(2010). Hollnagel’s test: Being “in control” of highly interdependent multi-layered networked systems. Cognition, Technology and Work, 12(2), 95–101. doi:10.1007/s10111-010-0144-5

54.

Woods

Dekker

(2000). Anticipating the effects of technological change: A new era of dynamics for human factors. Theoretical Issues in Ergonomics Science, 1(3), 272–282. doi:10.1080/14639220110037452

55.

Zachary

Neville

Fowlkes

Hoffman

R. R.

(2007). Human total cost of ownership: The penny foolish principle at work. IEEE Intelligent Systems, 22(2), 88–92. doi:10.1109/MIS.2007.33