Beyond Identity: Incorporating System Reliability Information Into an Automated Combat Identification System

Abstract

Objective: The aim of this study was to evaluate display formats for an automated combat identification (CID) aid.

Background: Verbally informing users of automation reliability improves reliance on automated CID systems. A display can provide reliability information in real time.

Method: We developed and tested four visual displays that showed both target identity and system reliability information. Display type (pie, random mesh) and display proximity (integrated, separated) of identity and reliability information were manipulated. In Experiment 1, participants used the displays while engaging targets in a simulated combat environment. In Experiment 2, participants briefly viewed still scenes from the simulation.

Results: Participants relied on the automation more appropriately with the integrated display than with the separated display. Participants using the random mesh display showed greater sensitivity than those using a pie chart. However, in Experiment 2, the sensitivity effects were limited to lower reliability levels.

Conclusion: The integrated display format and the random mesh display were the most effective displays tested.

Application: We recommend the use of the integrated format and a random mesh display to indicate identity and reliability information with an automated CID system.

Keywords

automation combat identification decision aids integrated displays proximity compatibility principle reliance simulation signal detection theory system reliability visual attention visual displays

Get full access to this article

View all access options for this article.

References

Ariely D.

.Seeing sets: Representation by statistical properties.Psychological Science. 2001;12:157-162

Bainbridge L.

.Ironies of automation.Automatica. 1983;19:775-779

Brand J. L.

Orenstein H. B.

.Does display configuration affect information sampling performance?.Ergonomics. 1998;41:286-301

Chong S.

Treisman A.

.Representation of statistical properties.Vision Research. 2003;43:393-404

Chong S.

Treisman A.

.Attentional spread in the statistical processing of visual displays.Perception & Psychophysics. 2004;66:1282-1294

Coury B. G.

Boulette M. D.

Smith R. A.

.Effect of uncertainty and diagnosticity on classification of multidimensional data with integral and separable displays of system status.Human Factors. 1989;31:551-569

Dzindolet M. T.

Pierce L. G.

Beck H. P.

Dawe L. A.

Anderson B. W.

Military Psychology. 2001:147-164.

Feldman-Stewart D.

Brundage M. D.

Zotov V.

.Further insight into the perception of quantitative information: Judgments of gist in treatment decisions.Medical Decision Making. 2007;27:34-43

Finger R.

Bisantz A. M.

.Utilizing graphical formats to convey uncertainty in a decision making task.Theoretical Issues in Ergonomics Science. 2002;3:1-25

10.

Hollands J. G.

Spence I.

.Judgments of change and proportion in graphical perception.Human Factors. 1992;35:313-334

11.

Hollands J. G.

Spence I.

.Judging proportion with graphs: The summation model.Applied Cognitive Psychology. 1998;12:173-190

12.

Howell D. C.

Statistical methods for psychology. 3rd ed.Belmont, CA: Duxbury Press; 1992:

13.

Karsh R.

Walrath J. D.

Swoboda J. C.

Pillalamarri K.

The effect of battlefield combat identification system information on target identification time and errors in a simulated tank engagement task. Aberdeen Proving Ground, MD: Army Research Laboratory; 1995:

14.

Lee J. D.

See K. A.

.Trust in automation: Designing for appropriate reliance.Human Factors. 2004;46:50-80

15.

Macmillan N. A.

Creelman C. D.

Detection theory: A user’s guide. New York, NY: Cambridge University Press; 1991:

16.

Maltz M.

Shinar D.

.New alternative methods in analyzing human behavior in cued target acquisition.Human Factors. 2003;45:281-295

17.

Parasuraman R.

Riley V.

.Humans and automation: Use, misuse, disuse, abuse.Human Factors. 1997;39:230-253

18.

Rovira E.

McGarry K.

Parasuraman R.

.Effects of imperfect automation on decision making in a simulated command and control task.Human Factors. 2007;49:76-87

19.

Salthouse T. A.

Ellis C. L.

.Determinants of eye-fixation duration.American Journal of Psychology. 1980;93:207-234

20.

Salvucci D. D.

.A model of eye movements and visual attention. Proceedings of the International Conference on Cognitive Modeling; 2000

; 2000. 252.

21.

Sanquist T. F.

Minsk B.

Parasuraman R.

.Cognitive engineering in radiation screening for homeland security.Journal of Cognitive Engineering and Decision Making. 2008;2:204-219

22.

See J. E.

Howe S. R.

Warm J. S.

Dember W. N.

.Meta-analysis of the sensitivity decrement in vigilance.Psychological Bulletin. 1995;117:230-249

23.

Sherman K.

.Combat identification system for the dismounted soldier. Proceedings of SPIE 2000: Digitization of the Battlespace V and Battlefield Biomedical Technologies II; 2000

; 2000. 135.

24.

Sherman K. B.

.Combat ID coming for individual soldiers.Journal of Electronic Defense. 2002;25:34-35

25.

Skitka L. J.

Mosier K. L.

Burdick M.

.Does automation bias decision-making?.International Journal of Human-Computer Studies. 1999;51:991-1006

26.

Sorkin R. D.

Woods D. D.

.Systems with human monitors: A signal detection analysis.Human-Computer Interaction. 1985;1:49-75

27.

Spence I.

Lewandowsky S.

.Displaying proportions and percentages.Applied Cognitive Psychology. 1991;5:61-77

28.

Wang L.

Jamieson G. A.

Hollands J. G.

.Improving reliability awareness to support appropriate trust and reliance on individual combat identification systems. Proceedings of the Human Factors and Ergonomics Society 52nd Annual Meeting; 2008

; 2008. 292.

29.

Wang L.

Jamieson G. A.

Hollands J. G.

.Trust and reliance on an automated combat identification system: The role of aid reliability and reliability disclosure.Human Factors. 2009;51:281-291

30.

Wickens C. D.

Carswell C. M.

.The proximity compatibility principle: Its psychological foundation and relevance to display design.Human Factors. 1995;37:473-494

31.

Wickens C. D.

Dixon S.

.The benefits of imperfect diagnostic automation: A synthesis of the literature.Theoretical Issues in Ergonomics Science. 2007;8:201-212

32.

Wickens C. D.

Hollands J. G.

Engineering psychology and human performance. 3rd ed.Upper Saddle River, NJ: Prentice Hall; 2000:

33.

Young C. J.

Dispatches: Lessons Learned for Soldiers. 2005: