Measuring Lethal Force Performance in the Lab: The Effects of Simulator Realism and Participant Experience

Abstract

Objective

The goal of the current study was to compare two types of shooting simulators to determine which is best suited for assessing different aspects of lethal force performance.

Background

Military and law enforcement personnel are often required to make decisions regarding the use of lethal force. A critical goal of both training and research endeavors surrounding lethal force is to find ways to simulate lethal force encounters to better understand behavior in those scenarios.

Method

Participants of varying degrees of experience completed both marksmanship and shoot/don’t shoot scenarios on both a video game and a military-grade shooting simulator. Using signal detection theory, we assessed sensitivity as a measure of lethal force performance overall. We used hit rate to assess shooting accuracy and false alarm rate to assess decision making.

Results

Results demonstrated that performance was correlated across simulators. Results supported the notion that shooting accuracy and decision making are independent components of performance. Individuals with firearms expertise outperformed novices on the military-grade simulator, but only with respect to shooting accuracy, not unintended casualties. Individuals with video game experience outperformed novices in the video game simulator, but again only on shooting accuracy.

Conclusion

Experience played a crucial role in the assessment of shooting accuracy on a given simulator platform; decision-making performance remained unaffected by experience level or type of simulator.

Application

We recommend that in expert populations or when assessing shooting accuracy, a military-grade shooting simulator be used. However, with a novice population and/or when interested in decision making in lethal force, a video game simulator is appropriate.

Keywords

decision making shooting simulator signal detection theory shooting accuracy

Get full access to this article

View all access options for this article.

References

Biggs

A. T.

Brockmole

J. R.

Witt

J. K

. (2013). Armed and attentive: Holding a weapon can bias attentional priorities in scene viewing. Attention, Perception, & Psychophysics, 75, 1715–1724.doi:10.3758/s13414-013-0538-6

http://www.ncbi.nlm.nih.gov/pubmed/24027031

Biggs

A. T.

Cain

M. S.

Mitroff

S. R

. (2015). Cognitive training can reduce civilian casualties in a simulated shooting environment. Psychological Science, 26, 1164–1176.doi:10.1177/0956797615579274

http://www.ncbi.nlm.nih.gov/pubmed/26170262

Blacker

K. J.

Curby

K. M

. (2013). Enhanced visual short-term memory in action video game players. Attention, Perception, & Psychophysics, 75, 1128–1136.doi:10.3758/s13414-013-0487-0

http://www.ncbi.nlm.nih.gov/pubmed/23709068

Brewer

G. A.

Hunter Ball

Ware

J. M

. (2016). Individual differences in working memory capacity and shooting behavior. Journal of Applied Research in Memory and Cognition, 5, 185–191.doi:10.1016/j.jarmac.2016.04.004

Correll

Park

Judd

C. M.

Wittenbrink

Sadler

M. S.

Keesee

. (2007). Across the thin blue line: Police officers and racial bias in the decision to shoot. Journal of Personality and Social Psychology, 92, 1006–1023.doi:10.1037/0022-3514.92.6.1006

http://www.ncbi.nlm.nih.gov/pubmed/17547485

Deeny

S. P.

Haufler

A. J.

Saffer

Hatfield

B. D

. (2009). Electroencephalographic coherence during visuomotor performance: A comparison of cortico-cortical communication in experts and novices. Journal of Motor Behavior, 41, 106–116.doi:10.3200/JMBR.41.2.106-116

http://www.ncbi.nlm.nih.gov/pubmed/19201681

Dye

M. W. G.

Green

C. S.

Bavelier

. (2009). Increasing speed of processing with action video games. Current Directions in Psychological Science, 18, 321–326.doi:10.1111/j.1467-8721.2009.01660.x

http://www.ncbi.nlm.nih.gov/pubmed/20485453

Fitts

P. M

. (1966). Cognitive aspects of information processing: III. Set for speed versus accuracy. Journal of Experimental Psychology, 71, 849–857.doi:10.1037/h0023232

http://www.ncbi.nlm.nih.gov/pubmed/5939364

Goldberg

Amburn

Ragusa

Chen

D.-W

. (2017). Modeling expert behavior in support of an adaptive psychomotor training environment: A marksmanship use case. International Journal of Artificial Intelligence and Education, 28, 194–224.doi:10.1007/s40593-017-0155-y

10.

Green

C. S.

Bavelier

. (2003). Action video game modifies visual selective attention. Nature, 423, 534–537.doi:10.1038/nature01647

http://www.ncbi.nlm.nih.gov/pubmed/12774121

11.

Green

D. M.

Swets

J. A

. (1966). Signal detection theory and psychophysics (Vol. 1). Wiley.

12.

Harris

K. R.

Eccles

D. W.

Freeman

Ward

. (2017). ‘Gun! Gun! Gun!’: An exploration of law enforcement officers’ decision-making and coping under stress during actual events. Ergonomics, 60, 1112–1122.doi:10.1080/00140139.2016.1260165

http://www.ncbi.nlm.nih.gov/pubmed/27841090

13.

James

Vila

Daratha

. (2013). Results from experimental trials testing participant responses to White, Hispanic and Black suspects in high-fidelity deadly force judgment and decision-making simulations. Journal of Experimental Criminology, 9, 189–212.doi:10.1007/s11292-012-9163-y

14.

Johnson

R. R.

Stone

B. T.

Miranda

C. M.

Vila

James

S. M.

Rubio

R. F.

Berka

. (2014). Identifying psychophysiological indices of expert vs. novice performance in deadly force judgment and decision making. Frontiers in Human Neuroscience, 8, 512.doi:10.3389/fnhum.2014.00512

http://www.ncbi.nlm.nih.gov/pubmed/25100966

15.

Kerick

S. E.

Hatfield

B. D.

Allender

L. E

. (2007). Event-related cortical dynamics of soldiers during shooting as a function of varied task demand. Aviation, Space, and Environmental Medicine, 78, B153–164.http://www.ncbi.nlm.nih.gov/pubmed/17547316

16.

Mastiff . (2013). Reload: Target down [Video game for Nintendo Wii]. Author.

17.

Sheeran

T. J

. (1985). Effect of pure and crossed dextrality on marksmanship skill. Perceptual and Motor Skills, 61, 1171–1174.doi:10.2466/pms.1985.61.3f.1171

http://www.ncbi.nlm.nih.gov/pubmed/4094857

18.

Soetedjo

Nurcahyo

Nakhoda

Y. I

. (2011). Development of a cost-effective shooting simulator using laser pointer [Paper presentation]. Paper Presented at the Proceedings of the 2011 International Conference on Electrical Engineering and Informatics, Bandung.

19.

Suss

Ward

. (2018). Revealing perceptual–cognitive expertise in law enforcement: An iterative approach using verbal-report, temporal-occlusion, and option-generation methods. Cognition, Technology & Work, 20, 585–596.doi:10.1007/s10111-018-0493-z

20.

Taylor

J. E. T.

Witt

J. K.

Pratt

. (2017). A different kind of weapon focus: Simulated training with ballistic weapons reduces change blindness. Cognitive Research: Principles and Implications, 2, 3.doi:10.1186/s41235-016-0037-0

http://www.ncbi.nlm.nih.gov/pubmed/28203631

21.

Ward

Suss

Eccles

D. W.

Williams

A. M.

Harris

K. R

. (2011). Skill-based differences in option generation in a complex task: A verbal protocol analysis. Cognitive Processing, 12, 289–300.doi:10.1007/s10339-011-0397-9

http://www.ncbi.nlm.nih.gov/pubmed/21461753

22.

Wickelgren

W. A

. (1977). Speed-accuracy tradeoff and information processing dynamics. Acta Psychologica, 41, 67–85.doi:10.1016/0001-6918(77)90012-9

23.

Wilson

K. M.

Head

de Joux

N. R.

Finkbeiner

K. M.

Helton

W. S

. (2015). Friendly fire and the sustained attention to response task. Human Factors: The Journal of the Human Factors and Ergonomics Society, 57, 1219–1234.doi:10.1177/0018720815605703

http://www.ncbi.nlm.nih.gov/pubmed/26408648

24.

Wilson

K. M.

Head

Helton

W. S

. (2013). Friendly fire in a simulated firearms task. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 57, 1244–1248.doi:10.1177/1541931213571276

25.

Witt

J. K.

Brockmole

J. R

. (2012). Action alters object identification: Wielding a gun increases the bias to see guns. Journal of Experimental Psychology: Human Perception and Performance, 38, 1159–1167.doi:10.1037/a0027881

http://www.ncbi.nlm.nih.gov/pubmed/22506781

26.

Inzlicht

. (2015). Neurophysiological responses to gun-shooting errors. International Journal of Psychophysiology, 95, 247–253.doi:10.1016/j.ijpsycho.2014.10.015

http://www.ncbi.nlm.nih.gov/pubmed/25448268

27.

Yates

W. W

. (2004). A training transfer study of the indoor simulated marksmanship trainer. (MS), Naval Postgraduate School.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.02 MB