Development and Evaluation of the Game-Based Performance Assessment Battery (GamePAB) and Game Experience Measure (GEM)

Abstract

The Army is increasingly using game-based simulations (GBS) for the training of Soldiers. The use of GBS addresses the need to quickly adapt training content and deliver relevant training to Soldiers. One major drawback to the use of any simulation is the need to insure the users have the minimal skills necessary to utilize the simulation to perform the training tasks. The best approach to insuring effective use of a GBS would be to employ a standardized measure of game skills. GamePAB was developed and is being evaluated for measuring video game skills and GEM was developed and is being evaluated for measuring prior gaming experience and knowledge. Data were collected from Soldiers during exercises in which a GBS was evaluated. Results suggest that the new metrics are reliable but not related. These results also suggest that there are continuing issues involved in using subjective measures of skill or objective measures of knowledge in predicting GBS performance.

Get full access to this article

View all access options for this article.

References

Brown

Hall

Holtzer

Brown

(1997). Gender and video game performance. Sex Roles, 36(11), 793–812.

Castel

Pratt

Drummond

(2005). The effects of action video game experience on the time course of inhibition of return and the efficiency of visual search. Acta Psychologica, 119(2), 217–230.

Chertoff

Jerome

Martin

Knerr

(2008). GamePAB: A game-based performance assessment battery application. Proceedings from the 52nd Annual Meeting of the Human Factors and Ergonomics Society Meeting. Santa Monica, CA: Human Factors and Ergonomics Society.

Durlach

Kring

Bowens

(2009). Effects of action video game experience on change detection. Military Psychology, 21, 24–39.

Gagnon

(1985). Videogames and spatial skills: An exploratory study. Educational Communication and Technology Journal, 33, 263–275.

Green

Bavelier

(2007). Action-video-game experience alters the spatial resolution of vision. Psychological Science, 18(1), 88–94.

O'Brea

Crabtree

Bell

(2006). Spiral development of virtual solutions for convoy defense training. Proceedings of the 28^th Interservice/Industry Training Systems and Education Conference. Arlington, VA: National Training Systems Association.

Orvis Orvis Belanich Mullin (2005). The influence of trainee gaming experience and computer self-efficacy on learner outcomes of videogame-based learning environments. (TR 1164). Alexandria, VA: U.S. Army Research Institute for the Behavioral and Social Sciences.

Terlecki

Newcombe

(2005). How important is the digital divide? The relation of computer and videogame usage to gender differences in mental rotation ability. Sex Roles, 53(5), 433–441.

10.

VanDeventer

White

(2002). Expert behavior in children's video game play. Simulation & Gaming, 33(1), 28–48.

11.

Young

W.C.

Broach

Farmer

W.L.

(1997). The effects of video game experience on computer-based air traffic controller specialist, air traffic scenario test scores. (FAA-AM-97-04). Washington, DC: FAA Office of Aviation Medicine Reports.