Assessing Distributed Mission Operations Using the Air Superiority Knowledge Assessment System

Abstract

The Air Superiority Knowledge Assessment System (ASKAS) was developed at the Air Force Research Laboratory as a method for measuring knowledge in fighter pilots. Differences in ASKAS results have been shown to correspond with the knowledge level of pilots with different amounts of experience. To further test this tool, it has recently been integrated into a week-long training program. ASKAS is given before and after training to measure changes in knowledge as a result of the training. Our results show that there is a small but measurable increase in knowledge, as measured by ASKAS, after the training. In addition, there is a quadratic relationship between pilot experience and performance on ASKAS, suggesting that mid-level pilots have the highest levels of knowledge. These results support the validity of ASKAS as a tool to measure changes in knowledge during training, and provide insight on how to improve ASKAS for future use.

Get full access to this article

View all access options for this article.

References

Crane

Robbins

Bennett

Jr. (2000). Using distributed mission training to augment flight lead upgrade training. In 2000 Proceedings of Interservice/Industry Training Systems and Education Conference (I/ITSEC). Orlando, FL: National Security Industrial Association.

Colegrove

C. M.

Alliger

G. M.

(2002). Mission essential competencies: Defining combat readiness in a novel way. Proceedings of the NATO Research & Technology Organization, Studies, Analysis, and Simulation Panel, Conference on Mission Training via Distributed Simulation (SAS-38), Brussels, Belgium.

Gehr

S. E.

Schreiber

B. T.

Metz

Bennett

Jr. (2005). Air Superiority Knowledge Assessment System. In 2005 Proceedings of the Interservice/Industry Training, Simulation and Education Conference (I/ITSEC). Orlando, FL National Security Industrial Association.

Kirkpatrick

(1975). Techniques for Evaluating Training Programs. Alexandria, VA: ASTD.

Krusmark

Schreiber

B. T.

Bennett

Jr. (2004). The Effectiveness of a Traditional Gradesheet for Measuring Air Combat Team Performance in Simulated Distributed Mission Operations. (AFRL-HE-AZ-TR-2004-0090). Air Force Research Laboratory, AZ: Warfighter Readiness Research Division.

Schreiber

B. T.

Bennett

Jr. (2006). Distributed Mission Operations Within-Simulator Training Effectiveness Baseline Study: Summary Report. (AFRL-HE-AZ-TR-2006–0015-Vol I, 1123AS03). Air Force Research Laboratory, AZ: Warfighter Readiness Research Division.

Schreiber

B. T.

Watz

E. A.

Bennett

Jr. (2003). Objective Human Performance Measurement in a Distributed Environment: Tomorrow's Needs. In 2003 Proceedings of the Interservice/Industry Training, Simulation and Education Conference (I/ITSEC). Orlando, FL National Security Industrial Association.

Schreiber

B.T.

Watz

E.A.

Bennett

Jr. Portrey

(2003). Development of a Distributed Mission Training Automated Performance Tracking System. In Proceedings of the 12th Conference on Behavior Representation in Modeling and Simulation. Scottsdale, AZ.