A Comparison of Observer and Incumbent Ratings of Situation Awareness

Abstract

The Situation Awareness Behavioral Rating Scale (SABARS) utilizes ratings by expert observer/controllers (O/Cs) to evaluate situation awareness (SA) of infantry small unit leaders. Previous research (Matthews et al., 2004) showed SABARS to be predictive of a variety of performance measures. The current study explored the question of whether small unit leaders could use SABARS to accurately rate their own behavior as an index of their SA. To evaluate this question, 12 Norwegian Army and Navy Academy cadets participating in the role of squad leader during summer training exercises were given the SABARS to complete following an infantry mission. An experienced officer O/C observed the cadets though the execution of the mission and also provided SABARS ratings on the squad leader. Results indicated that “self-SABARS” evaluations did not correlate with SABARS completed by O/C's, and were not predictive of performance criteria. O/C-completed SABARS were, however, predictive of performance criteria thus replicating findings reported previously (Matthews et al., 2004). Implications for assessing SA in the field are discussed.