Linking Performance Measures and Measurement Purpose in Scenario-Based Training

Abstract

Despite its importance, there are scant guidelines to assist instructional development experts with the scenario-based training process. In particular, little information exists that links different types of human performance measures with the type of performance assessed and the purpose of training. In an effort to provide new insights on this important issue, the present study examined the appropriateness of four rating formats (i.e., checklists, frequency count, distance and discrepancy, and rating scale) for six performance outcomes, three process variables, and three purposes of scenario-based training. Expert judgments were collected via a short survey. The results indicated that for nine of the 12 variables a single measurement strategy was most appropriate. However, the results also indicated that experts tended to over rely on rating scales as their preferred choice. Implications for practice and suggested requirements for future research are provided.