Deriving Performance Measures for Team Tasks: Evaluating a Methodology

Abstract

This study investigates the usefulness of existing performance measures for evaluating the outcome effectiveness of team tasks. It describes a method to identify the measures most appropriate for evaluating training on different types of tasks and under different performance conditions. Six prototype team tasks served as rating stimuli that were used to evaluate 15 objective and 23 subjective team performance measures. Raters (N=33) assessed the usefulness of these performance measures for evaluating performance on each team task under three different scenarios. These scenarios asked how useful the measure would be for: (1) evaluating the performance of teams that want to improve and develop skills; (2) evaluating the performance of teams that have learned the task and need to maintain performance; and (3) helping a consultant to appraise the performance of the team. Results indicated reliable panel ratings; factor analyses of each objective and subjective performance measure correlation matrix revealed five-factor solutions for each domain, and these solutions were consistent across tasks and scenarios. Performance rating means varied significantly by task type, but generally were consistent across scenarios. The ratings are sensitive to task type and can be used systematically to specify relevant dimensions of team evaluation.