Dynamic Measures for Performance Assessment in Complex Environments

Abstract

The command and control environment is a dynamic and complex setting with complicated technical systems where teams of operators interact to reach shared goals. This paper presents a study where a quasi-dynamic evaluation technique was used to assess performance. Nine operators from the Swedish Air Force participated in a peace support operation scenario in an operational setting. Data was collected by a repeated measurement technique to measure performance, workload, situation awareness, complexity, team coordination and sharing of information. A causal model was derived from the data which shows the relations between mental workload, individual performance and team performance. An efficiency index was calculated showing that the operators performed better over time, even though complexity increased. The use of the repeated measurement technique proved to be successful for measuring complex and dynamic events.