Studying Complex Human-System Behaviour: Human-in-the-loop Simulation Requirements

Abstract

The Defence Science and Technology Organisation (DSTO) is required to provide advice to customers for the procurement of future military systems using the high fidelity human-in-the-loop simulation (HILS) facility housed in the Air Operations Simulation Centre (AOSC). A program of research is under way that compares two work analysis techniques (traditional task analysis and Cognitive Work Analysis) on the basis of whether the human-system performance measures that they suggest are sensitive to system modifications and so may be used for system evaluation. In this paper we show that representing aircrew's tactical environment as a series of concentric “rings” resulted in the development of HILS requirements that let us evaluate the measures derived from both work analysis approaches. Using the rings to frame the experiment and develop simulation requirements was beneficial for several reasons including participant involvement, validity of the system and operator behaviour observed, and completeness of the study.