Recognition Measurement: Computer-Based and Paper-Based Methods

Abstract

According to a within-subjects design, 83 naval pilots and flight officers were administered computer-based and paper-based tests to assess recognition of aircraft silhouettes in order to determine the relative reliabilities and validities of these two measurement modes. Estimates of internal consistencies, equivalences, and discriminative validities were computed for multiple performance measures. It was established that the relative reliabilities and validities derived for these two assessment schemes were contingent upon the employed multivariate measurement criteria, i.e., percentage correct responses, average response latency, and average degree of confidence in recognition judgments, as well as the statistical criteria used to ascertain the comparative quality of these two modes of testing.