Abstract
A criterion-referenced test keyed to an individualized, self-paced instruction program was developed as part of a diagnostic testing/shipboard training system. The job-based test described hypothetical situations that were based on known job requirements. Under each such situation, questions were asked that required the demonstration of skills and knowledges that supported the job and were covered in the various modules of the instruction program. High face and content validity were ensured by using cards, charts, diagrams, and illustrations in presenting each job situation; and by having job experts write test items. Items were selected that best discriminated between graduates and nongraduates of a shorebased program using the same instruction. The cutoff score for the set of items pertaining to each module was determined from the performance of graduates of the shorebased program and applied to a cross-validation sample. Test scores from two administrations were used to estimate the reliability of the diagnostic decision making.
Get full access to this article
View all access options for this article.