Abstract
A preplacement selection test was developed and evaluated for the Bell System to ensure that the best qualified personnel would install and maintain new high-technology telecommunications systems. These new complex systems employ digital electronics and fiber optic transmission using lasers and glass fibers carrying pulses of light.
The project involved a thorough job analysis, development of test materials and evaluation study to set an initial passing score for the screening test. The basic principle of minicourse screening tests is to assess the candidates trainability or specific learning abilities. This is accomplished by presenting to the candidate modular samples of programmed learning materials adapted from required advanced training courses, and to test learning at the conclusion of each module using multiple choice questions. This particular minicourse screening test is titled Digital Cable Technologies Minicourse Test (DCTM); it consists of four modules (Introduction to Digital Multiplexing, Introduction to Fiber Optic Transmission Systems, Basic Electronics and Circuit Reading, and Acceptance Testing and Troubleshooting Procedures). The DCTM has a six hour time limit and the scoring algorithm is a function of the number of correct items and the total time required to read the programmed instructional materials and to answer the test questions.
The development of the DCTM followed the government requirements for test development as described in the Uniform Federal Guidelines on Employee Selection Procedures.
An empirically supported and fully documented job analysis was conducted including four criticality ratings of a 108 task statement inventory and Fleischman-type behaviorally anchored ratings of 31 basic abilities. A sample of 135 subject matter experts participated in this effort.
The evaluation of the minicourse test involved administration to 158 cable repair technicians across the Bell System from whom detailed time and accuracy data were collected. Although the DCTM is a completely content valid selection procedure, a follow-up predictive criteria-related validity study is currently being conducted to produce additional validity support. The evaluation study and the subsequent item analysis of the 79 test questions allowed two parallel forms of the DCTM tests to be developed with equal measurable levels of difficulty, discriminability and reliability.
Get full access to this article
View all access options for this article.