The Armed Services Vocational Aptitude Battery (ASVAB) is the test used by the United States military for personnel selection and classification. We evaluated the validity of this selection test to predict mechanical job performance, as measured by five different criteria: a hands-on performance test, a job knowledge test, grade point average in mechanical training, job proficiency ratings, and supervisor ratings. Using a sample of 891 automotive mechanics and 522 helicopter mechanics, we found that a mechanical maintenance composite of the ASVAB predicts hands-on performance, job knowledge, and training grades quite well, with validities corrected for range restriction between .68 and .72; the ASVAB was not as predictive of performance ratings, with validities ranging from .09 to .20. Job experience, measured by time in service, was also important in predicting job performance. No aptitude by experience interaction was found. For hands-on performance and job knowledge, an additional 10 points on the ASVAB composite usually resulted in greater performance than did an additional 12 months of job experience. Conversely, experience was the dominant predictor for performance ratings.
Get full access to this article
View all access options for this article.
References
1.
Brogden, H. E. (1946). On the interpretation of the correlation coefficient as a measure of predictive efficiency. Journal of Educational Psychology, 37, 65-76.
2.
Brogden, H. E. (1959). Efficiency of classification as a function of number of jobs, percent rejected, and the validity and intercorrelation of job performance estimates. Educational and Psychological Measurement, 19(2), 181-190.
3.
Campbell, J. P. (1990). An overview of the Army selection and classification project (Project A). Personnel Psychology, 43, 231-239.
4.
Campbell, J. P. , McHenry, J. J., & Wise, L. L (1990). Modeling job performance in a population of jobs. Personnel Psychology, 43, 313-333.
5.
Carey, N. B. (1991). Setting standards and diagnosing training needs with surrogate job performance measures. Military Psychology, 3, 135-150.
6.
Carey, N. B. (1992). Does choice of criterion matter?Military Psychology, 4, 103-117.
7.
Carey, N. B. (1994). Computer predictors of mechanical job performance: Marine Corps findings. Military Psychology, 6, 1-25.
8.
Carey, N. B. , & Hiatt, C. M. (1991). Data quality for the automotive maintenance phase of the Marine Corps Job Performance Measurement (JPM) project (CNA Research Memorandum 91-120). Alexandria, VA: Center for Naval Analyses.
9.
Carey, N. B. , & Hiatt, C. M. (1992). Data quality for the helicopter maintenance phase of the Marine Corps Job Performance Measurement (JPM) project (CNA Research Memorandum 91-221). Alexandria, VA: Center for Naval Analyses.
10.
Carey, N. B. , & Hiatt, C. M. (1993). Validity of the Marine Corps Electronics Composite for Predicting Success in Electronics Training School (CNA Research Memorandum 92-212). Alexandria, VA: Center for Naval Analyses.
11.
Dunnette, M. D. (1963). A note on the criterion. Journal of Applied Psychology, 47, 251-254.
12.
Earles, J. A. , & Ree, M. J. (1993). The predictive validity of the ASVAB for training grades. Educational and Psychological Measurement, 52, 721-725.
13.
Ghiselli, E. E. (1973). The validity of aptitude tests in selection. Personnel Psychology, 26, 461-477.
14.
Green, B. F. , & Wing, H. (Eds.). (1988). Analysis of job performance measurement data: Report of a workshop. Washington, DC: National Academy Press.
15.
Gulliksen, H. (1987). Theory of mental tests. Hillsdale, NJ: Lawrence Erlbaum.
16.
Jensen, A. J. (1984). Test validity: g versus the specificity doctrine. Journal of Social and Biological Structures, 7, 93-118.
17.
Lawley, D. N. (1943). A note on Karl Pearson's selection formulae. Proceedings of the Royal Society of Edinburgh, 62 (Section A, Pt. 1), 28-30.
18.
Maier, M. H. (1988). On the need for quality control in validation research. Personnel Psychology, 41, 497-502.
19.
Maier, M. H. , & Hiatt, C. M. (1984). An evaluation of using job performance tests to validate ASVAB qualification standards (CNA Report 89). Alexandria, VA: Center for Naval Analyses.
20.
Maier, M. H. , & Sims, W. (1986). The ASVAB score scales: 1980 and World WarI (CNAReport 116). Alexandria, VA: Center for Naval Analyses.
21.
Mayberiy, P. W. (1990). Validation of ASVAB against infantry job performance (CNA Research Memorandum 90-182). Alexandria, VA: Center for Naval Analyses.
22.
Mayberry, P. W. (1991). Analysis and prediction of infantry unit leaders' performance (CNA Research Memorandum 91-99). Alexandria, VA: Center for Naval Analyses.
23.
Mayberry, P. W. , & Carey, N. B. (1993). Relationship between ASVAB and mechanical maintenance job performance (CNA Research Memorandum 92-192). Alexandria, VA: Center for Naval Analyses.
24.
McHenry, J. J. , Hough, L. M., Toquam, J. L., Hanson, M. A., & Ashworth, S. (1990). Project A validity results: The relationship between predictor and criterion domains. Personnel Psychology, 43, 335-354.
25.
National Research Council, Committee on the Performance of Military Personnel, Commission on Behavioral and Social Sciences and Education . (1984). Job performance in the military: Report of a workshop. Washington, DC: National Academy Press.
26.
Pearson, K. (1903). Mathematical contributions to the theory of evolution: II. On the influence of natural selection on the variability and correlation of organs. Royal Society of Philosophical Transactions, 200,1-66.
27.
Ree, M. J. , Earles, J. A., & Teachout, M. S. (1994). Predicting job performance: Not much more than g. Journal of Applied Psychology, 79, 518-524.
28.
Schmidt, F. L. , Hunter, J. E., Outer bridge, A. N., & Goff, S. (1988). Joint relation of experience and ability with job performance: Test of three hypotheses. Journal of Applied Psychology, 73, 46-57.
29.
Schmidt, F. L. , Hunter, J. E., & Urry, V. W. (1976). Statistical power in criterion-related validation studies. Journal of Applied Psychology, 61(4), 473-485.
30.
Schmitt, N. , Gooding, R. A., Noe, R. A., & Kirsch, M. (1984). Meta-analyses of validity studies published between 1964 and 1982 and the investigation of study characteristics. Personnel Psychology, 37, 407-422.
31.
Spearman, C. (1904). "General intelligence" objectively determined and measured. American Journal of Psychology, 15, 201-293.
32.
Tang, V. K. , Carey, N. B., & Hiatt, C. M. (1993). Surrogates for mechanical maintenance job performance (CNA Research Memorandum 92-207). Alexandria, VA: Center for Naval Analyses.
33.
Taylor, H. C. , & Russell, J. T. (1939). The relationship of validity coefficients to the practical effectiveness of tests in selection: Discussion and tables. Journal of Applied Psychology, 23, 565-578.
34.
Thormdike, R. L. (1949). Personnel selection. New York: John Wiley.
35.
Thorndike, R. L. (1986). The role of general ability in prediction. Journal of Vocational Behavior, 29, 332-339.
36.
Wigdor, A. K. , & Green, B. F. (Eds.). (1986). Assessing the performance of enlisted personnel: Evaluation of a joint-service research project. Washington, DC: National Academy Press.
37.
Wigdor, A. K. , & Green, B. F. (Eds.). (1991). Performance assessment for the workplace: Volume L Washington, DC: National Academy Press.
