This study empirically tested the specificity-generality hypothesis regarding moderation of aptitude test validity by job ability requirement differences using a large sample (24,482) of Air Force enlistees in 37 different technical jobs. This was accomplished both across and within job families. In addition, the correlation of the proportion of psychometric g, measured by a test, and average test validity was estimated both within and across job families. The results failed to find moderating effects due to job differences. Furthermore, an analysis of the predictiveness of psychometric g showed that job ability differences did not moderate the relationship between the amount of g measured by a test and its score validity.
Get full access to this article
View all access options for this article.
References
1.
Alley, W. E. , Treat, B. R., & Black, D. E. (1988). Classification of Air Force jobs into aptitude clusters (AFHRL-TR-88-14). Brooks AFB, TX: Air Force Human Resources Laboratory.
2.
Barrett, G. V. , & Dippenette, R. L. (1991). A reconsideration of testing for competence rather than for intelligence. American Psychologist, 46, 1025-1032.
3.
Besetsney, L. K. , Earles, J. A., & Ree, M. J. (1993). Little incremental validity for a special test for Air Force intelligence operatives. Educational and Psychological Measurement, 53, 993-997.
4.
Besetsney, L. K. , Ree, M. J., & Earles, J. A. (1993). Special tests for computer programmers? Not needed. Educational and Psychological Measurement, 53, 507-511.
5.
Cattell, R. (1972). Intelligence: Its structure, growth, and action. The Netherlands: Elsevier Science.
6.
Dye, D. A. , Reck, M., & McDaniel, M. (1993). The validity of job knowledge measures. International Journal of Selection and Measurement, 1, 153-162.
7.
Earles, J. A. , & Ree, M. J. (1992). The predictive validity of ASVAB for training grades. Educational and Psychological Measurement, 52, 721-725.
8.
Ghiselli, E. E. (1973a). The validity of aptitude tests in personnel selection. Personnel Psychology, 26, 461-477.
9.
Ghiselli, E. E. (1973b). The validity of occupational aptitude tests. New York: John Wiley.
10.
Goldberg, S. (1991). When wish replaces thought: Why so much of what you believe is false. Buffalo, NY: Prometheus.
11.
Gottfredson, L. S. (1986). Foreword, The g factor in employment. Journal of Vocational Behavior, 29, 293-296.
12.
Hull, C. (1928). Aptitude testing. London: World Book.
13.
Hunter, J. E. (1983). A causal analysis of cognitive ability, job knowledge, job performance, and supervisor ratings. In F. Landy, S. Zedeck, & J. Cleveland (Eds.), Performance measurement and theory (pp. 257-266). Hillsdale, NJ: Lawrence Erlbaum.
14.
Hunter, J. E. (1986). Cognitive ability, cognitive aptitudes, job knowledge and job performance. Journal of Vocational Behavior, 29, 340-362.
15.
Hunter, J. E. , & Hunter, R. F. (1984). Validity and utility of alternative predictors across studies. Psychological Bulletin, 96, 72-98.
16.
Jensen, A. R. (1980). Bias in mental testing. New York: Free Press.
17.
Jensen, A. R. (1984). Test validity: g versus the specificity doctrine. Journal of Social and Biological Structures, 7, 93-118.
18.
Lawley, D. N. (1943). A note on Karl Pearson's selection formulae. Proceedings of the Royal Society of Edinburgh (Section A), 62(Part I), 28-30.
19.
McClelland, D. C. (1972). Testing for competence rather than for intelligence. American Psychologist, 28, 1-14.
20.
McHenry, J. J. , Hough, L. M., Toquam, J. L., Hanson, M. A., & Ashworth, S. (1990). Project A validity results: The relationship between predictor and criterion domains. Personnel Psychology, 43, 335-354.
21.
Olea, M. M. , & Ree, M. J. (1994). Pilot and navigator criteria: Not much more than g. Journal of Applied Psychology, 79, 845-851.
22.
Outerbridge, A. N. (1979). A survey of test validation study costs (Tech. Memorandum TM-79-18). Washington, DC: U.S. Office of Personnel Management, Personnel Research and Development Center. (NTIS No. 80-127319)
23.
Palmer, P. , Hartke, D. D., Ree, M. J., Welsh, J. R., & Valentine, L. D. (1988). Armed Services Vocational Aptitude Battery (ASVAB): Alternate form reliability (Forms 8, 9, 10, and 11) (AFHRL-TR-87-48). Brooks AFB, TX: Manpower and Personnel Division, Air Force Human Resources Laboratory.
24.
Ree, M. J. , & Carretta, T. R. (1994). Factor analysis of ASVAB: Confirming a Vernon-like structure. Educational and Psychological Measurement, 54, 457-461.
25.
Ree, M. J. , & Carretta, T. R. (1996). Central role of g in the prediction of pilot selection. International Journal of Aviation Psychology, 6, 111-123.
26.
Ree, M. J. , & Earles, J. A. (1991a). Predicting training success: Not much more than g. Personnel Psychology, 44(2), 321-332.
27.
Ree, M. J. , & Earles J. A. (1991b). The stability of g across different methods of estimation. Intelligence, 15, 271-278.
28.
Ree, M. J. , & Earles, J. A. (1992). Intelligence is the best predictor of job performance. Current Directions in Psychological Science, 1, 86-89.
29.
Ree, M. J. , Earles, J. A., & Teachout, M. S. (1994). Predicting job performance; Not much more than g. Journal of Applied Psychology, 79, 518-524.
30.
Schmidt, F. L. , Hunter, J. E. (1984). A within setting empirical test of the specificity hypothesis in personnel selection. Personnel Psychology, 37, 317-326.
31.
Schmidt, F. L. , Hunter, J. E., & Pearlman, K. (1981). Task differences as moderators of aptitude test validity in selection: A red herring. Journal of Applied Psychology, 66, 166-185.
32.
Stanley, J. C. (1971). Reliability. In R. L. Thorndike (Ed.), Educational measurement (2nd ed., pp. 400-401), Washington, DC: American Council on Education.
33.
Sternberg, R. J. , & Wagner, R. K. (1993). The gocentric view of intelligence andjob performance is wrong. Current Directions in Psychological Science, 2, 1-5.
34.
Thurstone, L. L. (1938). Primary mental abilities. Chicago: University of Chicago Press.
35.
Walters, L. C. , Miller, M., & Ree, M. J. (1993). Structured interviews for pilot selection: No incremental validity. International Journal of Aviation Psychology, 3, 25-38.
36.
Wilbourn, J. M. , Valentine, L. D., & Ree, M. J. (1984). Relationships of the Armed Services Vocational Aptitude Battery (ASVAB) Forns 8, 9, and 10 to Air Force technical school final grades (AFHRL-TR). Brooks AFB, TX: Air Force Human Resources Laboratory.
