This study examined the selection ratio for 253 doctorate-level psychology programs. On average, the selection ratio for psychology Ph.D. programs was .11 (SD = .12). This information was used to estimate the existing range restriction on General Record Examination (GRE) scores in validation studies. Results of the investigation showed the importance of correcting for range restriction in GRE validation research. The low selection ratio of graduate programs restricted the GRE variance in the validation sample, decreasing the observed mean correlations with graduate school performance criteria reported in the literature. Appropriate range restriction corrections were made using previous research data. Revised estimates of the GRE validity for predicting performance in psychology graduate programs were computed taking into account range restriction. Results showed that the GRE is a valid predictor of graduate school performance. We offer a GRE range restriction distribution that can be employed in future research on the validity of the GRE.
Get full access to this article
View all access options for this article.
References
1.
American Psychological Association . (1996). Graduate study in psychology. Washington, DC: Author.
2.
Birnbaum, Z. W. , Paulson, E., & Andrews, F. C. (1950). On the effect of selection performed on some coordinates of a multi-dimensional population. Psychometrika, 15, 191-204.
3.
Campbell, J. P. , Kuncel, N. R., & Oswald, F. L. (1998, April). Predicting performance in graduate school: The criterion problem. Paper presented at the annual conference of the Society for Industrial and Organizational Psychology, Dallas, TX.
4.
Dawes, R. M. (1971). A case study of graduate admissions: Application of three principles in human decision making. American Psychologist, 26, 180-188.
5.
Dawes, R. M. (1975). Graduate admissions variables and future success. Science, 187, 721-723.
6.
Dobson, P. (1988). The correction of correlation coefficients for restriction of range when restriction results from the truncation of a normally distributed variable. British Journal of Mathematical and Statistical Psychology, 41, 227-234.
7.
Dollinger, S. J. (1989). Predictive validity of the graduate record examination in a clinical psychology program. Professional Psychology: Research and Practice, 20, 56-58.
8.
Ewen, R. B. (1969). The GRE psychology test as an unobtrusive measure of motivation. Journal of Applied Psychology, 53, 383-387.
9.
Ghiselli, E. E. (1964). Theory of psychological measurement. New York: McGraw-Hill.
10.
Goldberg, E. L. , & Alliger, G. M. (1992). Assessing the validity of the GRE for students in psychology: A validity generalization approach. Educational and Psychological Measurement, 52, 1019-1027.
11.
Goldberg, L. R. (1977). Admission to the Ph.D. program in the department of psychology at the University of Oregon. American Psychologist, 32, 663-668.
12.
Gross, A. L. (1982). Relaxing assumptions underlying corrections for range restriction. Educational and Psychological Measurement, 42, 795-801.
13.
Gross, A. L. , & Fleischman, L. (1983). Restriction of range corrections when both distribution and selection assumption is violated. Applied Psychological Measurement, 7, 227-237.
14.
Gulliksen, H. (1950). Theory of mental tests. New York: John Wiley.
15.
Harnett, R. T. , & Willingham, W. W. (1980). The criterion problem: What measure of success in graduate education?Applied Psychological Measurement, 4, 281-291.
16.
Hunter, J. E. , & Schmidt, F. L. (1990). Methods of meta-analysis: Correcting error and bias in research findings. Newbury Park, CA: Sage.
17.
Hunter, J. E. , Schmidt, F. L., & Jackson, G. B. (1982). Meta-analysis: Cumulating research findings across studies. Beverly Hills, CA: Sage.
18.
Ingram, R. E. (1983). The GRE in the graduate admissions process: Is how it is used justified by evidence of its validity?Professional Psychology: Research and Practice, 14, 711-714.
19.
Ingram, R. E. , & Zurawski, R. (1981). Choosing clinical psychologists: An examination of the utilization of admission criteria. Professional Psychology: Research and Practice, 12, 684-689.
20.
Kaplan, R. M. , & Saccuzzo, D. P. (1982). Psychological testing: Principles, applications and issues. Pacific Grove, CA: Brooks/Cole.
21.
Kirnan, J. P. , & Geisinger, K. F. (1981). The prediction of graduate school success in psychology. Educational and Psychological Measurement, 41, 815-820.
22.
Kuncel, N. R. , Campbell, J. P., & Ones, D. S. (1998). The validity of the Graduate Record Exam: Estimated or tacitly known?American Psychologist, 53, 567-568.
23.
Lancholm, G. V. , & Schrader, W. B. (1951). Predicting graduate school success. Princeton, NJ: Educational Testing Service.
24.
Law, A. (1960). The prediction of ratings of students in a doctoral training program. Educational and Psychological Measurement, 44, 847-851.
25.
Lawley, D. N. (1943). A note on Karl Pearson’s selection formulae. Proceedings of the Royal Society of Edinborough, LXIII-Part 1, 28-30.
26.
Levin, J. (1972). An occurrence of an increase in correlation by restriction of range. Psycho-metrika, 37, 93-97.
27.
Lord, F. M. , & Novick, M. R. (1968). Statistical theories of mental test scores. Reading, MA: Addison-Wesley.
28.
Milner, M. , McNeil, J. S., & King, S. W. (1984). The GRE: A question of validity in predicting performance in professional schools of social work. Educational and Psychological Measurement, 44, 945-950.
29.
Rem, R. J. , Oren, E. M., & Childrey, G. (1987). Selection of graduate students in psychology: Use of cutoff scores and interviews. Professional Psychology: Research and Practice, 18, 485-488.
30.
Robertson, M. , & Nielson, W. (1961). The graduate record examination and selection of graduate students. American Psychologist, 16, 648-650.
31.
Schmidt, F. L. , & Hunter, J. E. (1977). Development of a general solution to the problem of validity generalization. Journal of Applied Psychology, 62, 529-540.
32.
Schnieder, L. M. , & Briel, J. B. (1990). Validity of the GRE: 1988-1989 summary report. Princeton, NJ: Educational Testing Service.
33.
Sternberg, R. J. , & Williams, W. W. (1997). Does the Graduate Record Examination predict meaningful success in the graduate training of psychologists? A case study. American Psychologist, 52, 630-641.
34.
Taylor, D. A. (1975). Recruitment and training of ethnic minorities in psychology. Personality and Social Psychology Bulletin, 2, 142-147.
35.
Thorndike, R. L. (1982). Applied psychometric theory. New York: John Wiley.
36.
Tryon, G. S. , & Tryon, W. W. (1986). Factors associated with clinical practicum trainees’ engagements of clients in counseling. Professional Psychology: Research and Practice, 17, 586-589.
