Do We Practice What We Preach? The Prevalence of Graduate Record Examination Predictive Validity Studies at Leading Master of Public Administration/Master of Public Policy Programs
Restricted accessResearch articleFirst published online May, 1996
Do We Practice What We Preach? The Prevalence of Graduate Record Examination Predictive Validity Studies at Leading Master of Public Administration/Master of Public Policy Programs
This study presents findings from a survey of leading Master of Public Administration (MPA) and Master of Public Policy (MPP) programs who were asked to provide copies of Graduate Record Examination (GRE) validation studies. We planned to examine these papers to determine common themes that might contribute to developing a theory of valid entrance standards for MPA/MPP students. In spite of an 89 percent (31/35) response rate, only four schools had GRE validity research available. Three programs sent written reports dated 1985, 1990, and 1994, respectively. A fourth school conducted annual validity studies but did not issue a written document. Based on this paucity of validity studies, the present discussion proposes that the National Association of Schools of Public Affairs and Administration (NASPAA) require all MPA schools to furnish GRE validation studies as a part of program accreditation.
“I hope you have uncovered a good set of validation studies. I am our MPA director and it is obvious that we are making our admissions decisions in the midst of a fog of ignorance.“
(Survey Respondent)
Get full access to this article
View all access options for this article.
References
1.
Armistead v. Starkville Municipal1972Separate School Dist., 461 F.2d 276.
2.
BairdLeonard L.1976 “Biographical and Educational Correlates of Graduate and Professional School Admissions Test Scores,” Educational and Psychological Measurement, 36 (2) Summer, 420–425.
3.
BorgWalter R.1963 “GRE Aptitude Scores as Predictors of GPA for Graduate Students in Education,” Educational and Psychological Measurement, 23 (2) 379–382.
4.
BowmanJames S.1988Admissions Practices in Master of Public Administration Programs: A Nationwide Study. Public Administration Review, 48, (5) September/October 867–875.
5.
BowmanJames S.1990The Graduate Record Examination and Masters of Public Administration Programs. International Journal of Public. Administration, 13, (4) 561–586.
6.
BurtonNancy W.TurnerNancy J.1983Effectiveness of the GRE for Predicting First-Year Grades: 1981–82 Summary Report of the Graduate Record Examinations Validity Study Service, Princeton, NJ: Educational Testing Service.
7.
Deloitte and Touche1991 “LSAT, MCAT, GRE, and GMAT Score Improvement Study.” The Princeton Review.
8.
Educational Testing Service1992Guide to the Use of the GRE Program.Princeton, NJ: Educational Testing Service.
9.
Educational Testing Service1991Guidelines for the Use of the GRE Scores.Princeton, NJ: Educational Testing Service.
10.
GoldbergEdith L.AlligerGeorge M.1992 “Assessing the Validity of the GRE for Students in Psychology: A Validity Generalization Approach,” Educational and Psychological Measurement, 52(4) Winter 1019–1027.
11.
Griggs v. Duke Power, 91 S.Ct. 8491971
12.
GuyotJames F.WiedemannCarl F.1982 “GRE: New Polish for an Old Shoe.” Public Administration Times, American Society for Public Administration, May 5.
13.
HoldenConstance1993 “Predicting Performance in Graduate School,” Science, 260 (5107) 23 April 494.
14.
HouseJ. DanielJohnsonJames J.1993a “Predictive Validity of the GRE Advanced Psychology Test for Graduate Grades,” Psychological Reports, 73 (1) August, 184–186.
15.
HouseJ. DanielJohnsonJames J.1993b “Graduate Record Examination Scores and Academic Background Variables as Predictors of Graduate Degree Completion,” Educational and Psychological Measurement, 53(2) Summer, 551–556.
16.
HouseJ. DanielJohnsonJamesToloneWilliam L.1993 “Predictive Validity of the Graduate Record Examination for Performance in Selected Graduate Psychology Courses,” Psychological Reports, 60, 107–110.
17.
HuitemaBradley E.SteinCheri R.1993 “Validity of the GRE Without Restriction of Range,” Psychological Reports, 72, February, 123–127.
18.
IngramRick E.1983 “The GRE in the Graduate Admissions Process: Is How It Is Used Justified by the Evidence of Its Validity?” Professional Psychology: Research and Practice, 14 (6) December, 711–714.
19.
JacobsonRobert L.1993a “New Computer Techniques Seen Producing a Revolution in Educational Testing,” Chronicle of Higher Education, 40, (4) September 15, 1993, A22.
20.
JacobsonRobert L.1993b “Critics Say Graduate Record Exam Does Not Measure Qualities Needed for Success and Is Often Misused,” Chronicle of Higher Education, 39, 29, A27–28.
21.
KingDonald C.BescoRobert O.1960 “The Graduate Record Examination as a Selection Device for Graduate Research Fellows,” Education and Psychological Measurement, 20, (4), 853–858.
22.
LawAlexander1960 “The Prediction of Ratings of Students in a Doctoral Training Program,” Educational Psychological Measurement”20 (40), 847–851.
23.
LivingstonSamuel A.TurnerNancy J.1982Effectiveness of the Graduate Record Examinations for Predicting First-Year Grades: 1980–81 Summary Report of the Graduate Record Examinations Validity Study Service.Princeton, New Jersey: Educational Testing Service.
24.
McConnellGrant1967Private Power and American Democracy.New York: Knopf.
25.
McCornackRobert L.McLeodMary M.1988 “Gender Bias in the Prediction of College Course Performance,” Journal of Educational Measurement, 25, (4), Winter, 321–331.
26.
MadausGeorge F.WalshJohn J.1965 “Departmental Differentials in the Predictive Validity of the Graduate Record Examination Aptitude Tests,” Educational and Psychological Measurement, 25 (4), 1105–1110.
27.
MorganDavid R.MeierKenneth J.KearneyRichard C.HaysSteven WBirchHarold B.1981 “Reputation and Productivity Among U.S. Public Administration and Public Affairs Programs,” Public Administration Review, 41 (6) November/December, 666–673.
28.
NigroFelixNigraLlovd G.1984Modern Public Administration, Sixth Edition. New York: Harper & Row.
29.
OldfieldKenneth1995a “An Impolite View of the Graduate Record Examination: Some Practical Reasons Most Studies Find This Test Has Low Predictive Validity,” Journal of Thought, 30 (2) Summer, 61–73.
30.
OldfieldKenneth1995b “The Political and Economic Reasons Why the Graduate Record Examination Persists Despite Its Generally Lou-Predictive Validity,” Journal of Thought, forthcoming.
31.
OldfieldKenneth1994a “On the Importance of Informing Students About the Potential Risks Associated with Taking the Graduate Record Examination,” Journal of Thought, 29 (3) Fall, 61–70.
32.
OldfieldKenneth1994b “Toward a Theory of Devising Valid Entrance Standards for Master of Public Administration Students,” College Student Journal, 28 (2) June, 147–155.
33.
SchneiderLisa M.BrielJacqueline B.1990Validity of the GRE: 1988–89 Summary Report, Princeton, New Jersey: Educational Testing Service.
34.
SleeperMildred L.1961 “Relationship of Scores on the Graduate Record Examination to Grade Point Averages of Graduate Students in Occupational Therapy,” Educational and Psychological Measurement, 21 (4), 1039–1040.
35.
ThackerAndrew J.WilliamsRobert E.1974 “The Relationship of the Graduate Record Examination to Grade Point Average and Success in Graduate School,” Educational and Psychological Measurement, 34, Winter, 939–944.
36.
ThompsonLykeKobrakPeter1983 “Predicting the Success of Students in an MPA Program,” Teaching Political Science, 10(4) Summer, 182–188.
37.
WilsonKenneth M.1979The Validation of GRE Scores as Predictors of First-Year Performance in Graduate Study: Report of the GRE Cooperative Validity Studies Project (GRE Board Research GREB No. 75–8R).Princeton, New Jersey: Educational Testing Service.
