The article by Woo et al. (this issue) reviews the existing research on graduate-school admissions measures. The goal of this commentary is to expand on their review and suggest several ways of supplementing the Graduate Record Examination (GRE) to both increase the predictive validity of admissions decisions and improve the diversity of a graduate program. We rely on several decades of research to suggest assessing both conscientiousness and vocational interests and combining the scores from these predictors with the GRE to inform admissions decisions. In addition, we also propose several ways of expanding recruitment efforts to attract qualified underrepresented minority applicants to improve the diversity of the applicant pool.
AveryD. R. (2003). Reactions to diversity in recruitment advertising-Are differences Black and White?Journal of Applied Psychology, 88(4), 672–679. https://doi.org/10.1037/0021-9010.88.4.672
2.
AveryD. R.HernandezM.HeblM. R. (2004). Who’s watching the race? Racial salience in recruitment advertising. Journal of Applied Social Psychology, 34(1), 146–161. https://doi.org/10.1111/j.1559-1816.2004.tb02541.x
3.
CaoM.DrasgowF. (2019). Does forcing reduce faking? A meta-analytic review of forced-choice personality measures in high-stakes situations. Journal of Applied Psychology, 104(11), 1347–1368. https://doi.org/10.1037/apl0000414
4.
ChaneyK. E.SanchezD. T.RemediosJ. D. (2016). Organizational identity safety cue transfers. Personality and Social Psychology Bulletin, 42(11), 1564–1576. https://doi.org/10.1177/0146167216665096
5.
CohenJ. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Erlbaum.
6.
CullenM. J.SackettP. R.LievensF. (2006). Threats to the operational use of situational judgment tests in the college admission process. International Journal of Selection and Assessment, 14, 142–155. https://doi.org/10.1111/j.1468-2389.2006.00340.x
7.
De CorteW.LievensF.SackettP. R. (2007). Combining predictors to achieve optimal trade-offs between selection quality and adverse impact. Journal of Applied Psychology, 92(5), 1380–1393. https://doi.org/10.1037/0021-9010.92.5.1380
8.
DrasgowF.NyeC. D.GuoJ.TayL. (2009). Cheating on proctored tests: The other side of the unproctored debate. Industrial and Organizational Psychology: Perspectives on Science and Practice, 2, 46–48. https://doi.org/10.1111/j.1754-9434.2008.01106.x
9.
EmersonK. T. U.MurphyM. C. (2014). Identity threat at work: How social identity threat and situational cues contribute to racial and ethnic disparities in the workplace. Cultural Diversity and Ethnic Minority Psychology, 20(4), 508–520. https://doi.org/10.1037/a0035403
10.
FinchD. M.EdwardsB. D.WallaceJ. C. (2009). Multistage selection strategies: Simulating the effects on adverse impact and expected performance for various predictor combinations. Journal of Applied Psychology, 94(2), 318–340. https://doi.org/10.1037/a0013775
11.
GutiérrezA. S.Saint ClairJ. K. (2018). Do organizations’ diversity signals threaten members of the majority group? The case of employee professional networks. Journal of Business Research, 89, 110–120. https://doi.org/10.1016/j.jbusres.2018.04.003
12.
HoughL. M.OswaldF. L.PloyhartR. E. (2001). Determinants, detection and amelioration of adverse impact in personnel selection procedures: Issues, evidence and lessons learned. International Journal of Selection and Assessment, 9(1-2), 152–194. https://doi.org/10.1111/1468-2389.00171
13.
JonesK. S.NewmanD. A.SuR.RoundsJ. (2021). Black-White differences in vocational interests: Meta-analysis and boundary conditions. Journal of Business and Psychology, 36, 589–607. https://doi.org/10.1007/s10869-020-09693-5
14.
KeiserH. N.SackettP. R.KuncelN. R.BrothenT. (2016). Why women perform better in college than admission scores would predict: Exploring the roles of conscientiousness and course-taking patterns. Journal of Applied Psychology, 101, 569–581. https://doi.org/10.1037/apl0000069
15.
KimS. S.GelfandM. J. (2003). The influence of ethnic identity on perceptions of organizational recruitment. Journal of Vocational Behavior, 63(3), 396–416. https://doi.org/10.1016/S0001-8791(02)00043-X
16.
KroeperK. M.WilliamsH. E.MurphyM. C. (2022). Counterfeit diversity: How strategically misrepresenting gender diversity dampens organizations’ perceived sincerity and elevates women’s identity threat concerns. Journal of Personality and Social Psychology, 122(3), 399–426. https://doi.org/10.1037/pspi0000348
17.
MorgesonF. P.CampionM. A.DipboyeR. L.HollenbeckJ. R.MurphyK.SchmittN. (2007). Reconsidering the use of personality tests in personnel selection contexts. Personnel Psychology, 60(3), 683–729. https://doi.org/10.1111/j.1744-6570.2007.00089.x
18.
National Academies of Sciences, Engineering, and Medicine. (2017). Supporting students’ college success: The role of assessment of intrapersonal and interpersonal competencies. The National Academies Press.
19.
NewmanD. A.LyonJ. S. (2009). Recruitment efforts to reduce adverse impact: Targeted recruiting for personality, cognitive ability, and diversity. Journal of Applied Psychology, 94(2), 298–317. https://doi.org/10.1037/a0013472
20.
NyeC. D. (2022). Assessing interests in the twenty-first century workforce: Building on a century of interest measurement. Annual Review of Organizational Psychology and Organizational Behavior, 9, 415–440. https://doi.org/10.1146/annurev-orgpsych-012420-083120
21.
NyeC. D.ButtS. M.BradburnJ.PrasadJ. (2018). Interests as predictors of performance: An omitted and underappreciated variable. Journal of Vocational Behavior, 108, 178–189. https://doi.org/10.1016/j.jvb.2018.08.003
22.
NyeC. D.PerlusJ. G.RoundsJ. (2018). Do ornithologists flock together? Examining the homogeneity of interests in occupations. Journal of Vocational Behavior, 107, 195–208. https://doi.org/10.1016/j.jvb.2018.04.004
23.
NyeC. D.PrasadJ.RoundsJ. (2021). The effects of vocational interests on motivation, satisfaction, and academic performance: Test of a mediated model. Journal of Vocational Behavior, 127, Article 103583. https://doi.org/10.1016/j.jvb.2021.103583
24.
NyeC. D.SuR.RoundsJ.DrasgowF. (2012). Vocational interests and performance: A quantitative summary of over 60 years of research. Perspectives of Psychological Science, 7, 384–403. https://doi.org/10.1177/1745691612449021
25.
PoropatA. E. (2009). A meta-analysis of the five-factor model of personality and academic performance. Psychological Bulletin, 135(2), 322–338. https://doi.org/10.1037/a0014996
26.
Purdie-VaughnsV.SteeleC. M.DaviesP. G.DitlmannR.CrosbyJ. R. (2008). Social identity contingencies: How diversity cues signal threat or safety for African Americans in mainstream institutions. Journal of Personality and Social Psychology, 94(4), 615–630. https://doi.org/10.1037/0022-3514.94.4.615
27.
RothP. L.Van IddekingeC. H.DeOrtentiisP. S.HackneyK. J.ZhangL.BusterM. A. (2017). Hispanic and Asian performance on selection procedures: A narrative and meta-analytic review of 12 common predictors. Journal of Applied Psychology, 102(8), 1178–1202. https://doi.org/10.1037/apl0000195
28.
SackettP. R.EllingsonJ. E. (1997). The effects of forming multi-predictor composites on group differences and adverse impact. Personnel Psychology, 50(3), 707–721. https://doi.org/10.1111/j.1744-6570.1997.tb00711.x
29.
SackettP. R.LaczoR. M.LippeZ. P. (2003). Differential prediction and the use of multiple predictors: The omitted variables problem. Journal of Applied Psychology, 88(6), 1046–1056. https://doi.org/10.1037/0021-9010.88.6.1046
30.
SackettP. R.RothL. (1996). Multi-stage selection strategies: A Monte Carlo investigation of effects on performance and minority hiring. Personnel Psychology, 49(3), 549–572. https://doi.org/10.1111/j.1744-6570.1996.tb01584.x
31.
SackettP. R.ZhangC.BerryC. M.LievensF. (2021). Revisiting meta-analytic estimates of validity in personnel selection: Addressing systematic overcorrection for restriction of range. Journal of Applied Psychology. Advance online publication. https://doi.org/10.1037/apl0000994
32.
SchmidtF. L. (2002). The role of general cognitive ability and job performance: Why there cannot be a debate. Human Performance, 15(1-2), 187–210. https://doi.org/10.1207/S15327043HUP1501&02_12
33.
SchmittN.KeeneyJ.OswaldF. L.PleskacT. J.BillingtonA. Q.SinhaR.ZorzieM. (2009). Prediction of 4-year college student performance using cognitive and noncognitive predictors and the impact on demographic status of admitted students. Journal of Applied Psychology, 94, 1479–1097. https://doi.org/10.1037/a0016810
34.
SinhaR.OswaldF.ImusA.SchmittN. (2011). Criterion-focused approach to reducing adverse impact in college admissions. Applied Measurement in Education, 24, 137–161. https://doi.org/10.1080/08957347.2011.554605
35.
SongQ. C.WeeS.NewmanD. A. (2017). Diversity shrinkage: Cross-validating pareto-optimal weights to enhance diversity via hiring practices. Journal of Applied Psychology, 102(12), 1636–1657. https://doi.org/10.1037/apl0000240
36.
StarkS.ChernyshenkoO. S.DrasgowF.NyeC. D.WhiteL. A.HeffnerT.FarmerW. L. (2014). From ABLE to TAPAS: A new generation of personality tests to support military selection and classification decisions. Military Psychology, 26(3), 153–164. https://doi.org/10.1037/mil0000044
37.
SuR.RoundsJ.ArmstrongP. I. (2009). Men and things, women and people: A meta-analysis of sex differences in interests. Psychological Bulletin, 135, 859–884. https://doi.org/10.1037/a0017364
38.
TrentJ. D.BarronL. G.RoseM. R.CarrettaT. R. (2020). Tailored Adaptive Personality Assessment System (TAPAS) as an indicator for counterproductive work behavior: Comparing validity in applicant, honest, and directed faking conditions. Military Psychology, 32(1), 51–59. https://doi.org/10.1080/08995605.2019.1652481
39.
Van IddekingeC. H.PutkaD. J.CampbellJ. P. (2011). Reconsidering vocational interests for personnel selection: The validity of an interest-based selection test in relation to job knowledge, job performance, and continuance intentions. Journal of Applied Psychology, 96, 13–33. https://doi.org/10.1037/a0021193
40.
WalkerH. J.FeildH. S.GilesW. F.ArmenakisA. A.BernerthJ. B. (2009). Displaying employee testimonials on recruitment web sites: Effects of communication media, employee race, and job seeker race on organizational attraction and information credibility. Journal of Applied Psychology, 94, 1354–1364. https://doi.org/10.1037/a0014964
41.
WiltonL. S.SanchezD. T.UnzuetaM. M.KaiserC.CaluoriN. (2019). In good company: When gender diversity boosts a company’s reputation. Psychology of Women Quarterly, 43(1), 59–72. https://doi.org/10.1177/0361684318800264
42.
WooS. E.LeBretonJ.KeithM.TayL. (2022). Bias, fairness, and validity in graduate admissions: A psychometric perspective. Perspectives on Psychological Science, 18(1), 3–31. https://doi.org/10.1177/17456916211055374
43.
WoutD. A.MurphyM. C.BarnettS. (2014). When having Black friends isn’t enough: How threat cues undermine safety cues in friendship formation. Social Psychological and Personality Science, 5(7), 844–851. https://doi.org/10.1177/1948550614535820
44.
ZhangC.KuncelN. R. (2020). Moving beyond the brag sheet: A meta-analysis of biodata measures predicting student outcomes. Educational Measurement: Issues and Practice, 39, 106–121. https://doi.org/10.1111/emip.12313
45.
ZickarM. J.RobieC. (1999). Modeling faking good on personality items: An item-level analysis. Journal of Applied Psychology, 84, 551–563. https://doi.org/10.1037/0021-9010.84.4.551
