This study examines a diverse set of nearly 100 private institutions that adopted test-optional undergraduate admissions policies between 2005–2006 and 2015–2016. Using comparative interrupted time series analysis and difference-in-differences with matching, I find that test-optional policies were associated with a 3% to 4% increase in Pell Grant recipients, a 10% to 12% increase in first-time students from underrepresented racial/ethnic backgrounds, and a 6% to 8% increase in first-time enrollment of women. Overall, I do not detect clear evidence of changes in application volume or yield rate. Subgroup analyses suggest that these patterns were generally similar for both the more selective and the less selective institutions examined. These findings provide evidence regarding the potential—and the limitations—of using test-optional policies to improve equity in admissions.
AllensworthE. M.ClarkK. (2020). High school GPAs and ACT scores as predictors of college completion: Examining assumptions about consistency across high schools. Educational Researcher, 49(3), 198–211. https://doi.org/10.3102/0013189X20902110
2.
AlonS.TiendaM. (2007). Diversity, opportunity, and the shifting meritocracy in higher education. American Sociological Review, 72(4), 487–511. https://doi.org/10.1177/000312240707200401
3.
AndersonN. (2018, June14). A shake-up in elite admissions: U-Chicago drops SAT/ACT testing requirement. Washington Post.
4.
AndersonN. (2020, October4). Beyond “test-optional”: Some “test-free” colleges drop the SAT and ACT entirely. Washington Post.
5.
AngristJ. D.PischkeJ. S. (2008). Mostly harmless econometrics: An empiricist's companion. Princeton University Press.
6.
Barron’s Educational Series, Inc. (2002). Barron’s profiles of American colleges, 2003.
7.
BastedoM. N.BowmanN. A. (2017). Improving admission of low-SES students at selective colleges: Results from an experimental simulation. Educational Researcher, 46(2),67–77. https://doi.org/10.3102/0013189X17699373
8.
BelascoA. S.RosingerK. O.HearnJ. C. (2015). The test-optional movement at America's selective liberal arts colleges: A boon for equity or something else?Educational Evaluation and Policy Analysis, 37(2), 206–223. https://doi.org/10.3102/0162373714537350
9.
BennettC. T.EvansB. J.MarsicanoC. R. (2020). Taken for granted? Effects of loan-reduction initiatives on student borrowing, admission metrics, and campus diversity. Research in Higher Education. https://doi.org/10.1007/s11162-020-09615-7
10.
BlackS. E.CortesK. E.LincoveJ. A. (2015). Academic undermatching of high-achieving minority students: Evidence from race-neutral and holistic admissions policies. American Economic Review, 105(5), 604–610. https://doi.org/10.1257/aer.p20151114
11.
BlackS. E.CortesK. E.LincoveJ. A. (2020). Apply yourself: Racial and ethnic differences in college application. Education Finance and Policy, 15(2), 209–240. https://doi.org/10.1162/edfp_a_00273
12.
BloomH. S.RiccioJ. A. (2005). Using place-based random assignment and comparative interrupted time-series analysis to evaluate the jobs-plus employment program for public housing residents. ANNALS of the American Academy of Political and Social Science, 599(1), 19–51. https://doi.org/10.1177/0002716205274824
13.
BourdieuP. (1977). Outline of a theory of practice. Cambridge University Press.
14.
BowenW. G.BokD. (1998). The shape of the river. Long-term consequences of considering race in college and university admissions. Princeton University Press.
15.
BowenW. G.ChingosM. M.McPhersonM. S. (2009). Crossing the finish line: Completing college at America's public universities. Princeton University Press.
16.
BowenW. G.ChingosM. M.McPhersonM. S. (2018). Test scores and high school grades as predictors. In BuckleyJ.LetukasL.WildavskyB. (Eds.), Measuring success: Testing, grades, and the future of college admissions (pp. 193–226). Johns Hopkins University Press.
17.
BraxtonJ. M. (1993). Selectivity and rigor in research universities. Journal of Higher Education, 64(6), 657–675. https://doi.org/10.2307/2960017
18.
BrookhartM. A.SchneeweissS.RothmanK. J.GlynnR. J.AvornJ.StürmerT. (2006). Variable selection for propensity score models. American Journal of Epidemiology, 163(12), 1149–1156. https://doi.org/10.1093/aje/kwj149
19.
BuchmannC.CondronD. J.RoscignoV. J. (2010). Shadow education, American style: Test preparation, the SAT and college enrollment. Social Forces, 89(2), 435–461. https://doi.org/10.1353/sof.2010.0105
20.
BulmanG. (2015). The effect of access to college assessments on enrollment and attainment. American Economic Journal, 7(4), 1–36. https://doi.org/10.1257/app.20140062
21.
CarmichaelL.MeadL. C. (Eds.). (1951). The selection of military manpower: A symposium (Vol. 209). National Academies Press.
DeeT. S.JacobB. (2011). The impact of No Child Left Behind on student achievement. Journal of Policy Analysis and Management, 30(3), 418–446. https://doi.org/10.1002/pam.20586
26.
DerousieJ. C. (2014). An exploration of the diffusion and adoption of four innovations in higher education [Doctoral dissertation]. Pennsylvania State University. https://etda.libraries.psu.edu/catalog/23568
27.
DillonE. W.SmithJ. A. (2017). Determinants of the match between student ability and college quality. Journal of Labor Economics, 35(1), 45–66. https://doi.org/10.1086/687523
28.
Dixon-RománE. J.EversonH. T.McArdleJ. J. (2013). Race, poverty and SAT scores: Modeling the influences of family income on Black and White high school students’ SAT performance. Teachers College Record, 115(4), 1–33.
29.
DuncanG. J.MagnusonK. A. (2005). Can family socioeconomic resources account for racial and ethnic test score gaps?The Future of Children, 15(1), 35–54. https://doi.org/10.1353/foc.2005.0004
30.
EngleJ.TintoV. (2008). Moving beyond access: College success for low-income, first-generation students. Pell Institute for the Study of Opportunity in Higher Education.
FurutaJ. (2017). Rationalization and student/school personhood in U.S. college admissions: The rise of test-optional policies, 1987 to 2015. Sociology of Education, 90(3), 236–254. https://doi.org/10.1177/0038040717713583
GoodmanS. (2016). Learning from the test: Raising selective college enrollment by providing information. Review of Economics and Statistics, 98(4), 671–684. https://doi.org/10.1162/REST_a_00600
Goodman-BaconA.GoldringT.NicholsA. (2019). BACONDECOMP: Stata module for decomposing difference-in-differences estimation with variation in treatment timing. Statistical Software Components.
37.
HallbergK.WilliamsR.SwanlundA.EnoJ. (2018). Short comparative interrupted time series using aggregate school-level data in education research. Educational Researcher, 47(5), 295–306.
HerzogS. (2014). The propensity score analytical framework: An overview and institutional research example. New Directions for Institutional Research, 2014(161), 21–40. https://doi.org/10.1002/ir.20065
41.
HillmanN. W. (2013). Economic diversity in elite higher education: Do no-loan programs impact Pell enrollments?Journal of Higher Education, 84(6), 806–833. https://doi.org/10.1353/jhe.2013.0038
42.
HissW. C.FranksV. W. (2014). Defining promise: Optional standardized testing policies in American college and university admissions. National Association for College Admission Counseling.
43.
HoxbyC. M.AveryC. (2012). The missing “one-offs”: The hidden supply of high-achieving, low income students (NBER Working Paper No. 18586). National Bureau of Economic Research.
44.
HoxbyC. M.TurnerS. (2015). What high-achieving low-income students know about college. American Economic Review, 105(5), 514–517. https://doi.org/10.1257/aer.p20151027
45.
HoxbyC. M.TurnerS. (2019). Measuring opportunity in US higher education (NBER Working Paper No. 25479). National Bureau of Economic Research.
HymanJ. (2017). ACT for all: The effect of mandatory college entrance exams on postsecondary attainment and choice. Education Finance and Policy, 12(3), 281–311. https://doi.org/10.1162/EDFP_a_00206
48.
IacusS. M.KingG.PorroG. (2011). Multivariate matching methods that are monotonic imbalance bounding. Journal of the American Statistical Association, 106(493), 345–361. https://doi.org/10.1198/jasa.2011.tm09599
49.
KarabelJ. (2006). The chosen: The hidden history of admission and exclusion at Harvard, Yale, and Princeton. Houghton Mifflin Harcourt.
50.
KlasikD. (2012). The college application gauntlet: A systematic analysis of the steps to four-year college enrollment. Research in Higher Education, 53(5), 506–549. https://doi.org/10.1007/s11162-011-9242-3
51.
LemannN. (1999). The big test: The secret history of the American meritocracy. Farrar, Straus & Giroux.
52.
LeonardD. K.JiangJ. (1999). Gender bias and the college predictions of the SATs: A cry of despair. Research in Higher Education, 40(4), 375–407. https://doi.org/10.1023/A:1018759308259
53.
LeuvenE.SianesiB. (2003). PSMATCH2: Stata module to perform full Mahalanobis and propensity score matching, common support graphing, and covariate imbalance testing. http://ideas.repec.org/c/boc/bocode/s432001.html
54.
LightA.StrayerW. (2000). Determinants of college completion: School quality or student ability?Journal of Human Resources, 35(2), 299–332. https://doi.org/10.2307/146327
55.
MahalanobisP. C. (1936). On the generalised distance in statistics. Proceedings of the National Institute of Sciences of India, 2(1), 49–55.
56.
ManskiC. F.WiseD. A. (1983). College choice in America. Harvard University Press.
57.
MarkowitzA. J. (2018). Changes in school engagement as a function of No Child Left Behind: A comparative interrupted time series analysis. American Educational Research Journal, 55(4), 721–760. https://doi.org/10.3102/0002831218755668
58.
MatternK. D.PattersonB. F.ShawE. J.KobrinJ. L.BarbutiS. M. (2008). Differential validity and prediction of the SAT® (Research Report No. 2008-4). College Board.
59.
McDonoughP. M.KornJ. S.YamasakiE. (1997). Access, equity, and the privatization of college counseling. Review of Higher Education, 20(3), 297–317. https://doi.org/10.1353/rhe.1997.0004
60.
MedinaJ.BennerK.TaylorK. (2019, March12). Actresses, business leaders and other wealthy parents charged in U.S. college entry fraud. New York Times.
61.
MelguizoT. (2010). Are students of color more likely to graduate from college if they attend more selective institutions? Evidence from a cohort of recipients and nonrecipients of the Gates Millennium Scholarship Program. Educational Evaluation and Policy Analysis, 32(2), 230–248. https://doi.org/10.3102/0162373710367681
NiederleM.VesterlundL. (2010). Explaining the gender gap in math test scores: The role of competition. Journal of Economic Perspectives, 24(2), 129–44. https://doi.org/10.1257/jep.24.2.129
64.
PallaisA. (2015). Small differences that matter: Mistakes in applying to college. Journal of Labor Economics, 33(2), 493–520. https://doi.org/10.1086/678520
65.
PernaL. W. (2006). Studying college choice: A proposed conceptual model. In SmartJ. C. (Ed.), Higher education: Handbook of theory and research (Vol. 21, pp. 99–157). Springer.
66.
PlankS. B.JordanW. J. (2001). Effects of information, guidance, and actions on postsecondary destinations: A study of talent loss. American Educational Research Journal, 38(4), 947–979. https://doi.org/10.3102/00028312038004947
67.
ReardonS. F.KalogridesD.ShoresK. (2019). The geography of racial/ethnic test score gaps. American Journal of Sociology, 124(4), 1164–1221. https://doi.org/10.1086/700678
68.
RobinsonK. J.RoksaJ. (2016). Counselors, information, and high school college-going culture: Inequalities in the college application process. Research in Higher Education, 57(7), 845–868. https://doi.org/10.1007/s11162-016-9406-2
69.
RobinsonM.MonksJ. (2005). Making SAT scores optional in selective college admissions: A case study. Economics of Education Review, 24(4), 393–405. https://doi.org/10.1016/j.econedurev.2004.06.006
70.
RosenbaumP. R.RubinD. B. (1985). Constructing a control group using multivariate matched sampling methods that incorporate the propensity score. The American Statistician, 39(1), 33–38. https://doi.org/10.1080/00031305.1985.10479383
71.
RosingerK.FordK. S. (2019). Pell Grant versus income data in postsecondary research. Educational Researcher, 48(5), 309–315. https://doi.org/10.3102/0013189X19852102
72.
RosingerK. O.BelascoA. S.HearnJ. C. (2018). A boost for the middle class: An evaluation of no-loan policies and elite private college enrollment. Journal of Higher Education, 90(1), 27–55. https://doi.org/10.1080/00221546.2018.1484222
73.
RosingerK. O.Sarita FordK.ChoiJ. (2021). The role of selective college admissions criteria in interrupting or reproducing racial and economic inequities. The Journal of Higher Education, 92(1), 31–55. https://doi.org/10.1080/00221546.2020.1795504
74.
RosnerJ. (2012). The SAT: Quantifying the unfairness behind the bubbles. In SoaresJ. (Ed.), SAT wars: The case for test-optional college admissions (pp. 104–117). Teachers College Press.
75.
RubinD. B.ThomasN. (1996). Matching using estimated propensity scores: Relating theory to practice. Biometrics, 52(1), 249–264. https://doi.org/10.2307/2533160
76.
SaboeM.TerrizziS. (2019). SAT optional policies: Do they influence graduate quality, selectivity or diversity?Economics Letters, 174, 13–17. https://doi.org/10.1016/j.econlet.2018.10.017
SweitzerK.BlalockA. E.SharmaD. B. (2018). The effect of going test-optional on diversity and admissions. In BuckleyJ.LetukasL.WildavskyB. (Eds.), Measuring success: Testing, grades, and the future of college admissions (pp. 288–307). Johns Hopkins University Press.
79.
SyversonS. (2007). The role of standardized tests in college admissions: Test-optional admissions. New Directions for Student Services, 2007(118), 55–70. https://doi.org/10.1002/ss.241
TebbsJ.TurnerS. (2005). College education for low-income students: A caution about using data on Pell Grant recipients. Change: Magazine of Higher Learning, 37(4), 34–43. https://doi.org/10.3200/CHNG.37.4.34-43
WaltonG. M.SpencerS. J. (2009). Latent ability: Grades and test scores systematically underestimate the intellectual ability of negatively stereotyped students. Psychological Science, 20(9), 1132–1139. https://doi.org/10.1111/j.1467-9280.2009.02417.x
84.
WarikooN. K. (2016). The diversity bargain: And other dilemmas of race, admissions, and meritocracy at elite universities. University of Chicago Press.
85.
WechslerH. S. (1977). The qualified student: A history of selective college admission in America. Wiley.
86.
WestrickP. A.LeH.RobbinsS. B.RadunzelJ. M.SchmidtF. L. (2015). College performance and retention: A meta-analysis of the predictive validities of ACT® scores, high school grades, and SES. Educational Assessment, 20(1), 23–45. https://doi.org/10.1080/10627197.2015.997614
87.
Worcester Polytechnic Institute. (2007, May8). Worcester Polytechnic Institute is first nationally-ranked science and engineering university to make SAT optional for admissions. https://www.wpi.edu/news/satoptional
ZwickR. (Ed.). (2004). Rethinking the SAT: The future of standardized testing in university admissions. Routledge.
90.
ZwickR. (2019). Assessment in American higher education: The role of admissions tests. ANNALS of the American Academy of Political and Social Science, 683(1), 130–148. https://doi.org/10.1177/0002716219843469
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
