Perceptions of school quality affect many aspects of education policy and politics. Using two randomized survey experiments, we studied the factors that individuals use to evaluate school quality. Our surveys included two novel components: text analysis of open-ended responses and videos highlighting different perspectives on assessing school quality. While we found that individuals respond most strongly to test scores, we also found that a video explaining how standardized testing imperfectly reflects student learning led attentive respondents to reduce reliance on achievement status and to increase attention to growth. The results suggest that informational interventions may affect how individuals interpret school performance data. Yet, we also found evidence of political polarization and preferences for school characteristics not in standard reporting.
AbdulkadiroğluA.AgarwalN.PathakP. A. (2017). The welfare effects of coordinated assignment: Evidence from the New York City high school match. American Economic Review, 107(12), 3635–3689. https://doi.org/10.1257/aer.20151425
2.
AbdulkadiroğluA.PathakP. A.SchellenbergJ.WaltersC. R. (2020). Do parents value school effectiveness?American Economic Review, 110(5), 1502–1539. https://doi.org/10.1257/aer.20172040
3.
AngristJ.HullP.PathakP. A.WaltersC. R. (2024). Race and the mismeasure of school quality. American Economic Review: Insights, 6(1), 20–37. https://doi.org/10.1257/aeri.20220292
4.
BarrowsS.HendersonM.PetersonP. E.WestM. R. (2016). Relative performance information and perceptions of public service quality: Evidence from American school districts. Journal of Public Administration Research and Theory, 26(3), 571–583. https://doi.org/10.1093/jopart/muw028
5.
BayerP.FerreiraF.McMillanR. (2007). A unified framework for measuring preferences for schools and neighborhoods. Journal of Political Economy, 115(4), 588–638. https://doi.org/10.1086/522381
6.
BenoitK.WatanabeK.WangH.NultyP.ObengA.MüllerS.MatsuoA. (2018). Quanteda: An R package for the quantitative analysis of textual data. Journal of Open Source Software, 3(30), 774. https://doi.org/10.21105/joss.00774
7.
BerinskyA. J.MargolisM. F.SancesM. W.WarshawC. (2021). Using screeners to measure respondent attention on self-administered surveys: Which items and how many?Political Science Research and Methods, 9(2), 430–437. https://doi.org/10.1017/psrm.2019.53
8.
BertrandA. R.LyonM. A.JacobsenR. (2023). Narrative spillover: A narrative policy framework analysis of critical race theory discourse at multiple levels. Policy Studies Journal, 52(2), 391–423. https://doi.org/10.1111/psj.12523
9.
BillinghamC. M.HuntM. O. (2016). School racial composition and parental choice: New evidence on the preferences of white parents in the United States. Sociology of Education, 89(2), 99–117. https://doi.org/10.1177/0038040716635718
10.
BlackS. E. (1999). Do better schools matter? Parental valuation of elementary education. Quarterly Journal of Economics, 114(2), 577–599. https://doi.org/10.1162/003355399556070
CharbonneauÉ.Van RyzinG. G. (2015). Benchmarks and citizen judgments of local government performance: Findings from a survey experiment. Public Management Review, 17(2), 288–304. https://doi.org/10.1080/14719037.2013.798027
13.
ChingosM. M.HendersonM.WestM. R. (2012). Citizen perceptions of government service quality: Evidence from public schools. Quarterly Journal of Political Science, 7(4), 411–445. https://doi.org/10.1561/100.00011071
14.
ChoiI.Gil-GarciaJ. R. (2022). Do different presentations of performance information on government websites affect citizens’ decision making? A survey experiment. International Public Management Journal, 25(1), 140–158. https://doi.org/10.1080/10967494.2021.1913459
15.
CohodesS.CorcoranS.JenningsJ.Sattin-BajajC. (2022). When do informational interventions work? Experimental evidence from New York City high school choice (NBER Working Paper No. 29690). National Bureau of Economic Research. https://doi.org/10.3386/w29690
16.
CoppockA.McClellanO. A. (2019). Validating the demographic, political, psychological, and experimental results obtained from a new source of online survey respondents. Research & Politics, 6(1), 1–14. https://doi.org/10.1177/2053168018822174
17.
CoppockA.EkinsE.KirbyD. (2018). The long-lasting effects of newspaper op-eds on public opinion. Quarterly Journal of Political Science, 13(1), 59–87. https://doi.org/10.1561/100.00016112
DafoeA.ZhangB.CaugheyD. (2018). Information equivalence in survey experiments. Political Analysis, 26(4), 399–416. https://doi.org/10.1017/pan.2018.9
20.
de la CuestaB.EgamiN.ImaiK. (2022). Improving the external validity of conjoint analysis: The essential role of profile distribution. Political Analysis, 30(1), 19–45. https://doi.org/10.1017/pan.2020.40
21.
FerrarioB.StantchevaS. (2022). Eliciting people's first-order concerns: Text analysis of open-ended survey questions. AEA Papers and Proceedings, 112(2), 163–169. https://doi.org/10.1257/pandp.20221071
22.
FiglioD. A.StoneJ. N. (2001). Can public policy affect private school cream skimming?Journal of Urban Economics, 49(2), 240–266. https://doi.org/10.1006/juec.2000.2189
GlazermanS.DotterD. (2017). Market signals: Evidence on the determinants and consequences of school choice from a citywide lottery. Educational Evaluation and Policy Analysis, 39(4), 593–619. https://doi.org/10.3102/0162373717702964
25.
GlazermanS.Nichols-BarrerI.ValantJ.ChandlerJ.BurnettA. (2020). The choice architecture of school choice websites. Journal of Research on Educational Effectiveness, 13(2), 322–350. https://doi.org/10.1080/19345747.2020.1716905
GrünB.HornikK. (2011). Topicmodels: An R package for fitting topic models. Journal of Statistical Software, 40(13), 1–30. https://doi.org/10.18637/jss.v040.i13
28.
HaderleinS. A. K. (2022). How do parents evaluate and select schools? Evidence from a survey experiment. American Educational Research Journal, 59(2), 381–414. https://doi.org/10.3102/00028312211046360
29.
HaileyC. A. (2022). Racial preferences for schools: Evidence from an experiment with White, Black, Latinx, and Asian parents and students. Sociology of Education, 95(2), 110–132. https://doi.org/10.1177/00380407211065179
30.
HainmuellerJ.HangartnerD.YamamotoT. (2015). Validating vignette and conjoint survey experiments against real-world behavior. Proceedings of the National Academy of Sciences USA, 112(8), 2395–2400. https://doi.org/10.1073/pnas.1416587112
31.
HainmuellerJ.HopkinsD. J.YamamotoT. (2014). Causal inference in conjoint analysis: Understanding multidimensional choices via stated preference experiments. Political Analysis, 22(1), 1–30. https://doi.org/10.1093/pan/mpt024
32.
HankinsonM. (2018). When do renters behave like homeowners? High rent, price anxiety, and NIMBYism. American Political Science Review, 112(3), 473–493. https://doi.org/10.1017/s0003055418000035
33.
HastingsJ. S.WeinsteinJ. W. (2008). Information, school choice, and academic achievement: Evidence from two experiments. Quarterly Journal of Economics, 123(4), 1373–1414. https://doi.org/10.1162/qjec.2008.123.4.1373
34.
HenigJ. RJacobsenR.ReckhowS. (2019). Outside money in school board elections: The nationalization of education politics. Harvard Education Press.
35.
HolbeinJ. (2016). Left behind? Citizen responsiveness to government performance information. American Political Science Review, 110(2), 353–368. https://doi.org/10.1017/s0003055416000071
36.
HopkinsD. J. (2018). The increasingly United States: How and why American political behavior nationalized. University of Chicago Press.
37.
HoriuchiY.MarkovichZ.YamamotoT. (2022). Does conjoint analysis mitigate social desirability bias?Political Analysis, 30(4), 535–549. https://doi.org/10.1017/pan.2021.30
38.
HoustonD. M. (2024). Polarization, partisan sorting, and the politics of education. American Educational Research Journal, 61(3), 508–540. https://doi.org/10.3102/00028312241228280
39.
HoustonD. M.HenigJ. R. (2023). The “good” schools: Academic performance data, school choice, and segregation. AERA Open, 9(1), 1–18. https://doi.org/10.1177/23328584231177666
40.
HoustonD. M.HenigJ. R. (2021). The effects of student growth data on school district choice: Evidence from a survey experiment. American Journal of Education, 127(4), 563–595. https://doi.org/10.1086/715003
41.
HoustonD. M.HendersonM.PetersonP. E.WestM. R. (2022). Status, growth, and perceptions of school quality. Educational Evaluation and Policy Analysis, 44(1), 105–126. https://doi.org/10.3102/01623737211030505
42.
HoxbyC. (2006). The power of peers. Education Next. https://www.educationnext .org/the-power-of-peers/
43.
JacobsenR.SnyderJ. W.SaultzA. (2014). Informing or shaping public opinion? The influence of school accountability data format on public perceptions of school quality. American Journal of Education, 121(1), 1–27. https://doi.org/10.1086/678136
KellyS.MozenterZ.AucejoE.FruehwirthJ. C. (2020). School-to-school differences in instructional practice: New descriptive evidence on opportunity to learn. Teachers College Record, 122(11), 1–38. https://doi.org/10.1177/016146812012201102
KoganV.LavertuS.PeskowitzZ. (2016). Performance federalism and local democracy: Theory and evidence from school tax referenda. American Journal of Political Science, 60(2), 416–435. https://doi.org/10.1111/ajps.12184
48.
KuziemkoI.NortonM. I.SaezE.StantchevaS. (2015). How elastic are preferences for redistribution? Evidence from randomized survey experiments. American Economic Review, 105(4), 1478–1508. https://doi.org/10.1257/aer.20130360
49.
LandgraveM.WellerN. (2022). Do name-based treatments violate information equivalence? Evidence from a correspondence audit experiment. Political Analysis, 30(1), 142–148. https://doi.org/10.1017/pan.2020.52
50.
MizrahiS.MinchukY. (2020). The relevance and reliability of performance information for accountability: A survey experiment exploring citizens’ views. Public Administration, 98(1), 140–158. https://doi.org/10.1111/padm.12623
51.
OlsenA. L. (2017). Compared to what? How social and historical reference points affect citizens’ performance evaluations. Journal of Public Administration Research and Theory, 27(4), 562–580. https://doi.org/10.1093/jopart/mux023
52.
PeerE.RothschildD.GordonA.EverndenZ.DamerE. (2021). Data quality of platforms and panels for online behavioral research. Behavior Research Methods, 54(4), 1643–1662. https://doi.org/10.3758/s13428-021-01694-3
ReadB.WoltersL.BerinskyA. J. (2021). Racing the clock: Using response time as a proxy for attentiveness on self-administered surveys. Political Analysis, 30, 550–569. https://doi.org/10.1017/pan.2021.32
55.
ReardonS. F. (2016). School district socioeconomic status, race, and academic achievement. Stanford Center for Educational Policy Analysis.
56.
ReckhowS.HenigJ. R.JacobsenR.LittJ. A. (2017). “Outsiders with deep pockets”: The nationalization of local school board elections. Urban Affairs Review, 53(5), 783–811. https://doi.org/10.1177/1078087416663004
57.
SacerdoteB. (2011). Peer effects in education: How might they work, how big are they and how much do we know thus far? In HanushekE. A.MachinS.WoessmannL. (Eds.), Handbook of the economics of education (Vol. 3, pp. 249–277). Elsevier.
58.
ShapiroR. Y.KilibardaA.SinozichS.McClellanO. (2021). American public opinion and partisan conflict: Education's exceptionalism? In WestM. R.WoessmannL. (Eds.), Public opinion and the political economy of education policy around the world (pp. 141–174). MIT Press.
TeeleD. L.KallaJ.RosenbluthF. (2018). The ties that double bind: Social roles and women's underrepresentation in politics. American Political Science Review, 112(3), 525–541. https://doi.org/10.1017/s0003055418000217
62.
TernovskiJ.OrrL. (2022). A note on increases in inattentive online survey-takers since 2020. Journal of Quantitative Description: Digital Media, 2, 1–35. https://doi.org/10.51685/jqd.2022.002
63.
ValantJ.NewarkD. A. (2020). The word on the street or the number from the state? Government-provided information and Americans’ opinions of schools. Journal of Public Administration Research and Theory, 30(4), 674–692. https://doi.org/10.1093/jopart/muaa010
64.
ValantJ.WeixlerL. H. (2022). Informing school-choosing families about their options: A field experiment from New Orleans. Educational Evaluation and Policy Analysis, 44(4), 608–637. https://doi.org/10.3102/01623737221086305
65.
YunJ. T.MorenoJ. F. (2006). College access, K–12 concentrated disadvantage, and the next 25 years of education research. Educational Researcher, 35(1), 12–19. https://doi.org/10.3102/0013189x035001012
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
