This paper provides the first population-based evidence on how much standardized test scores vary among public school districts within each state and how segregation explains that variation. Using estimates based on roughly 300 million test score records in math and English Language Arts (ELA) for Grades 3 through 8 from every U.S. public school district during the 2008–09 to 2014–15 school years, we estimate intraclass correlations (ICCs) as a measure of between-district variation. We characterize the variation in the ICCs across states as well as the patterns in the ICCs over subjects, grades, and cohorts. Further, we investigate the relationship between the ICCs and measures of racial and socioeconomic segregation. We find that between-district variation is greatest, on average, in states with high levels of both White-Black and economic segregation.
BischoffK. (2008). School district fragmentation and racial residential segregation: How do boundaries matter?Urban Affairs Review, 44(2), 182–217. https://doi.org/10.1177/1078087408320651
2.
BloomH. S.Richburg-HayesL.BlackA. R. (2007). Using covariates to improve precision for studies that randomize schools to evaluate educational interventions. Educational Evaluation and Policy Analysis, 29(1), 30–59. https://doi.org/10.3102/0162373707299550
3.
CardD.KruegerA. B. (1992). Does school quality matter? Returns to education and the characteristics of public schools in the United States. Journal of Political Economy, 100(1), 1–40. Retrieved from http://www.jstor.org/stable/2138804
4.
ChettyR.FriedmanJ. N.HilgerN.SaezE.SchanzenbachD. W.YaganD. (2011). How does your kindergarten classroom affect your earnings? Evidence from project star. Quarterly Journal of Economics, 126(4), 1593–1660. https://doi.org/10.1093/qje/qjr041
5.
DeckerP.MayerD.GlasermanS. (2004). The effects of Teach for America on students: Findings from a national evaluation. Princeton, NJ: Mathematica Policy Research.
6.
DemingD. J.HastingsJ. S.KaneT. J.StaigerD. O. (2014). School choice, school quality, and postsecondary attainment. American Economic Review, 104(3), 991–1013. https://doi.org/10.1257/aer.104.3.991
7.
DobbieW.FryerR. G. (2011). Are high-quality schools enough to increase achievement among the poor? Evidence from the Harlem Children’s Zone. American Economic Journal: Applied Economics, 3(3), 158–187. https://doi.org/10.1257/app.3.3.158
8.
HedgesL. V.HedbergE. C. (2007). Intraclass correlation values for planning group-randomized trials in education. Educational Evaluation and Policy Analysis, 29(1), 60–87. https://doi.org/10.3102/0162373707299706
9.
HedgesL. V.HedbergE. C. (2014). Intraclass correlations and covariate outcome correlations for planning two- and three-level cluster-randomized experiments in education. Evaluation Review, 37(6), 445–489. https://doi.org/10.1177/0193841X14529126
10.
HerfindahlO. C. (1950). Concentration in the U.S. steel industry. New York, NY: Columbia University Press.
11.
HirschmanA. O. (1964). The paternity of an index. American Economic Review, 54(5), 761.
12.
HirschmanA. O.AlbertO. H. (1945). National power and the structure of foreign trade. National power and the structura of foreign trade. Los Angeles, CA: University of California Press.
13.
JacobB. A. (2005). Accountability, incentives and behavior: The impact of high-stakes testing in the Chicago Public Schools. Journal of Public Economics, 89(5–6), 761–796. https://doi.org/10.1016/j.jpubeco.2004.08.004
14.
JacobR.ZhuP.BloomH. (2010). New empirical evidence for the design of group randomized trials in education. Journal of Research on Educational Effectiveness, 3(2), 157–198. https://doi.org/10.1080/19345741003592428
15.
KonstantopoulosS. (2009). Incorporating cost in power analysis for three-level cluster-randomized designs. Evaluation Review, 33(4), 335–357. https://doi.org/10.1177/0193841X09337991
16.
KonstantopoulosS. (2011). A more powerful test in three-level cluster randomized designs. Journal of Research on Educational Effectiveness, 4(4), 354–369. https://doi.org/10.1080/19345747.2010.519824
17.
KonstantopoulosS. (2012). The impact of covariates on statistical power in cluster randomized designs: Which level matters more?Multivariate Behavioral Research, 47(3), 392–420. https://doi.org/10.1080/00273171.2012.673898
18.
LankfordH.LoebS.WykoffJ. (2002). Teacher sorting and the plight of urban schools: A descriptive analysis. Educational Evaluation and Policy Analysis, 24(1), 37–62. https://doi.org/10.3102/01623737024001037
19.
MagnusonK. A.MeyersM. K.RuhmC. J.WaldfogelJ. (2004). Inequality in preschool education and school readiness. American Educational Research Journal Spring, 41(1), 115–157. https://doi.org/https://doi.org/10.3102/00028312041001115
20.
MasseyD. S.DentonN. A. (1988). The dimensions of residential segregation. Social Forces, 67(2), 281–315. Retrieved from http://www.jstor.org/stable/2579183
21.
OwensA. (2016). Inequality in children’s contexts: The economic segregation of households with and without children. American Sociological Review, 81(3), 1–26. https://doi.org/10.1177/0003122416642430
22.
RaudenbushS. W.MartinezA.SpybrookJ. (2007). Strategies for improving precision in group-randomized experiments. Educational Evaluation and Policy Analysis, 29(1), 5–29. https://doi.org/10.3102/0162373707299460
23.
ReardonS. F. (2011). The widening academic achievement gap between the rich and the poor: New evidence and possible explanations. In DuncanG. J.MurnaneR. J. (Eds.), Whither opportunity? Rising inequality, schools, and children’s life chances (pp. 91–115). New York, NY: Russell Sage Foundation.
24.
ReardonS. F.HoA. D. (2015). Practical issues in estimating achievement gaps from coarsened data. Journal of Educational and Behavioral Statistics, 40. https://doi.org/10.3102/1076998615570944
25.
ReardonS. F.ShearB. R.CastellanoK. E.HoA. D. (2016). Using heteroskedastic ordered probit models to recover moments of continuous test score distributions from coarsened data. Journal of Educational and Behavioral Statistics, 42(16–2), 3–45. https://doi.org/10.3102/1076998616666279
26.
SampsonR. J.SharkeyP.RaudenbushS. W. (2008). Durable effects of concentrated disadvantage on verbal ability among African-American children. Proceedings of the National Academy of Sciences, 105(3), 845–852. https://doi.org/10.1073/pnas.0710189104
27.
SchochetP. Z. (2008). Statistical power for random assignment evaluations of education programs. Journal of Educational and Behavioral Statistics, 33(1), 62–87. https://doi.org/10.3102/1076998607302714
28.
ShearB. R.ReardonS. F. (2016). HETOP: Stata module for estimating heteroskedastic ordered probit models with ordered frequency data. Retrieved from https://ideas.repec.org/c/boc/bocode/s458287.html
29.
SirinS. R. (2005). Socioeconomic status and academic achievement: A meta-analytic review of research. Review of Educational Research, 75(3), 417–453. https://doi.org/10.3102/00346543075003417
30.
StataCorp. (2013). Stata Statistical Software: Release 13. College Station, TX: StataCorp LP.
31.
TheilH.FinezzaA. J. (1971). A note on the measurement of racial integation of schools by means of informational concepts. Journal of Mathematical Sociology, 1, 187–194.
32.
ValentinoR. (2017). Will public pre-K really close achievement gaps? Gaps in prekindergarten quality between students and across states. American Educational Research Journal.
33.
WestineC. D.SpybrookJ.TaylorJ. A. (2013). An empirical investigation of variance design parameters for planning cluster-randomized trials of science achievement. Evaluation Review, 37(6), 490–519. https://doi.org/10.1177/0193841X14531584
34.
WodtkeG. T.ElwertF.HardingD. J. (2016). Neighborhood effect heterogeneity by family income and developmental period. American Journal of Sociology, 121(4), 1168–1222. https://doi.org/10.1086/684137
35.
ZhuP.JacobR.BloomH.XuZ. (2012). Designing and analyzing studies that randomize schools to estimate intervention effects on student academic outcomes without classroom-level information. Educational Evaluation and Policy Analysis, 34(1), 45–68. https://doi.org/10.3102/0162373711423786
