Efforts to support children in schools require addressing not only academic issues, but also out-of-school factors that can affect students’ ability to succeed. This study examined academic achievement of students participating in City Connects, a student support intervention operating in high-poverty elementary schools. The sample included 7,948 kindergarten to fifth-grade students in a large urban district during 1999–2009. School- and student-level treatment effects on report card grades and standardized test scores in elementary through middle school were estimated. Propensity score methods accounted for pre-intervention group differences. City Connects students demonstrated higher report card scores than comparisons and scored higher on middle school English language arts and mathematics tests. This study provides evidence for the value of addressing out-of-school factors that impact student learning.
AdelmanH.TaylorL. (2006). The implementation guide to student learning supports in the classroom and schoolwide: New directions for addressing barriers to learning. Thousand Oaks, CA: Sage Publications.
2.
AlexanderK. L.EntwisleD. R.DauberS. L. (1996). Children in motion: School transfers and elementary school performance. Journal of Educational Research, 90(1), 3–12.
3.
AudS.HussarW.JohnsonF.KenaG.RothE.ManningE.. . . YohnC. (2012). The condition of education 2012. Washington, DC: National Center for Education Statistics.
4.
AyoubC. C.FischerK. W. (2006). Developmental pathways and intersections among domains of development. In McCartneyK.PhillipsD. (Eds.), Handbook of early child development (pp. 62–82). Oxford, UK: Blackwell.
5.
BecketB. E.LutharS. S. (2002). Social-emotional factors affecting achievement outcomes among disadvantaged students. Educational Psychologist, 37(4), 197–214.
6.
BelfieldC. R.LevinH. M. (Eds.). (2007). The price we pay: Economic and social consequences of inadequate education. Washington, DC: The Brookings Institution.
7.
BerlinerD. (2013). Effects of inequality and poverty vs. teachers and schooling on America’s youth. Teacher’s College Record, 116(1).
8.
Bertelsmann Foundation. (2011). Social justice in the OECD—How do the member states compare? Sustainable governance indicators 2011. Gütersloh, Germany: Bertelsmann Stiftung.
9.
BloomB. S.MadausG. F.HastingsJ. T. (1981). Evaluation to improve learning. New York: McGraw-Hill.
BridgelandJ.BruceM. (2011). 2011 National survey of school counselors: Counseling at a crossroads. New York, NY: The College Board Advocacy and Policy Center.
12.
Brooks-GunnJ.DuncanG. J. (1997). The effects of poverty on children. The Future of Children, 7(2), 55–71.
13.
BrykA. S.SebringP. B.AllensworthE.LuppescuS.EastonJ. Q. (2010). Organizing schools for improvement: Lessons from Chicago. Chicago, IL: University of Chicago Press.
14.
Center for Optimized Student Support. (2012). The impact of City Connects: Progress report 2012. Chestnut Hill, MA: Author.
15.
City Connects. (2009). Measurement characteristics of report card scales. Chestnut Hill, MA: Author.
16.
CohenJ. (1992). A power primer. Psychological Bulletin, 112(1), 155–159.
17.
ColemanJ. S.CampbellE. Q.HobsonC. J.McPartlandJ.MoodA. M.WeinfeldF. D.YorkR. L. (1966). Equality of educational opportunity. Washington, DC: US Department of Health, Education, and Welfare, Office of Education.
18.
ColeyR. J.BakerB. (2013). Poverty and education: Finding the way forward. Princeton, NJ: The ETS Center for Research on Human Capital and Education.
19.
CookT. D.SteinerP. M. (2010). Case matching and the reduction of selection bias in quasi-experiments: The relative importance of covariate choice, unreliable measurement, and mode of data analysis. Psychological Methods, 15(1), 56–68. doi:10.1037/a0018536
20.
CordrayD. S.HullemanC. (2009). Assessing intervention fidelity in RCTs: Models, methods, and modes of analysis. Washington, DC: IES Research Conference.
21.
DearingE. (2008). The psychological costs of growing up poor. Annals of the New York Science Academy of Sciences, 1136, 324–332. doi: 10.1196/annals.1425.006
22.
DeNavas-WaltC.ProctorB. D.SmithJ. C. (2011). Income, poverty, and health insurance coverage in the United States: 2010. U.S. Census Bureau, Current Population Reports. Washington, DC: US Government Printing Office.
23.
DuckworthA. L.SeligmanM. E. P. (2005). Self-discipline outdoes IQ in predicting academic performance of adolescents. Psychological Science, 16(12), 939–944.
24.
DuncanG.MagnusonK. (2011). The long reach of early childhood poverty. Pathways. Stanford, CA: Center for the Study of Poverty and Inequality.
25.
DurlakJ. A.WeissbergR. P.DymnickiA. B.TaylorR. D.SchellingerK. B. (2011). The impact of enhancing students’ social and emotional learning: A meta-analysis of school-based universal interventions. Child Development, 82(1), 405–432.
26.
EvansG. W. (2004). The environment of childhood poverty. American Psychologist59(2), 77–92. doi:10.1037/0003-066X.59.2.77
27.
GreeneW. H. (2012). Econometric analysis. Upper Saddle River, NJ: Prentice Hall.
28.
GrumanD. H.HarachiT. W.AbbottR. D.CatalanoR. F.FlemingC. B. (2008). Longitudinal effects of student mobility on three dimensions of elementary school engagement. Child Development, 79(6), 1833–1852. doi: 10.1111/j.1467-8624.2008.01229
29.
GuoS.FraserM. W. (2010). Propensity score analysis: Statistical methods and applications. Thousand Oaks, CA: Sage.
30.
GysbersN. C.HendersonP. (2001). Comprehensive guidance and counseling programs: A rich history and a bright future. Professional School Counseling, 4, 246–256.
31.
HarderV.StuartE.AnthonyJ. (2010). Propensity score techniques and the assessment of measured covariate balance to test causal associations in psychological research. Psychological Methods, 15(3), 234–249. doi:10.1037/a0019623
32.
HarringtonM. (1962). The other America: Poverty in the United States. New York, NY: Macmillan.
33.
HeckmanJ. J. (2008). Schools, skills, and synapses. Economic Inquiry, 46(3), 289–324.
34.
HeckmanJ. J.PintoR.SavelyevP. (2012). Understanding the mechanisms through which an influential early childhood program boosted adult outcomes (NBER Working Paper No. 18581). Retrieved from http://www.nber.org/papers/w18581.pdf
35.
HeckmanJ.RubensteinY. (2001). The importance of non-cognitive skills: Lessons from the GED testing program. American Economic Review, 91(2), 145–149.
36.
HeinleinL. M.ShinnM. (2000). School mobility and student achievement in an urban setting. Psychology in the Schools, 37(4), 349–357.
37.
HillC. J.BloomH. S.BlackA. R.LipseyM. W. (2008). Empirical benchmarks for interpreting effect sizes in research. Child Development Perspectives, 2(3), 172–177.
38.
HoD.ImaiK.KingG.StuartE. A. (2007). Matching as nonparametric preprocessing for reducing model dependence in parametric causal inference. Political Analysis, 15(3), 199–236.
39.
ImbensG. W. (2000). The role of the propensity score in estimating dose-response functions. Biometrika, 87, 706–710. doi:10.1093/biomet/87.3.706
JonesS. M.BrownJ. L.AberJ. L. (2011). Two-year impacts of a universal school-based social-emotional and literacy intervention: An experiment in translational developmental research. Child Development, 82(2), 533–554. doi: 10.1111/j.1467-8624.2010.01560.x
42.
KahnC. B.MartinJ. K. (2011). The measure of poverty: A Boston Indicators Project special report. Boston, MA: The Boston Foundation.
43.
LassenS. R.SteeleM. M.SailorW. (2006). The relationship of school-wide Positive Behavior Support to academic achievement in an urban middle school. Psychology in the Schools, 43(6), 701–712. doi:10.1002/pits.20177
44.
LeanD. S.ColucciV. A. (2010). Barriers to learning: The case for integrated mental health services in schools. Lanham, MD: Rowman & Littlefield.
45.
LeventhalT.Brooks-GunnJ. (2000). The neighborhoods they live in: The effects of neighborhood residence upon child and adolescent outcomes. Psychological Bulletin, 126(2), 309–337. doi: 10.1037/0033-2909.126.2.309
46.
MarxE.WooleyS.NorthrupD. (1998). Health is academic: A guide to coordinated school health programs. New York, NY: Teachers College Press.
47.
Massachusetts Department of Elementary and Secondary Education. (2010). 2009 MCAS technical report. Malden, MA: Department of Education.
48.
MowbrayC. T.HolterM. C.TeagueG. B.BybeeD. (2003). Fidelity criteria: Development, measurement, and validation. American Journal of Evaluation, 24(3), 315–340.
49.
National Center for Education Statistics. (2011). The nation’s report card: Findings in brief. Reading and mathematics 2011. Washington, DC: Institute of Education Sciences, U.S. Department of Education.
50.
NoahT. (2012). The great divergence: America’s growing inequality crisis and what we can do about it. New York, NY: Bloomsbury Press.
51.
NogueraP. A. (2011). A broader and bolder approach uses education to break the cycle of poverty. Phi Delta Kappan, 93(3), 8–14.
52.
PotterF. J. (1993). The effect of weight trimming on nonlinear survey estimates. In Proceedings of the Section on Survey Research Methods of the American Statistical Association (pp. 758–763). Alexandria, VA: American Statistical Association.
53.
RaudenbushS. W.BrykA. S. (2002). Hierarchical linear models (2nd ed.). Thousand Oaks, CA: Sage.
54.
ReardonS. F. (2011). The widening academic achievement gap between the rich and the poor: New evidence and possible explanations. In MurnaneR.DuncanG. (Eds.), Whither opportunity? Rising inequality and the uncertain life chances of low-income children (pp. 91–116). New York, NY: Russell Sage Foundation Press.
55.
RobinsJ. M.HernanM. A.BrumbackB. (2000). Marginal structural models and causal inference in epidemiology. Epidemiology, 11, 550–560.
56.
RogersW. H. (1993). sg17: Regression standard errors in clustered samples. Stata Technical Bulletin, 13, 19–23.
57.
RosenbaumP. R.RubinD. B. (1983a). Assessing sensitivity to an unobserved binary covariate in an observational study with binary outcome. Journal of the Royal Statistical Society, 45(2), 212–218.
58.
RosenbaumP. R.RubinD. B. (1983b). The central role of the propensity score in observational studies for causal effects. Biometrika, 70(1), 41–55. doi:10.1093/biomet/70.1.41
59.
RothsteinR. (2004). Class and schools: Using social, economic, and educational reform to close the black-white achievement gap. Washington, DC: Economic Policy Institute.
60.
RothsteinR. (2010). How to fix our schools: It’s more complicated, and more work, than the Klein-Rhee “manifesto” wants you to believe (Policy Brief No. 286). Washington, DC: Economic Policy Institute.
61.
SadlerP. M.TaiR. H. (2007). Weighting for recognition: Accounting for Advanced Placement and honors courses when calculating high school grade point average. NASSP Bulletin, 9(1), 5–31.
62.
SampsonR. J.RaudenbushS. W.EarlsF. (1997). Neighborhoods and violent crime: A multilevel study of collective efficacy. Science, 277(5328), 918–924.
63.
SastryN.PebleyA. R. (2010). Family and neighborhood sources of socioeconomic inequality in children’s achievement. Demography, 47(3), 777–800.
64.
SchaferJ. L.KangJ. (2008). Average causal effects from nonrandomized studies: A practical guide and simulated example. Psychological Methods, 13(4), 279–313. doi: 10.1037/a0014268
65.
ShadishW. R.CookT. D.CampbellD. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. Boston, MA: Houghton Mifflin.
66.
ShonkoffJ. P.PhillipsD. A. (Eds.). (2000). From neurons to neighborhoods: The science of early childhood development (Report of the Committee on Integrating the Science of Early Childhood Development, Board on Children, Youth, and Families, Commission on Behavioral and Social Sciences and Education). Washington, DC: National Academy Press.
67.
SouthS. J.BaumerE. P.LutzA. (2003). Interpreting community effects on youth educational attainment. Youth & Society, 35(1), 3–36. doi: 10.1177/0044118X03254560
68.
SpybrookJ.RaudenbushS. W.LiuX.CongdonR.MartínezA. (2008). Optimal Design for longitudinal and multilevel research: Documentation for the “Optimal Design” software. New York, NY: William T. Grant Foundation.
StuartE. A. (2007). Estimating causal effects using school-level data sets. Educational Researcher, 36(4), 187–198. doi: 10.3102/0013189X07303396
71.
WalshM. E.BrabeckM. M. (2006). Resilience and risk in learning: Complex interactions and comprehensive interventions. In SternbergR. J.SubotnikR. F. (Eds.), Optimizing student success in school with the other three Rs: Reasoning, resilience, and responsibility (pp. 113–142). Greenwich, CT: Information Age Publishing.
72.
WalshM. E.GalassiJ. P.MurphyJ. A.ParkJ. (2002). A conceptual framework for counseling psychologists in schools. The Counseling Psychologist, 30, 682–704.
73.
WalshM. E.MurphyJ. (2003). Children, health, and learning. San Francisco, CA: Jossey-Bass.
74.
WeissE. (2013). Mismatches in Race to the Top limit educational improvement. Washington, DC: Broader, Bolder Approach to Education.
YoshikawaH.AberJ. L.BeardsleeW. R. (2012). The effects of poverty on the mental, emotional, and behavioral health of children and youth. American Psychologist, 67(4), 272–284.
