School Differences in Social–Emotional Learning Gains: Findings From the First Large-Scale Panel Survey of Students

Abstract

Measures of school-level growth in student outcomes are common tools for assessing the impacts of schools. The vast majority of these measures use standardized tests as the outcome of interest, even though emerging evidence demonstrates the importance of social–emotional learning (SEL). In this article, we present results from using the first large-scale panel surveys of students on SEL to produce school-level value-added measures by grade for growth mind-set, self-efficacy, self-management, and social awareness. We found substantive differences across schools in SEL growth, with magnitudes of differences similar to those for growth in academic achievement. In contrast, we found that the goodness of fit of the value-added model was considerably lower when the outcome variables were measures of SEL constructs rather than of academic achievement. In addition, the across-school variance in the average level of the SEL measures was proportionally much smaller than that for academic measures. These findings recommend caution in interpreting measures as the causal impacts of schools on SEL, though they also do not rule out important school effects.

Keywords

school growth value-added models social–emotional learning

Get full access to this article

View all access options for this article.

References

Allensworth

E. M.

Easton

J. Q.

(2007). What matters for staying on-track and graduating in Chicago public high schools: A close look at course grades, failures, and attendance in the freshman year. Chicago, IL: Consortium on Chicago School Research.

Angrist

Hull

Pathak

Walters

(2016). Interpreting tests of school VAM validity. American Economic Review: Papers and Proceedings, 106, 388–392.

Angrist

Hull

Pathak

Walters

(2017). Leveraging lotteries for school value-added: Testing and estimation. Quarterly Journal of Economics, 132, 871–919.

Bandura

(1997). Self-efficacy: The exercise of control. New York, NY: W. H. Freeman.

Battistich

Schaps

Wilson

(2004). Effects of an elementary school intervention on students’ “connectedness” to school and social adjustment during middle school. Journal of Primary Prevention, 24, 243–262.

Berkowitz

Moore

Astor

R. A.

Benbenishty

(2016). A research synthesis of the associations between socioeconomic background, inequality, school climate, and academic achievement. Review of Educational Research, 87, 425–469.

Blackwell

L. S.

Trzesniewski

K. H.

Dweck

C. S.

(2007). Implicit theories of intelligence predict achievement across an adolescent transition: A longitudinal study and an intervention. Child Development, 78, 246–263.

Blazar

(2018). Validating teacher effects on students’ attitudes and behaviors: Evidence from random assignment of teachers to students. Education Finance and Policy, 13, 281–309.

Blazar

Kraft

M. A.

(2017). Teacher and teaching effects on students’ attitudes and behaviors. Educational Evaluation and Policy Analysis, 39, 146–170.

10.

Blum

R. W.

Libbey

H. P.

Bishop

J. H.

Bishop

(2004). School connectedness—Strengthening health and education outcomes for teenagers. Journal of School Health, 74, 231–235.

11.

Briggs

Weeks

(2011). The persistence of school-level value-added. Journal of Educational and Behavioral Statistics, 36, 616–637.

12.

Chamberlain

G. E.

(2013). Predictive effects of teachers and schools on test scores, college attendance, and earnings. Proceedings of the National Academy of Sciences of the United States of America, 110, 17176–17182.

13.

Chetty

Friedman

J. N.

Rockoff

J. E.

(2014). Measuring the impacts of teachers II: Teacher value-added and student outcomes in adulthood. American Economic Review, 104, 2633–2679.

14.

Chiang

Lipscomb

Gill

(2016). Is school value added indicative of principal quality? Education Finance and Policy, 11, 283–309.

15.

Cohen

G. L.

Garcia

Apfel

Master

(2006). Reducing the racial achievement gap: A social-psychological intervention. Science, 313, 1307–1310.

16.

Collaborative for Academic, Social, and Emotional Learning. (2005). Safe and sound: An educational leader’s guide to evidence-based social and emotional learning programs (Illinois ed.). Chicago, IL: Author.

17.

Davidson

Crowder

Gordon

Domitrovich

Brown

Hayes

(2018). A continuous improvement approach to social and emotional competency measurement. Journal of Applied Developmental Psychology, 55, 93–106.

18.

Deming

(2014). Using school choice lotteries to test measures of school effectiveness. American Economic Review: Papers and Proceedings, 104, 406–411.

19.

Durlak

Weissberg

Dymnicki

Taylor

Schellinger

(2011). The impact of enhancing students’ social and emotional learning: A meta-analysis of school-based universal interventions. Child Development, 82, 405–432.

20.

Dweck

(2006). Mindset: The new psychology of success. New York, NY: Random House.

21.

Education Analytics. (2017). Growth Model for Educator Evaluation 2016/17 (Technical report, prepared for the New York State Education Department by Education Analytics). Madison, WI.

22.

Ehlert

Koedel

Parsons

Podgursky

(2016). Selecting growth measures for use in school evaluation systems: Should proportionality matter? Educational Policy, 30, 465–500.

23.

Fuller

(1987). Measurement error models. Hoboken, NJ: John Wiley.

24.

Gawade

Meyer

(2016). Measuring teacher effectiveness using value-added models of high school achievement. Teachers College Record, 118, 1–32.

25.

Gehlbach

Hough

. (2018). Measuring social emotional learning through student surveys in the CORE districts: A pragmatic approach to validity and reliability (PACE Working paper). Retrieved from http://edpolicyinca.org/sites/default/files/SEL_Validity_May-2018.pdf

26.

Gershenson

(2016). Linking teacher quality, student attendance, and student achievement. Education Finance and Policy, 11, 125–149.

27.

Grissom

Kalogrides

Loeb

(2015). Using student test scores to measure principal performance. Educational Evaluation and Policy Analysis, 37, 3–28.

28.

Guarino

Reckase

Wooldridge

(2015). Can value-added measures of teacher performance be trusted? Education Finance and Policy, 10, 117–156.

29.

Hallinger

(2005). Instructional leadership and the school principal: A passing fancy that refuses to fade away. Leadership and Policy in Schools, 4, 221–239.

30.

Hamre

B. K.

Pianta

R. C.

(2006). Student–teacher relationships. In Bear

G. G.

Minke

K. M.

(Eds.), Children’s needs III: Development, prevention, and intervention (pp. 59–71). Washington, DC: National Association of School Psychologists.

31.

Heckman

J. J.

Rubinstein

(2001). The importance of noncognitive skills: Lessons from the GED testing program. American Economic Review, 91, 145–149.

32.

Jackson

(2018). What do test scores miss? The importance of teacher effects on non-test-score outcomes. Journal of Political Economy, 126, 2072–2107.

33.

Jennings

J. L.

DiPrete

T. A.

(2010). Teacher effects on social and behavioral skills in early elementary school. Sociology of Education, 83, 135–159.

34.

Jennings

P. A.

Greenberg

M. T.

(2009). The prosocial classroom: Teacher social and emotional competence in relation to student and classroom outcomes. Review of Educational Research, 79, 491–525.

35.

Kane

Staiger

. (2001). Improving school accountability measures (National Bureau of Economic Research, working paper 8156). Cambridge, MA: National Bureau of Economic Research.

36.

Kane

Staiger

(2002). Volatility in school test scores: Implications for test-based accountability systems. In Ravitch

(Ed.), Brookings papers on education policy (pp. 235–283). Washington, DC: Brookings Institution.

37.

Kautz

Heckman

Diris

ter Weel

Borghans

(2014). Fostering and measuring skills: Improving cognitive and non-cognitive skills to promote lifetime success. Paris, France: Organization for Economic Co-Operation and Development.

38.

Koedel

Betts

(2010). Value added to what? How a ceiling in the testing instrument influences value-added estimation. Education Finance and Policy, 5, 54–81.

39.

Ladd

H. F.

Sorensen

L. C.

(2017). Returns to teacher experience: Student achievement and motivation in middle school. Education Finance and Policy, 12, 241–279.

40.

Ladd

H. F.

Walsh

(2002). Implementing value-added measures of school effectiveness: Getting the incentives right. Economics of Education Review, 21, 1–17.

41.

Leithwood

Louis

K. S.

Anderson

Wahlstrom

(2004). Review of research: How leadership influences student learning. St. Paul, MN: Center for Applied Research and Educational Improvement.

42.

Liu

Loeb

. (2018). Engaging teachers: Measuring the impact of teachers on student attendance in secondary school (CEPA working paper No. 17-01). Retrieved from http://cepa.stanford.edu/wp17-01

43.

Masters

G. N.

(1982). A Rasch model for partial credit scoring. Psychometrika, 47, 149–174.

44.

McCaffrey

Lockwood

J. R.

Koretz

Louis

Hamilton

(2004). Models for value-added modeling of teacher effects. Journal of Educational and Behavioral Statistics, 29, 67–101.

45.

McCormick

M. P.

Cappella

O’Connor

E. E.

McClowry

S. G.

(2015). Context matters for social emotional learning: Examining variation in program impact by dimensions of school climate. American Journal of Community Psychology, 56, 101–119.

46.

Meyer

(1997). Value-added indicators of school performance: A primer. Economics of Education Review, 16, 283–301.

47.

Meyer

Dokumaci

(2015). Value-added models and the next generation of assessments. In Lissitz

R. W.

(Ed.), Value added modeling and growth modeling with particular application to teacher and school effectiveness (pp. 139–190). Charlotte, NC: Information Age.

48.

Meyer

Wang

Rice

. (2018). Measuring students’ social-emotional learning among California’s CORE districts: An IRT modeling approach (PACE working paper). Retrieved from http://edpolicyinca.org/sites/default/files/Measuring_SEL_May-2018.pdf

49.

Muraki

(1992). A generalized partial credit model: Application of an EM algorithm (ETS research report 92-06). Princeton, NJ: Educational Testing Service.

50.

Olweus

(1994). Bullying at school. In Huesmann

L. R.

(Ed.), Aggressive behavior: Current perspectives (pp. 97–130). Boston, MA: Springer.

51.

Raudenbush

Willms

(1995). The estimation of school effects. Journal of Educational and Behavioral Statistics, 20, 307–355.

52.

Reardon

Raudenbush

(2009). Assumptions of value-added models for estimating school effects. Education Finance and Policy, 4, 492–519.

53.

Rivkin

S. G.

Hanushek

E. A.

Kain

J. F.

(2005). Teachers, schools, and academic achievement. Econometrica, 73, 417–458.

54.

Ruzek

E. A.

Domina

Conley

A. M.

Duncan

G. J.

Karabenick

S. A.

(2015). Using value-added models to measure teacher effects on students’ motivation and achievement. The Journal of Early Adolescence, 35, 852–882.

55.

SAS. (2018). SAS EVAAS: Statistical Models and Business Rules of OH EVAAS Analyses. Prepared for Ohio Department of Education. Cary, NC: SAS. Retrieved from http://education.ohio.gov/getattachment/Topics/Data/Accountability-Resources/Value-Added-Technical-Reports-1/Technical-Documentation-of-EVAAS-Analysis.pdf.aspx

56.

Tekwe

Carter

C. X.

Algina

Lucas

Roth

,… Resnick

. (2004). An empirical comparison of statistical models for value-added assessment of school performance. Journal of Educational and Behavioral Statistics, 29, 11–36.

57.

Thomsen

. (2013). 50-state comparison: State school accountability report cards. Retrieved from https://www.ecs.org/state-school-accountability-report-cards/

58.

Transforming Education. (2016). Measuring MESH: Student and teacher surveys curated for the CORE districts. Retrieved from https://www.transformingeducation.org/wp-content/uploads/2017/04/160406_MeasuringMESH_ForRelease2.pdf

59.

Ttofi

M. M.

Farrington

D. P.

(2011). Effectiveness of school-based programs to reduce bullying: A systematic and meta-analytic review. Journal of Experimental Criminology, 7, 27–56.

60.

Waters

Marzano

R. J.

McNulty

(2003). Balanced leadership: What 30 years of research tells us about the effect of leadership on student achievement. Aurora, CO: Mid-Continent Research for Education and Learning.

61.

West

M. R.

Buckley

Krachman

S. B.

Bookman

(2018). Development and implementation of student social-emotional surveys in the CORE districts. Journal of Applied Developmental Psychology, 55, 119–129.

62.

West

M. R.

Pier

Fricke

Hough

Loeb

Meyer

R. H.

Rice

. (2018). Trends in student social-emotional learning: Evidence from the CORE Districts (PACE working paper). Retrieved from https://edpolicyinca.org/sites/default/files/SEL_Trends_May-2018.pdf

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

1.11 MB