Are All Head Start Classrooms Created Equal? Variation in Classroom Quality Within Head Start Centers and Implications for Accountability Systems

Abstract

Most accountability policies monitor Head Start quality at the center level by selecting a subset of classrooms within a center to represent quality. This study explores variation in classroom quality in Head Start and implications for accountability systems and children’s well-being. We find that one third to one half of the variation in quality was due to differences between classrooms within center and that 37% of centers would receive different accountability decisions depending on which classrooms were selected. Average center-level quality was not related to children’s development. However, differences in within-center classroom instructional quality were related to children’s academic and social skills. Findings suggest that accountability systems miss important variation in classroom quality within centers, which may lead to inaccurate high-stakes decisions.

Keywords

Head Start preschool classroom quality school readiness accountability

Get full access to this article

View all access options for this article.

References

Araujo

M. C.

Carneiro

Cruz-Aguayo

Schady

(2016). Teacher quality and learning outcomes in kindergarten. Quarterly Journal of Economics, 131, 1415–1453. doi:10.1093/qje/qjw016

Barnett

(2007). Revving up Head Start: Lessons from recent research. Journal of Policy Analysis and Management, 26, 674–677. doi:10.1002/pam.20271

Bloom

H. S.

Weiland

(2015). Quantifying variation in Head Start effects on young children’s cognitive and socio-emotional skills using data from the National Head Start Impact Study. Washington, DC: MDRC.

Bronfenbrenner

Morris

P. A.

(1998). The ecology of developmental processes. In Damon

Lerner

R. M.

(Eds.), Handbook of child psychology: Theoretical models of human development (pp. 993–1028). Hoboken, NJ: Wiley.

Brunsek

Perlman

Falenchuk

McMullen

Fletcher

Shah

P. S.

(2017). The relationship between the Early Childhood Environment Rating Scale and its revised form and child outcomes: A systematic review and meta-analysis. PLoS One, 12, e0178512. doi:10.1371/journal.pone.0178512

Burchinal

(2018). Measuring early care and education quality. Child Development Perspectives, 12, 3–9.

Burchinal

Zaslow

Tarullo

(2016). Quality thresholds, features, and dosage in early care and education: Secondary data analyses of child outcomes. Monographs of the Society for Research in Child Development, 81(2), 7–26. doi:10.1111/mono.12236

Chetty

Friedman

Hilger

Saez

Schanzenbach

D. W.

Yagan

(2011). How does your kindergarten classroom affect your earnings? Evidence from project star. Quarterly Journal of Economics, 126, 593–1660. doi:10.3386/w16381

Chetty

Friedman

Rockoff

(2014). Measuring the impacts of teachers I: Evaluating bias in teacher value-added estimates. American Economic Review, 104, 2593–2632. doi:10.3386/w19423

10.

Clements

D. H.

Sarama

Spitler

M. E.

Lange

A. A.

Wolfe

C. B.

(2011). Mathematics learned by young children in an intervention based on learning trajectories: A large-scale cluster randomized trial. Journal for Research in Mathematics Education, 42, 127–166.

11.

Clotfelter

Ladd

Vigdor

(2006). Teacher-student matching and the assessment of teacher effectiveness. Journal of Human Resources, 41, 778–820. doi:10.3386/w11936

12.

Curby

T. W.

Locasale-Crouch

Konold

T. R.

Pianta

R. C.

Howes

Burchinal

. . . Barbarin

(2009). The relations of observed pre-K classroom quality profiles to children’s achievement and social competence. Early Education and Development, 20, 346–372. doi:10.1080/10409280802581284

13.

Derrick-Mills

Burchinal

Peters

H. E.

De Marco

Forestieri

Fyffe

. . . Woods

(2016). Early implementation of the Head Start designation renewal system: Volume I. OPRE Report #: 2016-75a. Washington, DC: U.S. Department of Health & Human Services.

14.

Dunn

L. M.

Dunn

D. M.

(2006). PPVT-4: Peabody picture vocabulary test. Minneapolis, MN: Pearson Assessments.

15.

Early

D. M.

Maxwell

K. L.

Burchinal

Alva

Bender

R. H.

Bryant

Henry

G. T.

(2007). Teachers’ education, classroom quality, and young children’s academic skills: Results from seven studies of preschool programs. Child Development, 78, 558–580. doi:10.1111/j.1467-8624.2007.01014.x

16.

Elliott

S. N.

Gresham

F. M.

McCloskey

(1988). Teacher and observer ratings of children’s social skills: Validation of the Social Skills Rating Scales. Journal of Psychoeducational Assessment, 6, 152–161. doi:10.1177/073428298800600206

17.

Finster

Milanowski

(2018). Teacher perceptions of a new performance evaluation system and their influence on practice: A within-and between-school level analysis. Education Policy Analysis Archives, 26, 41.

18.

Gordon

R. A.

Fujimoto

Kaestner

Korenman

Abner

(2013). An assessment of the validity of the ECERS-R with implications for measures of child care quality and relations to child development. Developmental Psychology, 49, 146-160. doi:10.1016/j.ecresq.2016.01.001

19.

Guthrie

J. T.

Cox

K. E.

Knowles

K. T.

Buehl

Mazzoni

S. A.

Fasulo

(2000). Building toward coherent instruction. In Baker

Dreher

M. J.

Guthrie

J. T.

(Eds.), Engaging young readers: Promoting achievement and motivation (pp. 1–16). New York, NY: Guilford Press.

20.

Hamre

B. K.

Pianta

R. C.

(2005). Can Instructional and emotional support in the first-grade classroom make a difference for children at risk of school failure? Child Development, 76, 949–967. doi:10.1111/j.1467-8624.2005.00889.x

21.

Hanuschek

E. A.

(1999). Evidence on class size. In Mayer

S. E.

Peterson

P. E.

(Eds.), Earning and learning: How schools matter (pp. 131–168). Washington, DC: Brookings Institution.

22.

Harms

Clifford

Cryer

(1998). Early Childhood Environment Rating Scale (Rev. ed.). New York, NY: Teachers College Press.

23.

Howes

(2000). Social-emotional classroom climate in child care, child-teacher relationships and children’s second grade peer relations. Social Development, 9, 191–204.

24.

Howes

Burchinal

Pianta

Bryant

Early

Clifford

Barbarin

(2008). Ready to learn? Children’s pre-academic achievement in pre-kindergarten programs. Early Childhood Research Quarterly, 23, 27–50.

25.

Howes

Phillips

Whitebook

(1992). Thresholds of quality: Implications for the social development of children in center-based care. Child Development, 63, 449–460. doi:10.1111/j.1467-8624.1992.tb01639.x

26.

Jacob

Lefgren

(2008). Can principals identify effective teachers? Evidence on subjective performance evaluation in education. Journal of Labor Economics, 26, 101–136. doi:10.1086/522974

27.

Karoly

L. A.

Schwartz

H. L.

Setodji

C. M.

Haas

A. C.

(2016). Evaluation of Delaware Stars for early success. Santa Monica, CA: RAND.

28.

Karoly

L. A.

Zellman

G. L.

Perlman

(2013). Understanding variation in classroom quality within early childhood centers: Evidence from Colorado’s quality rating and improvement system. Early Childhood Research Quarterly, 28, 645–657. doi:10.1016/j.ecresq.2013.05.001

29.

Klugman

Gordon

M. F.

Sebring

P. B.

Sporte

S. E.

(2015). A first look at the 5essentials in Illinois schools. Chicago, IL: University of Chicago Consortium on Chicago School Research.

30.

Ludwig

Phillips

(2007). The benefits and costs of head start (Working paper 12973). Cambridge, MA: National Bureau of Economic Research.

31.

Malone

Carlson

L. P.

Aikens

Moiduddin

Klein

A. K.

West

Rall

(2013). Head Start Family and Child Experiences Survey (FACES): 2009 Cohort. Washington, DC: U.S. Department of Health & Human Services.

32.

Mashburn

A. J.

(2017). Evaluating the validity of classroom observations in the Head Start designation renewal system. Educational Psychologist, 52, 38–49.

33.

Mashburn

A. J.

Pianta

R. C.

Hamre

Downer

Barbarin

Bryant

. . . Howes

(2008). Measures of classroom quality in prekindergarten and children’s development of academic, language, and social skills. Child Development, 79, 732–749. doi:10.1111/j.1467-8624.2008.01154.x

34.

McCormick Tribune Center for Early Childhood Leadership. (2008). Research notes: When quality counts and money matters. Wheeling, IL: National Louis University. Retrieved from https://digitalcommons.nl.edu/cgi/viewcontent.cgi?article=1029&context=mccormickcenter-pubs

35.

Muñoz-Sandoval

A. F.

Woodcock

R. W.

McGrew

K. S.

Mather

(2004). Batería III Woodcock-Muñoz: Pruebas de habilidades cognitivas [Woodcock-Muñoz Battery III: Cognitive skills tests]. Rolling Meadows, IL: Riverside.

36.

NICHD Early Child Care Research Network. (1999). Child outcomes when child care center classes meet recommended standards for quality. American Journal of Public Health, 89, 1072–1077.

37.

NICHD Early Child Care Research Network. (2002). Child-care structure→process→outcome: Direct and indirect effects of child-care quality on young children’s development. Psychological Science, 13, 199–206.

38.

Perlman

Falenchuk

Fletcher

McMullen

Beyene

Shah

P. S.

(2016). A systematic review and meta-analysis of a measure of staff/child interaction quality (the Classroom Assessment Scoring System) in early childhood education and care settings and child outcomes. PLoS One, 11, e0167660. doi:10.1371/journal.pone.0167660

39.

Peterson

J. L.

Zill

(1986). Marital disruption, parent-child relationships, and behavior problems in children. Journal of Marriage and the Family, 48, 295–307. doi:10.2307/352397

40.

Phillips

Gormley

Anderson

(2016). The effects of Tulsa’s CAP Head Start program on middle-school academic outcomes and progress. Developmental Psychology, 52, 1247–1261. doi:10.1037/dev0000151

41.

Phillipsen

L. C.

Burchinal

M. R.

Howes

Cryer

(1997). The prediction of process quality from structural features of child care. Early Childhood Research Quarterly, 12, 281–303.

42.

Pianta

R. C.

Burchinal

Barnett

E. S.

Thornburg

(2009). Preschool in the United States: What we know, what we need to know, and implications for policy and research. Psychological Science in the Public Interest, 10, 49–88.

43.

Pianta

R. C.

LaParo

K. M.

Hamre

B. K.

(2008). Classroom Assessment Scoring System (CLASS) pre-K version. Baltimore, MD: Brookes.

44.

Puma

Bell

Cook

Heid

Broene

Jenkins

. . . Downer

(2012). Third grade follow-up to the Head Start impact study: Final report. OPRE Report # 2012-45. Washington, DC: U.S. Department of Health & Human Services.

45.

QRIS Compendium Fact Sheet. (2016). Rating structures and processes. Washington, DC: National Center on Early Childhood Quality Assurance in cooperation with Child Trends. Retrieved from https://childcareta.acf.hhs.gov/sites/default/files/public/qris_rating_structures_processes_2016.pdf

46.

Rimm-Kaufman

S. E.

Curby

T. W.

Grimm

K. J.

Nathanson

Brock

L. L.

(2009). The contribution of children’s self-regulation and classroom quality to children’s adaptive behaviors in the kindergarten classroom. Developmental Psychology, 45, 958–972. doi:10.1037/a0015861

47.

Sabol

T. J.

Hong

S. S.

Pianta

R. C.

Burchinal

M. R.

(2013). Can rating pre-K programs predict children’s learning? Science, 341(6148), 845–846.

48.

Sabol

T. J.

Pianta

R. C.

(2014). Do standard measures of preschool quality used in statewide policy predict school readiness? Education Finance and Policy, 9, 116–164.

49.

Sameroff

(2010). A unified theory of development: A dialectic integration of nature and nurture. Child Development, 81, 6–22.

50.

Schanzenbach

D. W.

(2006). What have researchers learned from Project STAR? Brookings Papers on Education Policy, 9(2006/2007), 205–228. doi:10.1353/pep.2007.0007

51.

StataCorp

L. P.

(2011). Stata statistical software: Release 13. College Station, TX: Author.

52.

Thornburg

K. R.

Mayfield

W. A.

Hawks

J. S.

Fuger

K. L.

(2009). The Missouri quality rating system school readiness study. Columbia, MO: Center for Family Policy & Research.

53.

Tout

Zaslow

Berry

(2005). Quality and qualifications: Links between professional development and quality in early care and education settings. In Zaslow

Martinez-Beck

(Eds.), Critical issues in early childhood professional development (pp. 77–110). Baltimore, MD: Brookes.

54.

Turner

J. C.

Warzon

K. B.

Christensen

A. L

. (2011). Motivating mathematics learning: Changes in teachers’ practices and beliefs during a nine-month collaboration. American Educational Research Journal, 48, 718–762.

55.

U.S. Department of Health and Human Services, Administration for Children and Families. (2011). Head Start: Designation Renewal System. Federal Register, 76, 70010–70032.

56.

U.S. Department of Health and Human Services, Administration for Children and Families. (2014). The role of program quality in determining Head Start’s impact on child development: Third grade follow-up to the Head Start impact study. Washington, DC: Author.

57.

U.S. Department of Health and Human Services, Administration for Children and Families. (2016). Head Start performance standards: Final Rule. Washington, DC: Author.

58.

Vinovskis

M. A.

(2008). The birth of Head Start: Preschool education policies in the Kennedy and Johnson administrations. Chicago, IL: University of Chicago Press.

59.

Votruba-Drzal

Miller

(2016). Reflections on quality and dosage of preschool and children’s development. Monographs of the Society for Research in Child Development, 81(2), 100–113. doi:10.1111/mono.12244

60.

West

Tarullo

Aikens

Malone

Carlson

B. L.

(2010). FACES 2009 study design. Washington, DC: U.S. Department of Health & Human Services.

61.

Woodcock

R. W.

McGrew

K. S.

Mather

(2001). Woodcock-Johnson III test of achievement. Itasca, IL: Riverside.

62.

Yoshikawa

Weiland

Brooks-Gunn

Burchinal

M. R.

Espinosa

L. M.

Gormley

W. T.

. . .Zaslow

M. J.

(2013). Investing in our future: The evidence base on preschool education. Ann Arbor, MI: Society for Research in Child Development.

63.

Zellman

G. L.

Perlman

V. N.

Setodji

C. M.

(2008). Assessing the validity of the Qualistar early learning quality rating and improvement system as a tool for improving child-care quality. Santa Monica, CA: RAND.

64.

Zigler

Valentine

(Eds). (1979). Project Head Start: A legacy of the war on poverty. New York, NY: Free Press. doi:10.1001/archpedi.1980.021302200810

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.64 MB