What Is in a Definition? The How and When of Special Education Subgroup Analysis in Preschool Evaluations

Abstract

There are unique challenges to estimating causal effects of preschool for students with special needs that have not received attention in the literature. We revisit the Head Start Impact Study (HSIS) to illustrate that when and how special needs is defined has implications for the internal validity of and interpretation of special needs subgroup impact estimates. We find that the treatment group in the HSIS was three percentage points more likely to be classified as special education (SD = 0.11, p < .001) at baseline, likely biasing the impact estimates for this subgroup. We also find that the estimated intent-to-treat effects of Head Start on cognitive and socioemotional measures are sensitive to subgroup definition.

Keywords

preschool evaluation special education measurement

Get full access to this article

View all access options for this article.

References

Aron

Loprest

(2012). Disability and the education system. The Future of Children, 22, 97–122. doi:10.1353/foc.2012.0007

Artiles

A. J.

(2003). Special education’s changing identity: Paradoxes and dilemmas in views of culture and space. Harvard Educational Review, 73, 164–202. doi:10.17763/haer.73.2.j78t573x377j7106

Bassok

Finch

Lee

Reardon

Waldfogel

(2016). Socioeconomic gaps in early childhood experiences: 1998 to 2010. AERA Open, 2(3), 1–22. doi:10.1177/2332858416653924

Bloom

Weiland

(2015). Quantifying variation in Head Start effects on young children’s cognitive and socio-emotional skills using data from the National Head Start Impact Study New York, NY: MDRC. Retrieved from https://www.mdrc.org/sites/default/files/quantifying_variation_in_head_start.pdf.

Brault

(2011). School-aged children with disabilities in U.S. metropolitan statistical areas: 2010 (American Community Survey briefs). U.S. Census Bureau. Retrieved from https://www.census.gov/library/publications/2011/acs/acsbr10-12.html

Chaudry

Datta

A. R.

(2017). The current landscape for public pre-kindergarten: The current state of scientific knowledge on pre-kindergarten effects. Washington, DC: Brookings Institution. Retrieved from https://www.brookings.edu/wp-content/uploads/2017/04/duke_prekstudy_final_4-4-17_hires.pdf

Conyers

Reynolds

S.-R.

(2003). Effect of early childhood intervention and subsequent special education services: Findings from the Chicago Child-Parent Centers. Educational Evaluation and Policy Analysis, 25, 75–95. Retrieved from http://www.jstor.org/stable/3699518

Cooke

(1965, February 19). Recommendations for a Head Start program by panel of experts chaired by Dr. Robert Cooke Johns-Hopkins University. Washington, DC. Retrieved from https://eclkc.ohs.acf.hhs.gov/sites/default/files/pdf/cooke-report.pdf

Duncan

G. J.

Dowsett

C. J.

Claessens

Magnuson

Huston

A. C.

Klebanov

. . . Japel

(2007). School readiness and later achievement. Developmental Psychology, 43, 1428–1446. doi:10.1037/0012-1649.43.6.1428

10.

Duncan

G. J.

Magnuson

(2013). Investing in preschool programs. Journal of Economic Perspectives, 27, 109–132. doi:10.1257/jep.27.2.109

11.

Dunn

L. M.

Dunn

L. M.

(1997). Peabody Picture Vocabulary Test (3rd ed.). Bloomington, MN: Pearson Assessments.

12.

Graham

J. W.

(2009). Missing data analysis: Making it work in the real world. Annual Review of Psychology, 60, 549–576. doi:10.1146/annurev.psych.58.110405.085530

13.

Harry

Klingner

J. K.

(2006). Why are so many minority students in special education? Understanding race and disability in schools. New York, NY: Teachers College Press.

14.

Head Start Bureau. (2015). Head Start program facts fiscal year 2015. Washington, DC: U.S. Department of Health and Human Services. Retrieved from https://eclkc.ohs.acf.hhs.gov/sites/default/files/pdf/head-start-fact-sheet-fy-2015.pdf

15.

Hebbler

Spiker

(2016). Supporting young children with disabilities. The Future of Children, 25, 185–205.

16.

Individuals With Disabilities in Education Act of 2004, Pub. L. No. 108-446 Sec. 303.300-346 (2004a).

17.

Individuals With Disabilities in Education Act of 2004, Pub. L. No. 108-446 Sec. 655(a)(5) (2004b).

18.

Jenkins

Dale

Mills

Cole

Pious

Ronk

(2006). How special education preschool graduates finish: Status at 19 years of age. American Educational Research Journal, 43, 737–781. doi:10.3102/00028312043004737

19.

Justice

L. M.

Logan

J. A. R.

Lin

T.-J.

Kaderavek

J. N.

(2014). Peer effects in early childhood education: Testing the assumptions of special-education inclusion. Psychological Science, 25, 1722–1729. doi:10.1177/0956797614538978

20.

Krueger

Zhu

(2004). Another look at the New York City school voucher experiment. American Behavioral Scientist, 47, 658–698. doi:10.1177/0002764203260152

21.

Lazar

Darlington

Murray

Royce

Snipper

Ramey

(1982). Lasting effects of early education: A report from the consortium for longitudinal studies. Monographs of the Society for Research in Child Development, 47(2/3), 1–151. Retrieved from http://www.jstor.org/stable/1165938

22.

Lipsey

Hofer

Dong

Farran

Bilbrey

(2013). Evaluation of the Tennessee voluntary prekindergarten program: Kindergarten and first grade follow-up results from randomized control design. Nashville, TN: Peabody Research Institute. Retrieved from https://my.vanderbilt.edu/tnprekevaluation/files/2013/10/August2013_PRI_Kand1stFollowup_TN-VPK_RCT_ProjectResults_FullReport1.pdf

23.

Madden

O’Hara

Levenstein

(1984). Home again: Effects of the mother–child home program on mother and child. Child Development, 55, 636–647. doi:10.2307/1129975

24.

Marder

(2009). Facts from SEELS: Perspectives on students’ disability classifications. Office of Special Education Programs, U.S. Department of Education. Retrieved from https://www.seels.net/info_reports/DisabilityClassif1.9.09.pdf

25.

Markowitz

Carlson

Frey

Riley

Shimshak

Heinzen

. . . Lee

(2006). Preschoolers’ characteristics, services, and results: Wave 1 overview report from the Pre-Elementary Education Longitudinal Study (PEELS). Rockville, MD: Westat. Retrieved from http://www.peels.org/

26.

McCarton

Brooks-Gunn

Wallace

Bauer

Bennett

Berbaum

. . . Meinert

(1997). Results at age 8 years of early intervention for low-birth-weight premature infants: The Infant Health Development Program. Journal of the American Medical Association, 277, 126–132. doi:10.1001/jama.1997.03540260040033

27.

Michelmore

Dynarski

(2017). The gap within the gap: Using longitudinal data to understand income differences in educational outcomes. AERA Open, 3, 1–18. doi:10.1177/2332858417692958

28.

Morgan

Farkas

Hillemeier

Mattison

Maczuga

Cook

(2015). Minorities are disproportionately underrepresented in special education: Longitudinal evidence across five disability conditions. Educational Researcher, 44, 278–292. doi:10.3102/0013189X15591157

29.

Morrier

Gallagher

(2012). Racial disparities in preschool special education eligibility for five southern states. The Journal of Special Education, 44, 152–169. doi:10.1177/0022466910380465

30.

Murnane

Willett

(2010). Methods matter: Improving causal inference in educational and social science research. Oxford, UK: Oxford University Press.

31.

Muschkin

Ladd

Dodge

(2015). Impact of North Carolina’s early childhood initiatives on special education placements in third grade. Educational Evaluation and Policy Analysis, 37, 478–500. doi:10.3102/0162373714559096

32.

National Center for Education Statistics. (2016a). ECLS-B Preschool National Study: Parent interview. Retrieved from https://nces.ed.gov/ecls/pdf/birth/preschool_parent_interview.pdf

33.

National Center for Education Statistics. (2016b). Table 204.70: Number and percentage of children served under Individuals with Disabilities Education Act (IDEA), part B, by age group and state or jurisdiction: Selected years, 1990-91 through 2013-14. Digest of Education Statistics. Retrieved from https://nces.ed.gov/programs/digest/d15/tables/dt15_204.70.asp?current=yes

34.

National Center for Education Statistics. (2016c). Table 202.20: Percentage of 3-, 4-, and 5-year-old children enrolled in preprimary programs, by level of program, attendance status, and selected child and family characteristics: 2014. Retrieved from https://nces.ed.gov/programs/digest/d15/tables/dt15_202.20.asp

35.

National Center for Special Education Research. (2006). Preschoolers with disabilities: Characteristics, services, and results: Wave 1 overview report from the Pre-Elementary Education Longitudinal Study (PEELS). Retrieved from https://ies.ed.gov/pubsearch/pubsinfo.asp?pubid=NCSER20063003

36.

National Institute for Early Education Research. (2017). The state of preschool 2016. Retrieved from http://nieer.org/wp-content/uploads/2017/09/Full_State_of_Preschool_2016_9.15.17_compressed.pdf

37.

Office of Child Development. (1975, July). Head Start program performance standards (OCD-N-30-364-4). Washington, DC: U.S. Department of Health, Education, and Welfare. Retrieved from https://files.eric.ed.gov/fulltext/ED122936.pdf

38.

Oswald

D. P.

Coutinho

M. J.

Best

A. M.

Singh

(1999). Ethnic representation in special education: The influence of school-related economic and demographic variables. The Journal of Special Education, 32, 194–206. doi:10.1177/002246699903200401

39.

Phillips

Gormely

Anderson

(2016). The effects of Tulsa’s CAP Head Start program on middle-school academic outcomes and progress. Developmental Psychology, 52, 1247–1261. doi:10.1037/dev0000151

40.

Phillips

Johnson

Weiland

(2017, August). Public preschool in a more diverse America: Implications for next-generation evaluation research (Poverty Solutions at the University of Michigan Working Paper Series #2-17). Retrieved from https://poverty.umich.edu/research-publications/working-papers/preschool-diverse-america/

41.

Phillips

Meloy

(2012). High-quality school-based pre-k can boost early learning for children with special needs. Exceptional Children, 78, 471–490. doi:10.1177/001440291207800405

42.

Puma

Bell

Cook

Heid

Lopez

. (2005). Head Start Impact Study: First year findings. Washington, DC: U.S. Department of Health and Human Services, Administration for Children and Families. Retrieved from https://www.acf.hhs.gov/sites/default/files/opre/first_yr_finds.pdf

43.

Puma

Bell

Cook

Heid

. (2010). Head Start Impact Study: Final report. Washington, DC: U.S. Department of Health and Human Services, Administration for Children and Families. Retrieved from https://www.acf.hhs.gov/sites/default/files/opre/hs_impact_study_final.pdf

44.

Puma

Bell

Cook

Heid

Broene

Jenkins

. . . Downer

(2012). Third grade follow-up to the Head Start Impact Study: Final report (OPRE Report No. 2012-45). Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services. Retrieved from https://www.acf.hhs.gov/sites/default/files/opre/head_start_report.pdf

45.

Ramey

Campbell

Burchinal

Skinner

Gardner

Ramey

(2000). Persistent effects of early childhood education on high-risk children and their mothers. Applied Developmental Science, 4, 2–14. doi:10.1207/S1532480XADS0401_1

46.

Ramey

Phillips

Lanzi

Brezausek

Katholi

Snyder

(2000). Head Start children’s entry into public school: A report on the National Head Start/Public School Early Childhood Transition Demonstration Study. Washington, DC: Administration for Children and Families, U.S. Department of Health and Human Service. Retrieved from https://www.acf.hhs.gov/sites/default/files/opre/transition_study.pdf

47.

Raver

C. C.

Jones

S. M.

Li-Grining

C. P.

Zhai

Metzger

Solomon

(2009). Targeting children’s behavior problems in preschool classrooms: A cluster-randomized controlled trial. Journal of Consulting and Clinical Psychology, 77, 302–316. doi:10.1037/a0015302

48.

Ricciuti

A. E.

St. Pierre

R. G.

Lee

Parsad

Rimdzius

(2004). Third national even start evaluation: Follow-up findings from the experimental design study. Washington, DC: Institute of Education Sciences, National Center for Education Evaluation and Regional Assistance, U.S. Department of Education. Retrieved from https://ies.ed.gov/ncee/pdf/20053002.pdf

49.

Seitz

Rosenbaum

Apfel

(1985). Effects of family support intervention: A ten-year follow-up. Child Development, 56, 376–391. doi:10.2307/1129727

50.

Sullivan

A. L.

Bal

(2013). Disproportionality in special education: Effects of individual and school variables on disability risk. Exceptional Children, 79, 475–494. doi:10.1177/001440291307900406

51.

United States Department of Health and Human Services, Administration for Children and Families, Office of Planning, & Research and Evaluation. (2018, February 8). Head Start Impact Study (HSIS), 2002-2006 [United States] (ICPSR 29462). Ann Arbor, MI: Inter-university Consortium for Political and Social Research. Retrieved from https://doi.org/10.3886/ICPSR29462.v7

52.

Weiland

(2016). Impacts of the Boston prekindergarten program on the school readiness of young children with special needs. Developmental Psychology, 52, 1763–1776.

53.

Woodcock

R. W.

McGrew

K. S.

Mather

(2001). Woodcock–Johnson® III Tests of Achievement. Itasca, IL: Riverside.

54.

Yoshikawa

Weiland

Brooks-Gunn

Burchinal

M. R.

Espinosa

L. M.

Gormely

W. T.

. . . Zaslow

M. J.

(2013). Investing in our future: The evidence base on preschool education. Society for Research in Child Development. Retrieved from https://www.fcd-us.org/assets/2016/04/Evidence-Base-on-Preschool-Education-FINAL.pdf

55.

Zigler

Meunchow

(1992). Head Start: The inside story of America’s most successful educational experiment. New York, NY: Basic Books.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.05 MB