Program-Level Influences on the Measurement of Early Communication for Infants and Toddlers in Early Head Start

Abstract

Measurement in early childhood is an increasingly large-scale endeavor addressing purposes of accountability, program improvement, child outcomes, and intervention decision making for individual children. The Early Communication Indicator (ECI) is a measure relevant to intervention decision making for infants and toddlers, including response to intervention approaches. The widespread use of the ECI is growing in multiple programs and states. Local program staff members collect ECI data and, with their program directors, manage their own system of ECI measurement. Program-level implementations represent independent ECI measurement replications, and the success of each potentially influences the quality of data produced and, ultimately, the validity of the inferences made thereof. The purpose of this research was to examine program-level influences on child-level ECI total communication growth and 36-month outcomes in a large sample of children, including those with individual family service plans served by multiple Early Head Start programs in two states. Results indicated variation in programs’ sociodemographic composition, ECI implementation quality, ECI total communication growth, and 36-month outcomes. Program-level sociodemographic composition was found not to be an influence on ECI growth or 36-month outcomes, whereas state location and implementation quality were. Implications are discussed.

Keywords

language development child development speech and language delays disabilities and development delays assessment early intervention issues

Get full access to this article

View all access options for this article.

References

Administration for Children and Families. (2006). Research to practice program performance measures for Head Start programs serving infants and toddlers. Retrieved from http://www.acf.hhs.gov/programs/opre/ehs/perf_measures/reports/prgm_perf_measures/perf_meas_4pg.html

American Psychological Association, American Educational Research Association, & National Council on Measurement in Education. (1999). Standards for educational and psychological testing. Washington, DC: American Psychological Association.

Bagnato

S. J.

(2007). Authentic assessment for early childhood intervention: Best practices. New York, NY: Guilford Press.

Berkeley

Bender

W. N.

Peaster

L. G.

Saunders

(2009). Implementation of response to intervention: A snapshot of progress. Journal of Learning Disabilities, 42(1), 85-95.

Bryk

A. S.

Raudenbush

S. W.

Congdon

(1996). HLM: Hierarchical linear and nonlinear modeling with HLM/2L and HLM/3L programs. Chicago: Scientific Software International.

Burchinal

Appelbaum

M. I.

(1991). Estimating individual developmental functions: Methods and their assumptions. Child Development, 62(1), 23-43.

Buzhardt

Greenwood

C. R.

Walker

Carta

J. J.

Terry

Garrett

(2010). Web-based tools to support the use of data-based early intervention decision making. Topics in Early Childhood Special Education, 29(4), 201-214.

Carta

J. J.

Greenwood

C. R.

Walker

Buzhardt

(2010). Using IGDIs: Monitoring progress and improving intervention results for infants and young children. Baltimore, MD: Brookes.

Carta

J. J.

Greenwood

C. R.

Walker

Kaminski

Good

McConnell

S. R.

McEvoy

(2002). Individual growth and development indicators (IGDIs): Assessment that guides intervention for young children. Young Exceptional Children Monograph Series, 4 (15-28).

10.

Cornell Statistical Consulting Unit. (2008, May). Coding categorical variables in regression models: Dummy and effect coding (StatNews No. 72). Ithica, NY: Cornell University. Retrived from http://www.cscu.cornell .edu/news/statnews/stnews72.pdf

11.

Division of Early Childhood. (2007). Promoting positive outcomes for children with disabilities: Recommendations for curriculum, assessment, and program evaluation. Missoula, MT: Author.

12.

Fenson

Dale

P. S.

Resnick

J. S.

Bates

Thal

D. J.

Pethick

S. J.

(1994). Variability in early communicative development. Monographs of the Society for Research in Child Development, 59(5), 1-185.

13.

Fixsen

D. L.

Naoom

S. F.

Blase

K. A.

Friedman

R. M.

Wallace

(2006). Implementation research: A synthesis of the literature. Tampa, FL: University of South Florida, National Implementation Research Network.

14.

Fuchs

L. S.

Deno

S. L.

(1991). Paradigmatic distinctions between instructionally relevant measurement models. Exceptional Children, 57, 488-500.

15.

Galsworthy

M. J.

Dionne

Dale

P. S.

Plomin

(2000). Sex differences in early verbal and non-verbal cognitive development. Developmental Science, 3, 206-215.

16.

Greenwood

C. R.

Carta

J. J.

Baggett

Buzhardt

Walker

Terry

(2008). Best practices in integrating progress monitoring and response-to-intervention concepts into early childhood systems. In Thomas

Grimes

Gruba

(Eds.), Best practices in school psychology V (pp. 535-548). Washington, DC: National Association of School Psychology.

17.

Greenwood

C. R.

Carta

J. J.

Walker

(2005). Individual growth and development indicators (IGDIs): Tools for assessing intervention results for infants and toddlers. In Heward

W. J.

. (Eds.), Focus on behavior analysis in education: Achievements, challenges, and opportunities (pp. 103-124). Columbus, OH: Pearson / Prentice Hall.

18.

Greenwood

C. R.

Carta

J. J.

Walker

Hughes

Weathers

(2006). Preliminary investigations of the application of the Early Communication Indicator (ECI) for infants and toddlers. Journal of Early Intervention, 28(3), 178-196.

19.

Greenwood

C. R.

Dunn

Ward

S. M.

Luze

G. J.

(2003). The Early Communication Indicator (ECI) for infants and toddlers: What it is, where it’s been, and where it needs to go. The Behavior Analyst Today, 3(4), 383-388.

20.

Greenwood

C. R.

Walker

(2010). Development and validation of IGDIs. In Carta

J. J.

Greenwood

C. R.

Walker

Buzhardt

(Eds.), Using IGDIs: Monitoring progress and improving intervention for infants and young children (pp. 159-181). Baltimore, MD: Brookes.

21.

Greenwood

C. R.

Walker

Buzhardt

(2010). The Early Communication Indicator (ECI) for infants and toddlers: Early Head Start growth norms from two states. Journal of Early Intervention, 32(5), 310-334.

22.

Harjusola-Webb

S. M.

(2006). The use of naturalistic communication intervention with young children who have developmental disabilities. Dissertation Abstracts International, 67A(04), 1290 (Publication No. AAT 3216284)

23.

Hartmann

D. P.

(1977). Considerations in the choice of interobserver reliability estimates. Journal of Applied Behavior Analysis, 10, 103-116.

24.

Hebbeler

Barton

L. R.

Mallik

(2008). Assessment and accountability for programs serving young children. Exceptionality, 16, 48-63.

25.

Hox

J. J.

(2001). Multilevel analysis: Techniques and applications. Mahwah, NJ: Erlbaum.

26.

Huttenlocher

Haight

Bryk

Seltzer

Lyons

(1991). Early vocabulary growth: Relation to language input and gender. Developmental Psychology, 27, 236-248.

27.

Individuals with Disabilities Education Improvement Act, 20 U.S.C., § 1400 et seq. (2004).

28.

Kirk

(2006). Using outcome measures and progress monitoring to guide language-promoting interventions in Early Head Start Programs. Dissertation Abstracts International, 67A(02). (Publication No. AAT 3207867)

29.

Kosanic

A. Z.

(2000). Toward a technology for monitoring growth in the expressive communication of infants and toddlers (Unpublished master’s thesis). University of Kansas, Lawrence, KS.

30.

Liaw

F. R.

Brooks-Gunn

(1994). Cumulative familial risks and low-birthweight children’s cognitive and behavioral development. Journal of Clinical Child Psychology, 23, 360-372.

31.

Luze

G. J.

Linebarger

D. L.

Greenwood

C. R.

Carta

J. J.

Walker

Leitschuh

Atwater

J. B.

(2001). Developing a general outcome measure of growth in expressive communication of infants and toddlers. School Psychology Review, 30(3), 383-406.

32.

Marion

S. F.

White

Carlson

Erpenbach

W. J.

Rabinowitz

Sheinker

(2002). Making valid and reliable decisions in determining adequate yearly progress. Washington, DC: Council of Chief School Officers.

33.

McConnell

S. R.

Missall

K. N.

(2008). Best practices in monitoring progress for preschool children. In Thomas

Grimes

(Eds.), Best practices in school psychology V (pp. 561-573). Washington, DC: National Association of School Psychologists.

34.

McConnell

S. R.

Priest

J. S.

Davis

S. D.

McEvoy

M. A.

(2002). Best practices in measuring growth and development for preschool children. In Thomas

Grimes

(Eds.), Best practices in school psychology IV (Vol. 2, pp. 1231-1246). Washington, DC: National Association of School Psychologists.

35.

Missall

K. N.

McConnell

S. R.

Cadigan

(2006). Early literacy development in preschool: Skill growth and relations between classroom variables for preschool children. Journal of Early Intervention, 29, 1-21.

36.

Murray

(2002). Implementing a language intervention in a childcare setting using prelinguistic language-teaching techniques (Unpublished master’s thesis). University of Kansas, Lawrence, KS.

37.

Muthen

Satorra

(1995). Complex sample data in structural equation modeling. In Marsden

P. V.

(Ed.), Sociological methodology (pp. 267-316). Oxford, UK: Basil Blackwell.

38.

Priest

J. S.

McConnell

S. R.

Walker

Carta

J. J.

Kaminski

McEvoy

M. A.

. . . Shinn

M. R.

(2001). General growth outcomes for children: Developing a foundation for continuous progress measurement. Journal of Early Intervention, 24(3), 163-180.

39.

Raudenbush

S. W.

Bryk

A. S.

(2002). Hierarchical linear models: Applications and data analysis methods (2nd ed.). Newbury Park, CA: Sage.

40.

Rous

LoBianco

Moffet

D. L.

Lund

(2005). Building preschool accountability systems: Guidelines resulting from a national study. Journal of Early Intervention, 28, 50-64.

41.

Sandall

S. R.

McLean

Smith

McLean

(2005). DEC recommended practices: A comprehensive guide for practical application in early intervention/early childhood special education. Longmont, CO: Sopris West.

42.

Seaman

M. A.

Serlin

R. C.

(1998). Equivalence confidence intervals for two group comparisons. Psychological Methods, 3, 403-411.

43.

Small

C. J.

(2004). The effects of child care providers’ implementation of communication promoting strategies on the communication of toddlers with and without developmental disabilities (Unpublished master’s thesis). University of Kansas, Lawrence, KS.

44.

Snyder

P. A.

Wixson

C. S.

Talapatra

Roach

A. T.

(2008). Assessment in early childhood: Instruction-focused strategies to support response-to-intervention frameworks. Assessment for Effective Intervention, 34(1), 25-34.

45.

VanDerHeyden

A. M.

(2005). Intervention driven assessment practices in early childhood/early intervention: Measuring what is possible rather than what is present. Journal of Early Intervention, 28, 28-33.

46.

VanDerHeyden

A. M.

Snyder

(2006). Integrating frameworks from early childhood intervention and school psychology to accelerate growth for all young children. School Psychology Review, 35(4), 519-534.

47.

Walker

Buzhardt

(2010). IGDI administration: Coding, scoring, and graphing. In Carta

J. J.

Greenwood

C. R.

Walker

Buzhardt

(Eds.), Using IGDIs: Monitoring progress and improving intervention results for infants and young children. Baltimore, MD: Brookes.

48.

Walker

Carta

J. J.

(2010). The communication IGDI: Early Communication Indicator. In Carta

J. J.

Greenwood

C. R.

Walker

Buzhardt

(Eds.), Using IGDIs: Monitoring progress and improving intervention results for infants and young children (pp. 39-56). Baltimore, MD: Brookes.

49.

Walker

Carta

J. J.

Greenwood

Buzhardt

(2008). The use of individual growth and development indicators for progress monitoring and intervention decision making in early education. Exceptionality, 16(1), 33-47.

50.

Zimmerman

I. L.

Steiner

V. G.

Pond

R. V.

(1992). Preschool Language Scale–3. San Antonio, TX: The Psychological Corporation.