Despite evidence that frequent progress monitoring to identify children at-risk of delays and inform early intervention services improves child outcomes, this practice is rare in infant–toddler settings where children could benefit the most from early intervention. Using a descriptive research design within an Implementation Science framework, we evaluated how 10 community-based infant–toddler agencies implemented a standardized progress monitoring assessment using a web application to monitor children’s growth and identify children at-risk for delay. An Implementation Index was developed to quantify implementation progress for each agency, which included their percent of tasks completed, and rate of task implementation over time. Staff turnover and high staff:child ratios were associated with low implementation of progress monitoring. The Implementation Index differentiated between agencies that otherwise demonstrated similar implementation rates. Implications for supporting progress monitoring and other evidence-based practices in community-based infant–toddler childcare settings are discussed.
GreenwoodC. R.CartaJ. J.SchnitzA. G.IrvinD. W.JiaF.AtwaterJ. (2019). Filling an information gap in preschool gap in preschool MTSS and RTI decision making. Exceptional Children, 85(3), 271–290. https://doi.org/10.1177/0014402918812473
2.
AkersL.Del GrossoP.Atkins-BurnettS.MonahanS.BollerK.CartaJ. J.WasikB. A. (2015). Research brief—tailored teaching: The need for stronger evidence about early childhood teachers’ use of ongoing assessment to individualize instruction (OPRE Report 2015-59). Research Brief OPRE Report.
3.
Al-UbaydliO.ListJ. A.SuskindD. (2019). The science of using science: Towards an understanding of the threats to scaling experiments (No. w25848). National Bureau of Economic Research.
AtmowardoyoH. (2018). Research methods in TEFL studies: Descriptive research, case study, error analysis, and R & D. Journal of Language Teaching and Research, 9(1), 197−204. https://doi.org/10.17507/jltr.0901.25
6.
BagnatoS. J.McLeanM.MacyM.NeisworthJ. T. (2011). Identifying instructional targets for early childhood via authentic assessment: Alignment of professional standards and practice-based evidence. Journal of Early Intervention, 33(4), 243−253. https://doi.org/10.1177/1053815111427565
7.
BastL. S.DueP.BendtsenP.RinggardL.WohllebeL.DamsgaardM. T.GronbaekM.ErsbollA. K.AndersenA. (2015). High impact of implementation on school-based smoking prevention: the X:IT study—a cluster-randomized smoking prevention trial. Implementation Science, 11(1), 125. Article 125https://doi.org/10.1186/s13012-016-0490-7
8.
BuzhardtJ.AbbottM.GreenwoodC.TapiaY. (2004). Usability testing of the classwide peer tutoring learning management system. Journal of Special Education Technology, 20(1), 19−29. https://doi.org/10.1177/016264340502000102
9.
BuzhardtJ.GreenwoodC. R.AbbottM.TapiaY. (2006). Research on scaling up evidence-based instructional practice: Developing a sensitive measure of the rate of implementation. Educational Technology Research and Development, 54(5), 467−492. https://doi.org/10.1007/s11423-006-0129-5
10.
BuzhardtJ.GreenwoodC. R.JiaF.WalkerD.SchneiderN.LarsonA. L.ValdovinosM.McConnellS. R. (2020). Technology to guide data-driven intervention decisions: Effects on language growth of young children at risk for language delay. Exceptional Children, 87(1), 74–91. https://doi.org/10.1177/0014402920938003
11.
BuzhardtJ.GreenwoodC. R.WalkerD.AndersonR.HowardW.CartaJ. J. (2011). Effects of web-based support on early head start home visitors’ use of evidence-based intervention decision making and growth in children’s expressive communication. NHSA Dialog, 14(3), 121–146. https://doi.org/10.1080/15240754.2011.587614
12.
BuzhardtJ.GreenwoodC.WalkerD.CartaJ.TerryB.GarrettM. (2010). A web-based tool to support data-based early intervention decision making. Topics in Early Childhood Special Education, 29(4), 201−213. https://doi.org/10.1177/0271121409353350
13.
BuzhardtJ.GreenwoodC. R.WalkerD.JiaF.SchnitzA. G.HigginsS.MontagnaD.MueheC. (2018). Web-based support for data-based decision making: Effect of intervention implementation on infant-toddler communication. Journal of Early Intervention, 40(3), 246–267. https://doi.org/10.1177/1053815118788059
14.
BuzhardtJ.WalkerD. (2010). Web-based support for decision making using IGDIs. In Using IGDIs: Monitoring progress and improving intervention for infants and young children (pp. 127-142). Paul H Brookes Publishing.
15.
BuzhardtJ.WalkerD.GreenwoodC. R.Heitzman-PowellL. (2012). Using technology to support progress monitoring and data-based intervention decision making in early childhood: Is there an app for that?Focus on Exceptional Children, 44(8), 1−18. https://doi.org/10.17161/fec.v44i8.6914
16.
CartaJ. J.GreenwoodC. R.LuzeG. J.ClineG.KuntzS. (2004). Developing a general outcome measure of growth in social skills for infants and toddlers. Journal of Early Intervention, 26(2), 91–114. https://doi.org/10.1177/105381510402600203
17.
CartaJ.GreenwoodC.WalkerD.BuzhardtJ. (2010). Using IGDIs: Monitoring progress and improving intervention for infants and young children. Paul H Brooks Publishing.
18.
ChristT. J.ZopluogluC.MonaghenB. D.Van NormanE. R. (2013). Curriculum-based measurement of oral reading: multi-study evaluation of schedule, duration, and dataset quality on progress monitoring outcomes. Journal of School Psychology, 51(1), 19−57. https://doi.org/10.1016/j.jsp.2012.11.001
DixK. L.SleeP. T.LawsonM. J.KeevesJ. P. (2012). Implementation quality of whole‐school mental health promotion and students’ academic performance. Child and Adolescent Mental Health, 17(1), 45−51. https://doi.org/10.1111/j.1475-3588.2011.00608.x
21.
DowlingK.BarryM. M. (2020). Evaluating the implementation quality of a social and emotional learning program: A mixed methods approach. International Journal of Environmental Research in Public Health, 17(9), 3249. https://doi.org/10.3390/ijerph17093249
22.
DurlakJ. A.DuPreE. P. (2008). Implementation matters: a review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology, 41(3), 327−350. https://doi.org/10.1007/s10464-008-9165-0
FixsenD. L.BlaseK. A.NaoomS. F.WallaceF. (2009). Core implementation components. Research on Social Work Practice, 19(5), 531−540. https://doi.org/10.1177/1049731509335549
25.
FixsenD. L.NaoomS. F.BlaseK. A.FriedmanR. M.WallaceF. (2005). Implementation research: A synthesis of the literature (FMHI Publication#231). Louis dr la Parte Florida Mental Health Institute.
26.
FoegenA.JibanC.DenoS. (2007). Progress monitoring measures in mathematics: A review of the literature. The Journal of Special Education, 41(2), 121−139. https://doi.org/10.1177/00224669070410020101
27.
FuchsD.FuchsL. S.ComptonD. L. (2012). Smart RTI: A next-generation approach to multilevel prevention. Exceptional Children, 78(3), 263−279. https://doi.org/10.1177/001440291207800301
28.
FuchsL. S.FuchsD.HamlettC. L. (1989). Effects of instrumental use of curriculum-based measurement to enhance instructional programs. Remedial and Special Education, 10(2), 43−52. https://doi.org/10.1177/074193258901000209
29.
GreenwoodC. R.AbbottM. (2001). The research to practice gap in special education. Teacher Education and Special Education, 24(4), 276−289. https://doi.org/10.1177/088840640102400403
30.
GreenwoodC. R.CartaJ. J.SchnitzA. G.HigginsS.BuzhardtJ.WalkerD.JiaF.IrvinD. (2020). Progress toward an early social indicator for infants and toddlers. Journal of Early Intervention. https://doi.org/10.1177/1053815120945021
31.
GreenwoodC. R.LuzeG. J.ClineG.KuntzS.LeitschuhC. (2002). Developing a general outcome measure of growth in movement for infants and toddlers. Topics in Early Childhood Special Education, 22(3), 143–157. https://doi.org/10.1177/02711214020220030201
32.
GreenwoodC.WalkerD.BuzhardtJ. (2010). The Early Communication Indicator (ECI) for infants and toddlers: early head start growth norms from two states. Journal of Early Intervention, 32(5), 310−334. https://doi.org/10.1177/1053815110392335
33.
GreenwoodC. R.WalkerD.BuzhardtJ.IrvinD.SchnitzA. G.JiaF. (2018). Update on the EMI for infants and toddlers. Topics in Early Childhood Special Education, 38(2), 105–117. https://doi.org/10.1177/0271121418777290
34.
GreenwoodC. R.WalkerD.CartaJ. J.HigginsS. K. (2006). Developing a general outcome measure of growth in the cognitive abilities of children 1 to 4 years old: The early problem-solving indicator. School Psychology Review, 35(4), 535–551. https://doi.org/10.1080/02796015.2006.12087960
35.
HeathC.HeathD. (2007). Made to stick: Why some ideas survive and others die. New York, NY:Random House.
36.
HigginsM. C.WeinerJ.YoungL. (2012). Implementation teams: A new lever for organizational change. Journal of Organizational Behavior, 33(3), 366−388. https://doi.org/10.1002/job.1773
37.
HornerR. H.SugaiG. (2015). School-wide PBIS: An example of applied behavior analysis implemented at a scale of social importance. Behavior Analysis in Practice, 8(1), 80−85. https://doi.org/10.1007/s40617-015-0045-4
38.
Hughes-BeldingK.LuzeG. J.WalterM. C. (2021). Evaluating implementation of infant/toddler IGDIs for progress monitoring by practitioners in Part C programs. Child and Youth Care Forum, 50(1), 77−97. https://doi.org/10.1007/s10566-020-09549-2
39.
Institute of Medicine and the National Research Council (2012). The early childhood care and education workforce: Challenges and opportunities: A workshop report. Washington (DC). The National Academies Press. https://doi.org/10.17226/13238
40.
JamesA. G.NoltemeyerA.RitchieR.PalmerK.Miami University (2019). Longitudinal disciplinary and achievement outcomes associated with school-wide PBIS implementation level. Psychology in the Schools, 56(9), 1512−1521. https://doi.org/10.1002/pits.22282
41.
JoyceK. E.CartwrightN. (2020). Bridging the gap between research and practice: Predicting what will work locally. American Educational Research Journal, 57(3), 1045−1082. https://doi.org/10.3102/0002831219866687
42.
KaminskiR.CummingsK. D.Powell-SmithK. A.GoodR. H. (2008). Best practices in using dynamic indicators of basic early literacy skills for formative assessment and evaluationBest practices in school psychology (5th ed., pp. 1181−1204). National Association of School Psychologists.
43.
KilbourneA. M.NeumannM. S.PincusH. A.BauerM. S.StallR. (2007). Implementing evidence-based interventions in health care: Application of the replicating effective programs framework. Implementation Science, 2(1), 1−10. https://doi.org/10.1186/1748-5908-2-42
44.
KimmonsR. (2020). Current trends (and missing links) in educational technology research and practice. TechTrends, 64(6), 803−809. https://doi.org/10.1007/s11528-020-00549-6
45.
KlingnerJ. K.BoardmanA. G.McMcasterK. L. (2013). What does it take to scale up and sustain evidence-based practices?Exceptional Children, 79(3), 195−211. https://doi.org/10.1177/001440291307900205
46.
KwonK-A.FordT. G.SalvatoreA. L.RandallK.JeonL.Malek-LasaterA.EllisN.KileM. S.HormD. M.KimS. G.HanM. (2020). Neglected elements of a high-quality early childhood workforce: Whole teacher well-being and working conditions. Early Childhood Education Journal, 50(1), 157−168. https://doi.org/10.1007/s10643-020-01124-7
47.
LeeH.ChungH. Q.ZhangY.AbediJ.WarschauerM. (2020). The effectiveness and features of formative assessment in US K-12 education: A systematic review. Applied Measurement in Education, 33(2), 124−140. https://doi.org/10.1080/08957347.2020.1732383
48.
McConnellS.McEnvoyM. A.PriestJ. S. (2002). “Growing” measures for monitoring process in early childhood education: A research and development process for individual growth and development indicators. Assessment for Effective Intervention, 27(4), 3−14. https://doi.org/10.1177/073724770202700402
49.
McCoyK. P. (2015). The science, and art, of program dissemination: Strategies, successes, and challenges. New Directions for Child and Adolescent Development, 149, 1−10. https://doi.org/10.1002/cad.20109
50.
MetzA.HalleT.BartleyL.BlasbergA. (2013). The key components of successful implementation. In HalleT.MetzA.Martinez-BeckI. (Eds.), Applying implementation science in early childhood programs and systems (pp. 21−42). Baltimore, MD: Paul H Brookes Publishing.
51.
National Association for the Education of Young Children [NAEYC] (2018). NAEYC Early Learning Program accreditation standards and assessment items.
52.
OdomS. L. (2009). The tie that binds: Evidence-based practice, implementation science, and outcomes for children. Topics in Early Childhood Special Education, 29(1), 53−61. https://doi.org/10.1177/0271121408329171
53.
RigglemanS. (2020). Using data collection applications in early childhood settings to support behavior change. Journal of Special Education Technology, 36(3), 175−182. https://doi.org/10.1177/0162643420942763
54.
SaundersR. P.WardD.FeltonG. M.DowdaM.PateR. R. (2006). Examining the link between program implementation and behavior outcomes in the lifestyle education for activity program (LEAP). Evaluation and Program Planning, 29(4), 352−364. https://doi.org/10.1016/j.evalprogplan.2006.08.006
55.
ScheirerM. A. (2005). Is sustainability possible? A review and commentary on empirical studies of program sustainability. American Journal of Evaluation, 26(3), 320−347. https://doi.org/10.1177/1098214005278752
56.
SteckerP. M.FuchsL. S.FuchsD. (2005). Using curriculum-based measurement to improve student achievement: Review of research. Psychology in the Schools, 42(8), 795−819. https://doi.org/10.1002/pits.20113
57.
SugaiG.HornerR. H. (2006). A promising approach for expanding and sustaining school-wide positive behavior support. School Psychology Review, 35(2), 245−259. https://doi.org/10.1080/02796015.2006.12087989
58.
SuppleeL. H.MeyerA. L. (2015). The intersection between prevention science and evidence-based policy: How the SPR evidence standards support human services prevention programs. Prevention Science, 16(7), 938−942. https://doi.org/10.1007/s11121-015-0590-7
59.
TibbitsM. K.BumbargerB. K.KylerS. J.PerkinsD. F. (2010). Sustaining evidence-based interventions under real-world conditions: Results from a large-scale diffusion project. Prevention Science, 11(3), 252−262. https://doi.org/10.1007/s11121-010-0170-9
60.
WalkerD.CartaJ. J.GreenwoodC. R.BuzhardtJ. F. (2008). The use of individual growth and developmental indicators for progress monitoring and intervention decision making in early education. Exceptionality, 16(1), 33−47. https://doi.org/10.1080/09362830701796784
61.
YsseldykeJ.BoltD. M. (2007). Effect of technology-enhanced continuous progress monitoring on math achievement. School Psychology Review, 36(3), 453–467. https://doi.org/10.1080/02796015.2007.12087933
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
