Evidenced-based mathematics interventions are critical for supporting students with mathematics difficulties. In research and practice, collecting implementation fidelity is important for ensuring that all the core components of the intervention are implemented as designed. Historically, implementation fidelity has been defined as multifaceted, including examinations of adherence, instructional quality, and student engagement, though mathematics intervention studies rarely report on fidelity components outside of adherence. The current study examined the relationships between these different components of fidelity and whether they are associated with student mathematics outcomes and intervention group size within the context of a first-grade mathematics intervention. Findings revealed relationships between components of fidelity with student’s initial mathematics skill; however, no relationship was observed between fidelity components and student mathematics growth. Findings for group size were mixed. Limitations, implications for research and practice, and future directions are discussed.
AbryT.HullemanC. S.Rimm-KaufmanS. E. (2015). Using indices of fidelity to intervention core components to identify program active ingredients. American Journal of Evaluation, 36(3), 320–338. https://doi.org/10.1177/1098214014557009
2.
BakerS.GerstenR.LeeD. (2002). A synthesis of empirical research on teaching mathematics to low-achieving students. The Elementary School Journal, 103(1), 51–73. https://doi.org/10.1086/499715
3.
BosS. E.PowellS. R.MaddoxS. A.DoablerC. T. (2022). A synthesis of the conceptualization and measurement of implementation fidelity in mathematics intervention research. Journal of Learning Disabilities, 56(2), 95–115. https://doi.org/10.1177/00222194211065498
4.
BryantD. P.PfannenstielK. H.BryantB. R.RobertsG.FallA.NozariM.LeeJ. (2021). Improving the mathematics performance of second-grade students with mathematics difficulties through an early numeracy intervention. Behavior Modification, 45(1), 99–121. https://doi.org/10.1177/0145445519873651
5.
CapinP.RobertsG.ClemensN. H.VaughnS. (2022). When treatment adherence matters: Interactions among treatment adherence, instructional quality, and student characteristics on reading outcomes. Reading Research Quarterly, 57(2), 753–774. https://doi.org/10.1002/rrq.442
6.
CarrollC.PattersonM.WoodS.BoothA.RickJ.BalainS. (2007). A conceptual framework for implementation fidelity. Implementation Science, 2, Article 40. https://doi.org/10.1186/1748-5908-2-40
7.
ClarkeB.DoablerC. T.FienH.SmolkowskiK. (2016–2020). A randomized control trial of a Tier 2 first grade mathematics intervention (Project no. R324A160046, NCSER: Mathematics, Efficacy and Replication, Goal 3, CFDA no. 84.324). Institute of Education Sciences: Special Education Research. http://ies.ed.gov/funding/grantsearch/details.asp?ID=1815
8.
ClarkeB.DoablerC. T.Strand CaryM.KostyD.BakerS.FienH.SmolkowskiK. (2014). Preliminary evaluation of a tier 2 mathematics intervention for first-grade students: Using a theory of change to guide formative evaluation activities. School Psychology Review, 43(2), 160–178. https://doi.org/10.1080/02796015.2014.12087442
9.
ClarkeB.DoablerC. T.SutherlandM.KostyD.TuturaJ.SmolkowskiK. (2022). Examining the impact of a first-grade whole number intervention by group size. Journal of Research on Educational Effectiveness, 16, 326–349. https://doi.org/10.1080/19345747.2022.2093299
10.
ClarkeB.RolfhusE.DiminoJ.GerstenR. M. (2012). Assessing student proficiency of number sense (ASPENS). Cambium Learning Group, Sopris Learning.
DaneA. V.SchneiderB. H. (1998). Program integrity in primary and early secondary prevention: Are implementation effects out of control?Clinical Psychology Review, 18(1), 23–45. https://doi.org/10.1016/S0272-7358(97)00043-3
14.
DoablerC. T.ClarkeB. (2012). Quality of explicit mathematics instruction [Unpublished observation instrument]. Center on Teaching and Learning, University of Oregon.
15.
DoablerC. T.ClarkeB.KostyD.FienH.SmolkowskiK.LiuM.BakerS. (2021a). Measuring the quantity and quality of explicit instructional interactions in an empirically validated tier 2 kindergarten mathematics intervention. Learning Disability Quarterly, 44(1), 50–60. https://doi.org/10.1177/0731948719884921
16.
DoablerC. T.ClarkeB.KostyD.SmolkowskiK.Kurtz-NelsonE.FienH.BakerS. K. (2019). Building number sense among English learners: A multisite randomized controlled trial of a Tier 2 kindergarten mathematics intervention. Early Childhood Research Quarterly, 47, 432–444. https://doi.org/10.1016/j.ecresq.2018.08.004
17.
DoablerC. T.ClarkeB.KostyD.TurturaJ. E.SutherlandM.MaddoxS. A.SmolkowskiK. (2021b). Using direct observation to document “practice-based evidence” of evidence-based mathematics instruction. Journal of Learning Disabilities, 51(1), 20–35. https://doi.org/10.1177/0022219420911375
18.
FogartyM.OslundE.SimmonsD.DavisJ.SimmonsL.AndersonL.ClemensN.RobertsG. (2014). Examining the effectiveness of a multicomponent reading comprehension intervention in middle schools: A focus on treatment fidelity. Educational Psychology Review, 26, 425–449. https://doi.org/10.1007/s10648-014-9270-6
19.
FredricksJ. A.BlumenfeldP. C.ParisA. H. (2004). School engagement: Potential of the concept, state of the evidence. Review of Educational Research, 74(1), 59–109.
20.
FuchsL. S.Newman-GoncharR.SchumacherR.DoughertyB.BuckaN.KarpK. S.WoodwardJ.ClarkeB.JordanN. C.GerstenR.JayanthiM.KeatingB.MorganS. (2021). Assisting students struggling with mathematics: Intervention in the elementary grades (WWC 2021006). National Center for Education Evaluation and Regional Assistance, Institute of Education Sciences, U.S. Department of Education. http://whatworks.ed.gov/
21.
GerstenR.BeckmannS.ClarkeB.FoegenA.MarshL.StarJ. R.WitzelB. (2009). Assisting students struggling with mathematics: Response to Intervention (RtI) for elementary and middle schools (NCEE 2009-4060). National Center for Education Evaluation and Regional Assistance, Institute of Education Sciences, U.S. Department of Education. http://ies.ed.gov/ncee/wwc/publications/practiceguides/
22.
GinsburgH. P.BaroodyA. J. (2003). Test of early mathematics ability (TEMA-3) (3rd ed.). ProEd.
23.
Kwan LoC.Foon HewK. (2021). Student engagement in mathematics flipped classrooms: Implications of journal publications from 2011 to 2020. Frontiers in Psychology, 12, Article 672610. https://doi.org/10.3389/fpsyg.2021.672610
24.
LekwaA. J.ReddyL. A.SchernoffE. S. (2019). Measuring teacher practices and student academic engagement: A convergent validity study. School Psychology, 34(1), 109–118. https://doi.org/10.1037/spq0000268
25.
NelsonP. M.PullesS. M.ParkerD. C.KlaftJ. (2020). Implementation fidelity for math intervention: Basic quality ratings to supplement adherence. School Psychology, 35(1), 72–79. https://doi.org/10.1037/spq0000338
26.
O’DonnellC. L. (2008). Defining, conceptualizing, and measuring fidelity of implementation and its relationship to outcomes in K–12 curriculum intervention research. Review of Educational Research, 78(1), 33–84. https://doi.org/10.3102/003465430731379
27.
RosnowR. L.RosenthalR. (2003). Effect sizes for experimenting psychologists. Canadian Journal of Experimental Psychology, 57(3), 221–237. https://doi.org/10.1037/h0087427
28.
SanettiL. M. H.KratochwillT. R. (2009). Toward developing a science of treatment integrity: Introduction to the special series. School Psychology Review, 38(4), 445–459.
29.
StainsM.VickreyT. (2017). Fidelity of implementation: An overlooked yet critical construct to establish effectiveness of evidence-based instructional practices. CBE Life Sciences Education, 16(1), Article rm1. https://doi.org/10.1187/cbe.16-03-0113
30.
SutherlandM.ClarkeB.KostyD. B.BakerS. K.DoablerC. T.SmolkowskiK.FienH.GoodeJ. (2022). Investigating the interaction between teacher mathematics content knowledge and curriculum on instructional behaviors and student achievement. The Elementary School Journal, 123(2), 292–317. https://doi.org/10.1086/721877
31.
Van DijkW.GageN. A.Grasley-BoyN. (2019). The relation between classroom management and mathematics achievement: A multilevel structural equation model. Psychology in the Schools, 56, 1173–1186. https://doi.org/10.1002/pits.22254
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
