Discrete trial training is a popular teaching method for individuals with autism, but it is not easily implemented with fidelity due to its complexity. This is the first meta-analysis of single-case experimental design studies to quantify the impact of behavioral skills training on individuals’ ability to implement discrete trials with fidelity. Furthermore, this meta-analysis examines the four training methods that make up behavioral skills training—feedback, instruction, modeling, and rehearsal—to determine the “active ingredients” of behavioral skills training. A total of 46 single-case experimental design studies are included in this meta-analysis. Hierarchical linear modeling, which has the ability to analyze clustered data, is the meta-analytic technique used to estimate the effectiveness of behavioral skills training across studies. Results show that behavioral skills training has a statistically significant positive effect on discrete trial training implementation fidelity; therefore, behavior skills training is recommended for discrete trial training implementation instruction.
*ArnalL.FazzioD.MartinG. L.YuC. T.KeilbackL.StarkeM. (2007). Instructing university students to conduct discrete-trials teaching with confederates simulating children with Autism. Developmental Disabilities Bulletin, 35(1), 131–147.
2.
BartonE. E.PustejovskyJ. E.MagginD. M.ReichowB. (2017). Technology-aided instruction and intervention for students with ASD: A meta-analysis using novel methods of estimating effect sizes for single-case research. Remedial and Special Education, 38(6), 371–386. https://doi.org/10.1177/0741932517729508
3.
*BelfioreP. J.FrittsK. M.HermanB. C. (2008). Using self-monitoring to enhance discrete trial. Focus on Autism and Other Developmental Disabilities, 23(2), 95–102.
4.
BrockM. E.Cannella-MaloneH. I.SeamanR. L.AndzikN. R.SchaeferJ. M.PageJ. E.BarczakM.DuekerS. A. (2017). Findings across practitioner training studies in special education: A comprehensive review and meta-analysis. Exceptional Children, 84(1), 7–26.
5.
BrockM. E.CarterE. W. (2016). Efficacy of teachers training paras to implement peer support arrangements. Exceptional Children, 82, 354–371. https://doi.org/10.1177/0014402915585564
6.
*CardinalJ. R.GabrielsenT. P.YoungE. L.HansenB. D.KellemsR.HochH.Nicksic-SpringerT.KnorrJ. (2017). Discrete trial teaching interventions for students with autism. Journal of Special Education Technology, 32(3), 138–148.
7.
CarrollR. A.KodakT.FisherW. W. (2013). An evaluation of programmed treatment-integrity errors during discrete-trial instruction. Journal of Applied Behavior Analysis, 46(2), 379–394.
8.
*CataniaC. N.AlmeidaD.Liu-ConstantB.DiGennaro ReedF. D. (2009). Video modeling to train staff to implement discrete-trial instruction. Journal of Applied Behavior Analysis, 42(2), 387–392.
9.
*ClaytonM.HeadleyA. (2019). The use of behavioral skills training to improve staff performance of discrete trial training. Behavioral Interventions, 34(1), 136–143.
10.
*CowartJ. D.IwataB. A.PoynterH. (1984). Generalization and maintenance in training parents of the mentally retarded. Applied Research in Mental Retardation, 5(2), 233–244.
11.
Day-WatkinsJ.PallathraA. A.ConnellJ. E.BrodkinE. S. (2018). Behavior skills training with voice-over video modeling. Journal of Organizational Behavior Management, 38(2–3), 258–273. https://doi.org/10.1080/01608061.2018.1454871
12.
*DibN.SturmeyP. (2007). Reducing student stereotypy by improving teachers’ implementation of discrete-trial teaching. Journal of Applied Behavior Analysis, 40(2), 339–343.
13.
*DownsA.DownsR.RauK. (2008). Effects of training and feedback on discrete trial teaching skills and student performance. Research in Developmental Disabilities, 29, 235–246.
14.
*EidA. M.AljaserS. M.AlSaudA. N.AsfahaniS. M.AlhaqbaniO. A.MohtasibR. S.AldhalaanH. M.FrylingM. (2017). Training parents in Saudi Arabia to implement discrete trial teaching with their children with autism spectrum disorder. Behavior Analysis in Practice, 10(4), 402–406.
15.
FazzioD.ArnalL.MartinG. (2007). Discrete-Trials Teaching Evaluation Form (DTTEF). Unpublished Scoring Manual.
16.
*FazzioD.MartinG. L.ArnalL.YuD. C. T. (2009). Instructing university students to conduct discrete-trials teaching with children with autism. Research in Autism Spectrum Disorders, 3, 57–66.
17.
*FetherstonA.SturmeyP. (2014). The effects of behavioral skills training on instructor and learner behavior across responses and skill sets. Research in Developmental Disabilities, 35(2), 541–562.
18.
*GarlandK. V.VasquezE.PearlC. (2012). Efficacy of individualized clinical coaching in a virtual reality classroom for increasing teachers’ fidelity of implementation of discrete trial teaching. Education and Training in Autism and Developmental Disabilities, 47(4), 502–515.
19.
*GerencserK. R.HigbeeT. S.ContrerasB. P.PellegrinoA. J.GunnS. L. (2018). Evaluation of interactive computerized training to teach paraprofessionals to implement errorless discrete trial instruction. Journal of Behavioral Education, 27(4), 461–487.
20.
*GilliganK.LuiselliJ.PaceG. (2007). Training paraprofessional staff to implement discrete trial instruction: Evaluation of a practical performance feedback intervention. The Behavior Therapist, 30(3), 63–66. https://psycnet.apa.org/record/2007-11699-002
21.
HenricksonM.RappJ.AshbeckH. (2015). Teaching with massed versus interspersed trials: Effects on acquisition, maintenance, and problem behavior. Behavioral Interventions, 30, 36–50.
22.
HeyvaertM.MoeyaertM.VerkempynckP.Van den NoortgateW.VervloetM.UgilleM.OnghenaP. (2017). Testing the intervention effect in single-case experiments: A Monte Carlo simulation study. Journal of Experimental Education, 85(2), 175–196.
23.
*HigbeeT.AportaA. P.ResendeA.NogueiraM.GoyosC.PollardJ. S. (2016). Interactive computer training to teach discrete-trial instruction to undergraduates and special educators in Brazil: A replication and extension. Journal of Applied Behavior Analysis, 49(4), 780–793.
24.
JenkinsS. R.HirstJ. M.DiGennaro ReedF. D. (2015). The effects of discrete-trial training commission errors on learner outcomes: An extension. Journal of Behavioral Education, 24(2), 196–209. https://doi.org/10.1007/s10864-014-9215-7
25.
*JullS.MirendaP. (2016). Effects of a staff training program on community instructors’ ability to teach swimming skills to children with autism. Journal of Positive Behavior Interventions, 18(1), 29–40. https://doi.org/10.1177/1098300715576797
26.
*KoegelR. L.GlahnT. J.NieminenG. S. (1978). Generalization of parent-training results. Journal of Applied Behavior Analysis, 11(1), 95–109. https://doi.org/10.1901/jaba.1978.11-95
27.
*KoegelR. L.RussoD. C.RincoverA. (1977). Assessing and training teachers in the generalized use of behavior modification with autistic children. Journal of Applied Behavior Analysis, 10(2), 197–205. https://doi.org/10.1901/jaba.1977.10-197
28.
LaBrotZ. C.RadleyK. C.DartE. H.MooreJ. W.CavellH. J. (2018). A component analysis of behavioral skills training for effective instruction delivery. Journal of Family Psychotherapy, 29, 122–141.
29.
*LafasakisM.StrumeyP. (2007). Training parent implementation of discrete-trial teaching: Effects on generalization of parent teaching and child correct responding. Journal of Applied Behavior Analysis, 40(4), 685–689.
30.
LeafJ.CihonJ.LeafR.McEachinJ.TaubmanM. (2016). A progressive approach to discrete trial teaching: Some current guidelines. International Electronic Journal of Elementary Education, 9(2), 361–372.
31.
LeafJ. B.AljohaniW. A.MilneC. M.FergusonJ. L.CihonJ. H.Oppenheim-LeafM. L.McEachinJ.LeafR. (2019). Training behavior change agents and parents to implement discrete trial teaching: A literature review. Review Journal of Autism and Developmental Disorders, 6(1), 26–39. https://doi.org/10.1007/s40489-018-0152-6
32.
LeafJ. B.LeafR.McEachinJ.CihonJ. H.FergusonJ. L. (2018). Advantages and challenges of a home and clinic-based model of behavioral intervention for individuals diagnosed with autism spectrum disorder. Journal of Autism and Developmental Disorders, 48(6), 2258–2266. https://doi.org/10.1007/s10803-017-3443-3
33.
*LeblancM.RicciardiJ. N.LuiselliJ. K. (2005). Improving discrete trial instruction by paraprofessional staff through an abbreviated performance feedback intervention. Education and Treatment of Children, 28(1), 76–82.
34.
LedfordJ. R.LaneJ. D.ZimmermanK. N.ChazinK. T.AyresK. A. (2016, April). Single case analysis and review framework (SCARF). http://ebip.vkcsites.org/scarf/
35.
*LermanD.HawkinsL.HoffmanR.CaccavaleM. (2013). Training adults with an autism spectrum disorder to conduct discrete-trial training for young children with autism: A pilot study. Journal of Applied Behavior Analysis, 46(2), 465–478. https://doi.org/10.1002/jaba.50
36.
LermanD. C.ValentinoA. L.LeBlancL. A. (2016). Discrete trial training. In LangR.HancockT. B.SinghN. N. (Eds.), Early intervention for young children with autism spectrum disorder (pp. 47–83). Springer International.
37.
MadzharovaM. S.SturmeyP.JonesE. A. (2012). Training staff to increase manding in students with autism: Two preliminary case studies. Behavioral Interventions, 27, 224–235.
38.
MajdalanyL.WilderD.GreifA.MathisenD.SainiV. (2014). Comparing massed-trial instruction, distributed-trial instruction, and task interspersal to teach tacts to children with autism spectrum disorders. Journal of Applied Behavior Analysis, 47(3), 657–662.
39.
*MasonR. A.SchnitzA. G.WillsH. P.RosenbloomR.KampsD. M.BastD. (2017). Impact of a teacher-as-coach model: Improving paraprofessionals fidelity of implementation of discrete trial training for students with moderate-to-severe developmental disabilities. Journal of Autism and Developmental Disorders, 47(6), 1696–1707.
40.
*McKenneyE.BristolR. (2015). Supporting intensive interventions for students with autism spectrum disorder: Performance feedback and discrete trial teaching. School Psychology Quarterly, 30(1), 8–22.
41.
*McKenneyE. L. W.PageV.LakotaJ.NiekraN.ThompsonS. J. (2019). Supporting integrity of discrete trial teaching via tiered consultation: A pilot study. Journal of Applied School Psychology, 35(1), 52–74. https://doi.org/10.1080/15377903.2018.1493555
42.
*McKinneyT.VasquezE. (2014). There’s a bug in your ear! Using technology to increase the accuracy of DTT implementation. Education and Training in Autism and Developmental Disabilities, 49, 594–601.
43.
MoeyaertM.MagginD.VerkuilenJ. (2016). Reliability, validity, and usability of data extraction programs for single-case research designs. Behavior Modification, 40(6), 874–900. https://doi.org/10.1177/0145445516645763
44.
MoherD.LiberatiA.TetzlaffJ.AltmanD. G. (2009). Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. BMJ, 6(7), 1–6.
45.
MorganR.SalzbergC. (1992). Effects of video-assisted training on employment-related social skills of adults with severe mental retardation. Journal of Applied Behavior Analysis, 25, 365–383.
46.
NosikM. R.WilliamsW. L. (2011). Component evaluation of a computer based format for teaching discrete trial and backward chaining. Research in Developmental Disabilities, 32(5), 1694–1702. https://doi.org/10.1016/j.ridd.2011.02.02
47.
*NosikM. R.WilliamsW. L.GarridoN.LeeS. (2013). Comparison of computer based instruction to behavior skills training for teaching staff implementation of discrete-trial instruction with an adult with autism. Research in Developmental Disabilities, 34(1), 461–468.
48.
*O’GuinD. (2010). Training paraprofessionals to implement a discrete trial language intervention for children with autism [Unpublished doctoral dissertation]. Oklahoma State University, Stillwater.
49.
*ParnellA. M.LorahE. R.KarnesA.Schaefer-WhitbyP. (2017). Effectiveness of job aids and post performance review on staff implementation of discrete trial instruction. Journal of Organizational Behavior Management, 37(2), 207–220.
50.
PellecchiaM.ConnellJ. E.BeidasR. S.XieM.MarcusS. C.MandellD. S. (2015). Dismantling the active ingredients of an intervention for children with autism. Journal of Autism and Developmental Disorders, 45(9), 2917–2927.
51.
*PollardJ. S.HigbeeT. S.AkersJ. S.BrodheadM. T. (2014). An evaluation of interactive computer training to teach instructors to implement discrete trials with children with autism. Journal of Applied Behavior Analysis, 47(4), 765–776.
52.
*RadleyK. C.DartE. H.FurlowC. M.NessE. J. (2015). Peer-mediated discrete trial training within a school setting. Research in Autism Spectrum Disorders, 9, 53–67.
53.
ReedF. D. D.HirstJ. M.HowardV. J. (2013). Empirically supported staff selection, training, and management strategies. In ReedD. D.DiGennaroR. F. D.LuiselliJ. K. (Eds.), Handbook of crisis intervention and developmental disabilities (pp. 71–85). Springer.
54.
ReichowB.BartonE. E.MagginD. M. (2018). Development and applications of the single-case design risk of bias tool for evaluating single-case design research study reports. Research in Developmental Disabilities, 79, 53–64. https://doi.org/10.1016/j.ridd.2018.05.008
RStudio Team. (2015). RStudio: Integrated development for R. RStudio, Inc [Computer software]. http://www.rstudio.com
57.
*SalemS.FazzioD.ArnalL.FregeauP.ThomsonK.MartinG. L.YuC. T. (2009). A self-instructional package for teaching university students to conduct discrete-trials teaching with children with autism. Journal on Developmental Disabilities, 15(1), 21–29.
58.
*SarokoffR. A.SturmeyP. (2004). The effects of behavioral skills training on staff implementation of discrete-trial teaching. Journal of Applied Behavior Analysis, 37, 535–538.
59.
*SarokoffR. A.SturmeyP. (2008). The effects of instructions, rehearsal, modeling, and feedback on acquisition and generalization of staff use of discrete trial teaching and student correct responses. Research in Autism Spectrum Disorders, 2(1), 125–136.
60.
*SernaR. W.ForanM. M.CookeC.HurdK. E.TelloA. J.VangapalliR.HamadC. D. (2016). Teaching discrete trial training. Journal of Special Education Technology, 31(1), 39–49.
61.
*SevertsonJ. M.CarrJ. E. (2012). Training novice instructors to implement errorless discrete-trial teaching: A sequential analysis. Behavior Analysis in Practice, 5(2), 13–23.
62.
ShadishW. R.SullivanK. J. (2011). Characteristics of single-case designs used to assess intervention effects in 2008. Behavior Research Methods, 43, 971–980.
63.
ShapiroM.KazemiE. (2017). A review of training strategies to teach individuals implementation of behavioral interventions. Journal of Organizational Behavior Management, 37(1), 32–62.
64.
SkinnerB. F. (1953). Science and human behavior. Macmillan.
65.
SolomonB. G.KleinS. A.PolityloB. C. (2012). The effect of performance feedback on teachers’ treatment. School Psychology Review, 41(2), 160–175.
66.
*SubramaniamS.BrunsonL. Y.CookJ. E.LarsonN. A.PoeS. G.St PeterC. C. (2017). Maintenance of parent-implemented discrete-trial instruction during videoconferencing. Journal of Behavioral Education, 26(1), 126. https://doi.org/10.1007/s10864-016-9258-z
67.
*ThiessenC.FazzioD.ArnalL.MartinG. L.YuC. T.KeilbackL. (2009). Evaluation of a self-instructional manual for conducting discrete-trials teaching with children with autism. Behavior Modification, 33(3), 360–373.
68.
*ThomasB. R. (2013). Effects of conducting peer behavioral observations on the observer’s correct use of discrete trial teaching procedures. Research in Developmental Disabilities, 34(7), 2143–2148. https://doi.org/10.1016/j.ridd.2013.03.033
69.
ThomsonK.MartinG. L.ArnalL.FazzioD.YuC. T. (2009). Research in autism spectrum disorders instructing individuals to deliver discrete-trials teaching to children with autism spectrum disorders: A review. Research in Autism Spectrum Disorders, 3, 590–606.
70.
*ThomsonK. M.MartinG. L.FazzioD.SalemS.YoungK.YuC. T. (2012). Evaluation of a self-instructional package for teaching tutors to conduct discrete-trials teaching with children with autism. Research in Autism Spectrum Disorders, 6(3), 1073–1082.
71.
Van den NoortgateW.OnghenaP. (2003). Hierarchical linear models for the quantitative integration of effect sizes in single-case research. Behavior Research Methods, Instruments & Computers, 35(1), 1–10.
72.
ViechtbauerW. (2010). Conducting meta-analyses in R with the metafor package. Journal of Statistical Software, 36(3), 1–48. http://www.jstatsoft.org/v36/i03/
73.
*VladescuJ. C.CarrollR.PadenA.KodakT. M. (2012). The effects of video modeling with voiceover instruction on accurate implementation of discrete-trial instruction. Journal of Applied Behavior Analysis, 45(2), 419–423.
74.
*Ward-HornerJ.SturmeyP. (2008). The effects of general-case training and behavioral skills training on the generalization of parents’ use of discrete-trial teaching, child correct responses, and child. Behavioral Interventions, 284, 271–284.
75.
Ward-HornerJ.SturmeyP. (2012). Component analysis of behavior skills training in functional analysis. Behavioral Interventions, 27(2), 75–92. https://doi.org/10.1002/bin.1339
76.
WestE. A.McCollowM.UmbargerG.KidwellJ.CoteD. L. (2013). Current status of evidence-based practice for students with intellectual disability and autism spectrum disorders. Education and Training in Autism and Developmental Disabilities, 48, 443–455.
77.
What Works Clearinghouse (WWC). (2020). What Works Clearinghouse standards handbook, Version 4.1. U.S. Department of Education, Institute of Education Sciences, National Center for Education Evaluation and Regional Assistance. https://ies.ed.gov/ncee/wwc/handbooks
78.
*WightmanJ.BorisA.ThomsonK.MartinG.FazzioD.YuC. T. (2012). Evaluation of a self-instructional package for teaching tutors to conduct discrete-trials teaching with children with autism. Journal of Developmental Disabilities, 18(3), 33–34.
79.
*YoungK. L.BorisA. L.ThomsonK. M.MartinG. L.YuC. T. (2012). Evaluation of a self-instructional package on discrete-trials teaching to parents of children with autism. Research in Autism Spectrum Disorders, 6, 1321–1330.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
