Single-case design has a long history of use for assessing intervention effectiveness for children with disabilities. Although these designs have been widely employed for more than 50 years, recent years have been especially dynamic in terms of growth in the use of single-case design and application of standards designed to improve the validity and applicability of findings. This growth expanded possibilities and inspired new questions about the contributions this methodology can make to generalizable knowledge about intervention in special education. In this article, we discuss and extend previous standards for studies using single-case designs. We identify new suggestions for internal validity, generality and acceptability, and reporting. We also provide considerations for single-case synthesis and discuss the complexities of assessing accumulating evidence for a given practice.
Get full access to this article
View all access options for this article.
References
1.
AllisonD. B.GormanB. S. (1994). “Make things as simple as possible, but no simpler.” A rejoinder to Scruggs and Mastropieri. Behaviour Research and Therapy, 32(8), 885–890. https://doi.org/10.1016/0005-7967(94)90170-8
2.
American Psychological Association Presidential Task Force on Evidence-Based Practice. (2006). Evidence-based practice in psychology. American Psychologist, 61(4), 271–285. https://doi.org/10.1037/0003-066X.61.4.271
3.
BuryS. M.JellettR.SpoorJ. R.HedleyD. (2020). “It defines who I am” or “It’s something I have”: What language do [autistic] Australian adults [on the autism spectrum] prefer?Journal of Autism and Developmental Disorders. Advance online publication. https://doi.org/10.1007/s10803-020-04425-3
4.
BuskP. L.SerlinR. C. (1992). Meta-analysis for single-case research. In KratochwillT. R.LevinJ. R. (Eds.), Single-case research design and analysis: New directions for psychology and education (pp. 187–212). Lawrence Erlbaum.
5.
ContrerasB.HoffmannA.SlocumT. (2021). Ethical behavior analysis: evidence-based practice as a framework for ethical decision making. Behavior Analysis in Practice, 15(3), 619–634. https://doi.org/10.1007/s40617-021-00658-5
6.
CookB. G.FlemingJ. I.HartS. A.LaneK. L.TherrienW. J.van DijkW.WilsonS. E. (2021a). A How-To Guide for Open-Science Practices in Special Education Research. Remedial and Special Education, 43(4), 270–280. https://doi.org/10.1177/07419325211019100
7.
CookB. G.JohnsonA. H.MagginD. M.TherrienW. J.BartonE. E.LloydJ. W.TraversJ. C. (2021b). Open science and single-case design research. Remedial and Special Education, 43(5), 359–369. https://doi.org/10.1177/0741932521996452
8.
CooperH. M. (2010). Research synthesis and meta-analysis (4th ed.). Sage.
9.
CorrC.SnodgrassM. R.GreeneJ. C.MeadanH.SantosR. M. (2020). Mixed methods in early childhood special education research: Purposes, challenges, and guidance. Journal of Early Intervention, 42(1), 20–30. https://doi.org/10.1177/1053815119873096
10.
DowdyA.TincaniM.SchneiderW. J. (2020). Evaluation of publication bias in response interruption and redirection: A meta–analysis. Journal of Applied Behavior Analysis, 53(4), 2151–2171. https://doi.org/10.1002/jaba.724
11.
EdgingtonE. S. (1983). Response-Guided experimentation. Contemporary Psychology: A Journal of Reviews, 28(1), 64–65. https://doi.org/10.1037/021569
12.
FerronJ.GoldsteinH.OlszewskiA.RohrerL. (2020). Indexing effects in single-case experimental designs by estimating the percent of goal obtained. Evidence-Based Communication Assessment and Intervention, 14(1–2), 6–27. https://doi.org/10.1080/17489539.2020.1732024
13.
GageN. A.CookB. G.ReichowB. (2017). Publication bias in special education meta-analyses. Exceptional Children, 83(4), 428–445. https://doi.org/10.1177/0014402917691016
14.
HayesS. C.KohlenbergB. S.MelanconS. M. (1989). Avoiding and altering rule-control as a strategy of clinical intervention. In Rule-governed behavior (pp. 359–385). Boston, MA: Springer.
15.
HayesS. C.ToarminoD. (1995). If behavioral principles are generally applicable, why is it necessary to understand cultural diversity? The Behavior Therapist, 18(1), 21–23.
16.
HornerR. H.CarrE. G.HalleJ.McGeeG.OdomS.WoleryM. (2005). The use of single-subject research to identify evidence-based practice in special education. Exceptional Children, 71(2), 165–179. https://doi.org/10.1177/001440290507100203
17.
JamshidiL.HeyvaertM.DeclercqL.Fernández-CastillaB.FerronJ.MoeyaertM.Van den NoortgateW. (2018). Methodological quality of meta-analyses of single-case experimental studies. Research in Developmental Disabilities, 79, 97–115. https://doi.org/10.1016/j.ridd.2017.12.016
JohnstonJ. M.PennypackerH. S. (2010). Strategies and tactics of behavioral research. Routledge.
20.
JooS.-H.FerronJ. M.BeretvasS. N.MoeyaertM.Van den NoortgateW. (2018). The impact of response-guided baseline phase extensions on treatment effect estimates. Research in Developmental Disabilities, 79, 77–87. https://doi.org/10.1016/j.ridd.2017.12.018
21.
KaiserA. P. (2014). Using single-case research designs in programs of research. In KratochwillT. R.LevinJ. R. (Eds.), Single-case intervention research: Methodological and statistical advances (pp. 309–323). American Psychological Association.
22.
KazdinA. E. (1978). Methodological and interpretive problems of single-case experimental designs. Journal of Consulting and Clinical Psychology, 46(4), 629.
23.
KazdinA. E. (2016). Single-case research designs: Methods for clinical and applied settings. Oxford University Press.
24.
KennyL.HattersleyC.MolinsB.BuckleyC.PoveyC.PellicanoE. (2016). Which terms should be used to describe autism? Perspectives from the UK autism community. Autism, 20(4), 442–462. https://doi.org/10.1177/1362361315588200
25.
KratochwillT. R.HornerR. H.LevinJ. R.MachalicekW.FerronJ.JohnsonA. (2021). Single-case design standards: An update and proposed upgrades. Journal of School Psychology, 89, 91–105. https://doi.org/10.1016/j.jsp.2021.10.006
26.
LambertJ. M.SandstromA.HodappR.CopelandB. A.ParanczakJ. L.MacdonaldM. J.Houchins-JuarezN. J. (2022). Revisiting the social validity of services rendered through a university-based practicum addressing challenging behavior. Journal of Applied Behavior Analysis, 55(4), 1220–1238. https://doi.org/10.1002/jaba.939
27.
LedfordJ. R.GastD. L. (Eds.). (2018). Single case research methodology: Applications in special education and behavior sciences. Routledge.
28.
LedfordJ. R.LaneJ. D.SeveriniK. E. (2018). Systematic use of visual analysis for assessing outcomes. Brain Impairment, 19(1), 4–17. https://doi.org/10.1017/brimp.2017.16
29.
LedfordJ. R.LambertJ. M.BartonE. E.AyresK. M. (2021a). The evidence base for interventions for individuals with ASD: A call to improve practice conceptualization and synthesis. Focus on Autism and Other Developmental Disabilities, 36(3), 135–147. https://doi.org/10.1177/10883576211023349
30.
LedfordJ. R.TrumpC.ChazinK. T.WindsorS. A.EylerP. B.WunderlichK. (2021b). Systematic review of interruption and redirection procedures for autistic individuals. Advance online publication. Behavioral Interventions. https://doi.org/10.1002/bin.1905
31.
ManolovR.TaniousR.OnghenaP. (2021). Quantitative techniques and graphical representations for interpreting results from alternating treatment design. Perspectives on Behavior Science, 45(1), 259–294. https://doi.org/10.1007/s40614-021-00289-9
32.
Marks-AnglinA.ChenY. (2020). A historical review of publication bias. Research Synthesis Methods, 11(6), 725–742. https://doi.org/10.1002/jrsm.1452
33.
McClainM. B.CallanG. L.HarrisB.FloydR. G.HaverkampC. R.GolsonM. E.LonghurstD. N.BenallieK. J. (2021). Methods for addressing publication bias in school psychology journals. Journal of School Psychology, 84, 74–94. https://doi.org/10.1016/j.jsp.2020.11.002
34.
MorrisC.DetrickJ. J.PetersonS. (2021). Participant assent in behavior analytic research: Considerations for participants with autism and developmental disabilities. Journal of Applied Behavior Analysis, 54(4), 1300–1316. https://doi.org/10.1002/jaba.859
35.
ParkerR. I.VannestK. (2009). An improved effect size for single-case research: Nonoverlap of all pairs. Behavior Therapy, 40(4), 357–367. https://doi.org/10.1016/j.beth.2008.10.006
36.
PritchettM.Ala’i-RosalesS.CruzA. R.CihonT. M. (2021). Social justice is the spirit and aim of an applied science of human behavior: Moving from colonial to participatory research practices. Behavior Analysis in Practice. https://doi.org/10.1007/s40617-021-00591-7
37.
PustejovskyJ. E. (2018). Using response ratios for meta-analyzing single-case designs with behavioral outcomes. Journal of School Psychology, 68, 99–112. https://doi.org/10.1016/j.jsp.2018.02.003
38.
PustejovskyJ. E. (2019). Procedural sensitivities of effect sizes for single-case designs with directly observed behavioral outcome measures. Psychological Methods, 24(2), 217–235. https://doi.org/10.1037/met0000179
39.
PustejovskyJ. E.FerronJ. (2017). Research synthesis and meta-analysis of single-case designs. In Handbook of special education (2nd ed., p. 63). Routledge.
40.
ReppA. C.DeitzD. E.BolesS. M.DeitzS. M.ReppC. F. (1976). Differences among common methods for calculating interobserver agreement. Journal of Applied Behavior Analysis, 9(1), 109. https://doi.org/10.1901/jaba.1976.9-109
41.
ReppA. C.LloydJ. (1980). Evaluating educational changes with single-subject design. In GottliebJ. (Ed.), Educating mentally retarded persons in the mainstream. University Park Press.
42.
Riley-TillmanT. C.BurnsM. K.KilgusS. P. (2020). Evaluating educational interventions: Single-case design for measuring response to intervention. Guilford.
43.
RothsteinH. R.SuttonA. J.BorensteinM. (2005). Publication bias in meta-analysis. In RothsteinH. R.SuttonA. J.BorensteinM. (Eds.), Publication bias in meta-analysis: Prevention, assessment, and adjustments (pp. 1–7). Wiley.
44.
SandbankM.ChowJ.Bottema-BeutelK.WoynaroskiT. (2021). Evaluating evidence-based practice in light of the boundedness and proximity of outcomes: Capturing the scope of change. Autism Research, 14(8), 1536–1542. https://doi.org/10.1002/aur.2527
45.
ShadishW. R. (2014). Statistical analyses of single-case designs: The shape of things to come. Current Directions in Psychological Science, 23(2), 139–146. https://doi.org/10.1177/0963721414524773
46.
ShadishW. R.HedgesL. V.HornerR. H.OdomS. L. (2015). The role of between-case effect size in conducting, interpreting, and summarizing single-case research (NCER 2015–002). National Center for Education Research.
47.
ShadishW. R.HedgesL. V.PustejovskyJ. E. (2014). Analysis and meta-analysis of single-case designs with a standardized mean difference statistic: A primer and applications. Journal of School Psychology, 52(2), 123–147. https://doi.org/10.1016/j.jsp.2013.11.005
48.
ShadishW. R.ZelinskyN. A. M.VeveaJ. L.KratochwillT. R. (2016). A survey of publication practices of single-case design researchers when treatments have small or large effects. Journal of Applied Behavior Analysis, 49(3), 656–673. https://doi.org/10.1002/jaba.308
49.
ShamE.SmithT. (2014). Publication bias in studies of an applied behavior-analytic intervention: An initial analysis: Publication bias in applied behavior analysis. Journal of Applied Behavior Analysis, 47(3), 663–678. https://doi.org/10.1002/jaba.146
50.
ShogrenK. A.ScottL.HicksT.RaleyS.HagiwaraM.PaceJ.KiblenJ. (2021). Exploring self-determination outcomes of racially and ethnically marginalized students with disabilities in inclusive general education classrooms. Inclusion, 9(3), 189–205. https://doi.org/10.1352/2326-6988-9.3.189
51.
SteinbrennerJ. R.HumeK.OdomS. L.MorinK. L.NowellS. W.TomaszewskiB.SavageM. N. (2020). Evidence-based practices for children, youth, and young adults with autism. FPG Child Development Institute.
52.
SwanD. M.PustejovskyJ. E.BeretvasS. (2020). The impact of response-guided designs on count outcomes in single-case experimental design baselines. Evidence-Based Communication Assessment & Intervention, 14(1-2), 82–107. https://doi.org/10.1080/17489539.2020.1739048
53.
TincaniM.TraversJ. (2018). Publishing single-case research design studies that do not demonstrate experimental control. Remedial and Special Education, 39(2), 118–128. https://doi.org/10.1177/0741932517697447
54.
TincaniM.TraversJ. (2019). Replication research, publication bias, and applied behavior analysis. Perspectives on Behavior Science, 42(1), 59–75. https://doi.org/10.1007/s40614-019-00191-5
WhiteO. R. (1987). Some comments concerning “The Quantitative Synthesis of Single-Subject Research.”Remedial and Special Education, 8(2), 34–39. https://doi.org/10.1177/074193258700800207
58.
WolfeK.BartonE. E.MeadanH. (2019). Systematic protocols for the visual analysis of single-case research data. Behavior Analysis in Practice, 12(2), 491–502. https://doi.org/10.1007/s40617-019-00336-7
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
