A number of resources are available for evaluating the rigor of single-case designs, including the commonly used multiple baseline design. In this article, we discuss two characteristics commonly cited as necessary for the highest rigor in multiple baseline designs—concurrence and response-guided baseline condition duration. We suggest that both nonconcurrence and response-independent baseline condition duration may be appropriate in some situations. Suggestions for researchers include improved reporting and graphing. Future research is needed to determine experimental differences when these design variations are used.
BaerD. M.WolfM. M.RisleyT. R. (1968). Some current dimensions of applied behavior analysis. Journal of Applied Behavior Analysis, 1(1), Article 91. https://doi.org/10.1901/jaba.1968.1-91
2.
BarlowD. H.HersenM. (1984). Single case experimental designs. Pergamon.
3.
BartonE. E.LloydB. P.SpriggsA. D.GastD. L. (2018). Visual analysis of graphic data. In LedfordJ. R.GastD. L. (Eds.), Single case research methodology (pp. 179–214). Routledge.
4.
BrodheadM. T.KimS. Y.RispoliM. J.SipilaE. S.BakM. S. (2019). A pilot evaluation of a treatment package to teach social conversation via video-chat. Journal of Autism and Developmental Disorders, 49(8), 3316–3327. https://doi.org/10.1007/s10803-019-04055-4
5.
CarrJ. E. (2005). Recommendations for reporting multiple-baseline designs across participants. Behavioral Interventions: Theory & Practice in Residential & Community-Based Clinical Programs, 20(3), 219–224. https://doi.org/10.1002/bin.191
6.
ChristT. J. (2007). Experimental control and threats to internal validity of concurrent and nonconcurrent multiple baseline designs. Psychology in the Schools, 44(5), 451–459. https://doi.org/10.1002/pits.20237
7.
CookB.BuysseV.KlingnerJ.LandrumT.McWilliamR.TankersleyM.TestD. (2014). Council for exceptional children: Standards for evidence-based practices in special education. Teaching Exceptional Children, 46(6), 206–212. https://doi.org/10.1177/0040059914531389
8.
CookB. G.FlemingJ. I.HartS. A.LaneK. L.TherrienW. J.van DijkW.WilsonS. E. (2021a). A how-to guide for open-science practices in special education research. Remedial and Special Education. Advance online publication. https://doi.org/10.1177/07419325211019100
9.
CookB. G.JohnsonA. H.MagginD. M.TherrienW. J.BartonE. E.LloydJ. W.. . . TraversJ. C. (2021b). Open science and single-case design research. Remedial and Special Education. Advance online publication. https://doi.org/10.1177/0741932521996452
10.
CookB. G.LloydJ. W.MellorD.NosekB. A.TherrienW. J. (2018). Promoting open science to increase the trustworthiness of evidence in special education. Exceptional Children, 85(1), 104–118. https://doi.org/10.1177/0014402918793138
11.
CooperH.HedgesL. V.ValentineJ. C. (Eds.). (2019). The handbook of research synthesis and meta-analysis. Russell Sage Foundation.
12.
CooperJ. O.HeronT. E.HewardW. L. (2020). Applied behavior analysis. Pearson.
13.
GregoriE.RispoliM.LoryC.KimS.DavidM. (2022). Effects of teachers as coaches for paraprofessionals implementing functional communication training. Journal of Positive Behavior Interventions, 24(2), 133–144. https://doi.org/10.1177/1098300720983538
14.
GregoriE.RispoliM.NeelyL.LoryC.KimS. Y.DavidM. (2021). Training direct service personnel in functional communication training with adults with disabilities. Journal of Developmental and Physical Disabilities, 33, 669–692. https://doi.org/10.1007/s10882-020-09766-6
15.
HammondD.GastD. L. (2010). Descriptive analysis of single subject research designs. Education and Training in Autism and Developmental Disabilities, 45(2), 187–202. https://www.jstor.org/stable/23879806
16.
HarveyM. T.MayM. E.KennedyC. (2004). Nonconcurrent multiple baseline designs and the evaluation of educational systems. Journal of Behavioral Education, 13(4), 267–276. https://doi.org/10.1023/B:JOBE.0000044735.51022.5d
17.
HersenM.BarlowD. H. (1976). Single case experimental designs. Pergamon.
18.
HitchcockJ. H.HornerR. H.KratochwillT. R.LevinJ. R.OdomS. L.RindskopfD. M.ShadishW. R. (2014). The What Works Clearinghouse single-case design pilot standards: Who will guard the guards?Remedial and Special Education, 35(3), 145–152. https://doi.org/10.1177/0741932513518979
19.
HornerR. D.BaerD. M. (1978). Multiple-probe technique: a variation of the multiple baseline. Journal of Applied Behavior Analysis, 11(1), 189–196.
20.
JullS.MirendaP. (2016). Effects of a staff training program on community instructors’ ability to teach swimming skills to children with autism. Journal of Positive Behavior Interventions, 18(1), 29–40. https://doi.org/10.1177/1098300715576797
21.
KazdinA. E. (2016). Single-case experimental research designs. American Psychological Association.
22.
KennedyC. H. (2005). Single-case designs for educational research. Pearson.
23.
KratochwillT. R.HornerR. H.LevinJ. R.MachalicekW.FerronJ.JohnsonA. (2021). Single-case design standards: An update and proposed upgrades. Journal of School Psychology, 89, 91–105. https://doi.org/10.1016/j.jsp.2021.10.006
24.
LedfordJ. R.BartonE. E.SeveriniK. E.ZimmermanK. N. (2019a). A primer on single-case research designs: Contemporary use and analysis. American Journal on Intellectual and Developmental Disabilities, 124(1), 35–56. https://doi.org/10.1352/1944-7558-124.1.35
25.
LedfordJ. R.BartonE. E.SeveriniK. E.ZimmermanK. N.PokorskiE. A. (2019b). Visual display of graphic data in single case design studies: Systematic review and expert preference analysis. Education and Training in Autism and Developmental Disabilities, 54(4), 315–327. https://www.jstor.org/stable/26822511
26.
LedfordJ. R.ChazinK. T.LaneJ. D.ZimmermanK. N.AyresK. A. (2020). Single case analysis and review framework (SCARF). http://ebip.vkcsites.org/scarfv2
27.
LedfordJ. R.GastD. L. (Eds.). (2018). Single subject research methodology in behavioral sciences: Applications in special education and behavioral sciences. Routledge.
28.
LedfordJ. R.WhitesideE.SeveriniK. E. (2018). A systematic review of interventions for feeding-related behaviors for individuals with autism spectrum disorders. Research in Autism Spectrum Disorders, 52, 69–80. https://doi.org/10.1007/s10803-020-04582-5
29.
MagginD. M.BartonE. E.ReichowB.LaneK.ShogrenK. A. (2021). Commentary on theWhat Works Clearinghouse Standards and Procedures Handbook (v. 4.1) for the review of single case research. Remedial and Special Education. Advance online publication. https://doi.org/10.1177/07419325211051317
30.
PustejovskyJ. E.SwanD. M.EnglishK. W. (2019). An examination of measurement procedures and characteristics of baseline outcome data in single-case research. Behavior Modification. Advance online publication. https://doi.org/10.1177/0145445519864264
31.
ReichowB.BartonE.MagginD. (2018). Development and applications of the single-case design risk of bias tool for evaluating single-case design research study reports. Research in Developmental Disabilities, 79, 53–64. https://doi.org/10.1016/j.ridd.2018.05.008
32.
ShadishW. R.SullivanK. J. (2011). Characteristics of single-case designs used to assess intervention effects in 2008. Behavior Research Methods, 43(4), 971–980. https://doi.org/10.3758/s13428-011-0111-y
33.
ShadishW. R.ZelinskyN. A.VeveaJ. L.KratochwillT. R. (2016). A survey of publication practices of single-case design researchers when treatments have small or large effects. Journal of Applied Behavior Analysis, 49(3), 656–673. https://doi.org/10.1002/jaba.308
34.
ShepleyC.ZimmermanK. N.AyresK. M. (2021). Estimating the impact of design standards on the rigor of a subset of single-case research. Journal of Disability Policy Studies, 32(2), 108–118. https://doi.org/10.1177/1044207320934048
35.
SmithK. A.AyresK. A.AlexanderJ.LedfordJ. R.ShepleyC.ShepleyS. B. (2016). Initiation and generalization of self-instructional skills in adolescents with autism and intellectual disability. Journal of Autism and Developmental Disorders, 46(4), 1196–1209. https://doi.org/10.1007/s10803-015-2654-8
36.
SwanD. M.PustejovskyJ. E.BeretvasS. N. (2020). The impact of response-guided designs on count outcomes in single-case experimental design baselines. Evidence-Based Communication Assessment and Intervention, 14(1–2), 82–107. https://doi.org/10.1080/17489539.2020.1739048
37.
TateR. L.PerdicesM.RosenkoetterU.McDonaldS.TogherL.ShadishW.. . . SampsonM. (2016). The Single-Case Reporting Guideline In BEhavioural Interventions (SCRIBE) 2016: Explanation and elaboration. Archives of Scientific Psychology, 4(1), 10–31. https://doi.org/10.1037/arc0000027
38.
TincaniM.TraversJ. (2018). Publishing single-case research design studies that do not demonstrate experimental control. Remedial and Special Education, 39(2), 118–128. https://doi.org/10.1177/0741932517697447
39.
TurnerV. R.LedfordJ. R.LordA. K.HarbinE. R. (2020). Response shaping to improve food acceptance for children with autism: Effects of small and large food sets. Research in Developmental Disabilities, 98, Article 103574. https://doi.org/10.1016/j.ridd.2020.103574
40.
WatsonP. J.WorkmanE. A. (1981). The non-concurrent multiple baseline across-individuals design: An extension of the traditional multiple baseline design. Journal of Behavior Therapy and Experimental Psychiatry, 12(3), 257–259. https://doi.org/10.1016/0005-7916(81)90055-0
41.
What Works Clearinghouse. (2010). Procedures and standards handbook (Version 2.0).
42.
What Works Clearinghouse. (2020). Procedures and standards handbook (Version 4.1).
43.
WoleryM. (2013). A commentary: Single-case design technical document of the What Works Clearinghouse. Remedial and Special Education, 34(1), 39–43. https://doi.org/10.1177/0741932512468038
44.
ZimmermanK. N.LedfordJ. R.SeveriniK. E.PustejovskyJ. E.BartonE. E.LloydB. P. (2018). Single-case synthesis tools I: Comparing tools to evaluate SCD quality and rigor. Research in Developmental Disabilities, 79, 19–32. https://doi.org/10.1016/j.ridd.2018.02.003
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
