Single-case experimental designs (SCEDs) are frequently used to evaluate whether a functional relation exists between interventions and student outcomes. A critical factor in decision making is the evaluation of graphical data, typically displayed in time-series graphs. Distortion in the graphical display of data can lead to invalid decisions on whether a functional relation exists, as well as overestimating the magnitude of an effect. Previous research has identified two potentially analysis-altering elements that when manipulated alter visual analysts’ decision regarding the presence of a functional relation and magnitude of effect. The purpose of this review was to evaluate the graphical display of data from SCEDs in the field of emotional and behavioral disorders (EBD). The review covered 40 SCEDs, including 258 graphs, published in Behavioral Disorders and Journal of Emotional and Behavioral Disorders over the last 10 years (2010–2019). We identified large variation in the axis proportions of reviewed graphs, as measured using standardized x:y and the data points per x- to y-axis ratio (DPPXYR). A majority of graphs included an ordinate scaling procedure that aligns with findings from preliminary research on this analysis-altering element. We provide recommendations to the field on designing graphs to enhance the validity of visual analysis.
AdamsonR. M.LewisT. J. (2017). A comparison of three opportunity-to-respond strategies on the academic engaged time among high school students who present challenging behavior. Behavioral Disorders, 42(2), 41–51. https://doi.org/10.1177/0198742916688644
2.
AlldayR. A.Hinkson-LeeK.HudsonT.Neilsen-GattiS.KleinkeA.RusselC. S. (2012). Training general educators to increase behavior-specific praise: Effects on students with EBD. Behavioral Disorders, 37(2), 87–98. https://doi.org/10.1177/019874291203700203
BloodE. (2010). Effects of student response systems on participation and learning of students with emotional and behavioral disorders. Behavioral Disorders, 35(3), 214–228. https://doi.org/10.1177/019874291003500303
5.
BriereD. E.SimonsenB. (2011). Self-monitoring interventions for at-risk middle schoolstudents: The importance of considering function. Behavioral Disorders, 36(2), 129–140. https://doi.org/10.1177/019874291103600204
6.
BruhnA. L.Balint-LangelK.TroughtonL.LanganS.LodgeK.KortemeyerS. (2015). Assessing and treating stereotypical behaviors in classrooms using a functional approach. Behavioral Disorders, 41(1), 21–37. https://doi.org/10.17988/0198-7429-41.1.21
7.
BruhnA.WattS. (2012). Improving behavior by using multicomponent self-monitoring within a targeted reading intervention. Behavioral Disorders, 38(1), 3–17. https://doi.org/10.1177/019874291203800102
8.
BruhnA. L.Woods-GroveS.FernandoJ.ChoiT.TroughtonL. (2017). Evaluating technologybased self-monitoring as a tier 2 intervention across middle schools. Behavioral Disorders, 42(3), 119–131. https://doi.org/10.1177/0198742917691534
9.
ByunT.HitchcockE.FerronJ. (2017). Masked visual analysis: Minimizing type 1 error in visually guided single-case design for communication disorders. Journal of Speech and Hearing Research, 60(6), 1455–1466. https://doi.org/10.1044/2017_jslhr-s-16-0344
10.
ConroyM. A.StichterJ. P.DaunicA.HaydonT. (2008). Classroom-based research in the field of emotional and behavioral disorders. The Journal of Special Education, 41(4), 209–222. https://doi.org/10.1177/0022466907310369
11.
CookC. R.DartE.CollinsT.RestoriA.DaikosC.DelportJ. (2012). Preliminary study of the confined, collateral, and combined effects of reading and behavioral interventions: Evidence for a transactional relationship. Behavioral Disorders, 38(1), 38–56. https://doi.org/10.1177/019874291203800104
CouncilM. R.CartledgeG.GreenD.BarberM.GardnerR. (2016). Reducing risk through a supplementary reading intervention: A case study of first- and second-grade urban students. Behavioral Disorders, 41(4), 241–257. https://doi.org/10.17988/bedi-41-04-241-257.1
14.
CramerA. M.MasonL. H. (2014). The effects of strategy instruction for writing and revising persuasive quick writes for middle school students with emotional and behavioral disorders. Behavioral Disorders, 40(1), 37–51. https://doi.org/10.17988/0198-7429-40.1.37
15.
Cuenca-CarlinoY.MustianA. L. (2013). Self-regulated strategy development: Connecting persuasive writing to self-advocacy for students with emotional and behavioral disorders. Behavioral Disorders, 39(1), 3–15. https://doi.org/10.1177/019874291303900102
16.
DartE. H.RadleyK. C. (2017). The impact of ordinate scaling on the visual analysis of single-case data. Journal of School Psychology, 63, 105–118. https://doi.org/10.1016/j.jsp.2017.03.008
17.
DartE. H.RadleyK. C. (2018). Toward a standard assembly of linear graphs. School Psychology Quarterly, 33(3), 350–355. https://doi.org/10.1037/spq0000269
18.
De ProsperoA.CohenS. (1979). Inconsistent visual analysis of intrasubject data. Journal of Applied Behavior Analysis, 12(4), 573–579. https://doi.org/10.1901/jaba.1979.12-573
19.
EnnisR. P.JolivetteK.LosinskiM. (2017). The effects of writing choice prompt on the written narratives of students with emotional and behavioral disorders: A case study of an abandoned single-case design. Behavioral Disorders, 42(2), 185–195. https://doi.org/10.1177/0198742917709471
20.
EscarpioR.BarbettaP. M. (2016). Comparison of repeated and non-repeated readings on the reading performances of students with emotional and behavioral disorders. Journal of Emotional and Behavioral Disorders, 24(2), 111–124. https://doi.org/10.1177/1063426615574337
21.
FerronJ. M.JooS. H.LevinJ. R. (2017). A Monte Carlo evaluation of masked visual analysis in response-guided versus fixed-criteria multiple-baseline designs. Journal of Applied Behavior Analysis, 50(4), 701–716. https://doi.org/10.1002/jaba.410
22.
GarwoodJ. D.PeltierC.SinclairT. E.EiselH.McKennaJ. W.VannestK. J. (2020). A quantitative synthesis of intervention research published in flagship EBD journals: 2010 to 2019. Behavioral Disorders. Advanced online publication. https://doi.org/10.1177/0198742920961341
23.
GarwoodJ.WertsM.MasonL.HarrisB.AustinM.CiulloS.MagnerK.KoppenhaverD.ShinM. (2019). Improving persuasive science writing for secondary students with emotional and behavioral disorders educated in residential treatment facilities. Behavioral Disorders, 44(4), 227–240. https://doi.org/10.1177/0198742918809341
24.
GibsonG.OttenbacherK. (1988). Characteristics influencing the visual analysis of single-subject data: An empirical analysis. The Journal of Applied Behavioral Science, 24(3), 298–314. https://doi.org/10.1177/0021886388243007
25.
GinnsD. S.BegenyJ. C. (2019). Effects of performance feedback on treatment integrity of a classwide level system for secondary students with emotional disturbance. Behavioral Disorders, 44(3), 175–189. https://doi.org/10.1177/019874291795884
26.
GouldK.GaitherJ.DartE.WeaverA. D. (2018). A practical guide to single case design graphing. Communique, 47(1), 22–25.
27.
Hagan-BurkeS.BurkeM.SugaiG. (2007). Using structural analysis and academic-based intervention for a student at risk of EBD. Behavioral Disorders, 32(3), 175–191. https://doi.org/10.1177/019874290703200303
28.
HansenB. D.WillisH. P.KampsD. M.GreenwoodC. R. (2014). The effects of function based self-management interventions on student behavior. Journal of Emotional and Behavioral Disorders, 22(3), 149–159. https://doi.org/10.1177/1063426613476345
29.
HauthC.MastropieriM.ScruggsT.ReganK. (2013). Can students with emotional and/or behavioral disabilities improve on planning and writing in the content areas of civics and mathematics?Behavioral Disorders, 38(3), 154–170. https://doi.org/10.1177/019874291303800304
30.
HaydonT.ConroyM. A.ScottT. M.SindelarP. T.BarberB. R.OrlandoA. M. (2010). A comparison of three types of opportunities to respond on student academic and social behaviors. Journal of Emotional and Behavioral Disorders, 18(1), 27–40. https://doi.org/10.1177/1063426609333448
31.
HaydonT.HawkinsR.DenuneH.KimenerL.McCoyD.BashamJ. (2012). A comparison of iPads and worksheets on math skills of high school students with emotional disturbance. Behavioral Disorders, 37(4), 232–243. https://doi.org/10.1177/019874291203700404
32.
HornerR. H.CarrE. G.HalleJ.McGeeG.OdomS.WoleryM. (2005). The use of single-subject research to identify evidence-based practice in special education. Exceptional Children, 71(2), 165–179. https://doi.org/10.1177/001440290507100203
33.
HuX.LeeG. (2019). Effects of PECS on the emergence of vocal mands and the reduction of aggressive behavior across settings for a child with autism. Behavioral Disorders, 44(4), 215–226. https://10.1177/0198742918806925
34.
KellyJ. R.ShogrenK. A. (2014). The impact of teaching self-determination skills on the on-task and off-task behaviors of students with emotional and behavioral disorders. Journal of Emotional and Behavioral Disorders, 22(1), 27–40. https://doi.org/10.1177/1063426612470515
35.
KratochwillT. R.HitchcockJ. H.HornerR. H.LevinJ. R.OdomS. L.RindskopfD. M.ShadishW. R. (2013). Single-case intervention research design standards. Remedial and Special Education, 34(1), 26–38. https://doi.org/10.1177/0741932512452794
36.
KratochwillT. R.LevinJ. R.HornerR. H.SwobodaC. M. (2014). Visual analysis of single-case intervention research: Conceptual and methodological issues. In KratochwillT. R.LevinJ. R. (Eds.), Single-case intervention research: Methodological and statistical advances (pp. 53–89). American Psychological Association.
37.
KubinaR. M.KostewiczD. E.BrennanK. M.KingS. A. (2017). A critical review of line graphs in behavior analytic journals. Educational Psychology Review, 29(3), 583–598. https://doi.org/10.1007/s10648-015-9339-x
38.
LedfordJ. R.BartonE. E.SeveriniK. E.ZimmermanK. N.PokorskiE. A. (2019). Visual display of graphic data in single case design studies: Systematic review and expert preference analysis. Education and Training in Autism and Developmental Disabilities, 54(4), 315–327.
39.
LedfordJ. R.LaneJ. D.SeveriniK. E. (2018). Systematic use of visual analysis for assessing outcomes of single case design studies. Brain Impairment, 19(1), 4–17. https://doi.org/10.1017/BrImp.2017.16
40.
LittleM. A.LaneK. L.HarrisK. R.GrahamS.StoryM.SandmelK. (2010). Self-regulated strategies development for persuasive writing in tandem with schoolwide positive behavioral support: Effects for second-grade students with behavioral and writing difficulties. Behavioral Disorders, 35(2), 157–179. https://doi.org/10.1177/019874291003500206
41.
LosinskiM.CookK.HirschS.SandersS. (2017). The effect of deep pressure therapies and antecedent exercise on stereotypical behaviors of students with autism spectrum disorders. Behavioral Disorders, 42(4), 196–208. https://doi.org/10.1177/0198742917715873
42.
LundervoldD. A.BelwoodM. F. (2000). The best kept secret in counseling: Single-case (N = 1) experimental designs. Journal of Counseling & Development, 78, 92–102. https://doi.org/10.1002/j.1556-6676.2000.tb02565.x
43.
MagginD.CookB.CookL. (2018). Using single-case research designs to examine the effects of interventions in special education. Learning Disabilities Research & Practice, 33(4), 182–191. https://doi.org/10.1111/ldrp.12184
44.
MagginD. M.FallonL. M.SanettiL. M. H.RubertoL. M. (2012). Training paraeducators to implement a group contingency protocol: Direct and collateral effects. Behavioral Disorders, 38(1), 18–37. https://doi.org/10.1177/019874291203800103
45.
MagginD.WehbyJ.FarmerT.BrooksD. (2016). Intensive interventions for students with emotional and behavioral disorders: Issues, theory, and future directions. Journal of Emotional and Behavioral Disorders, 24(3), 127–137. https://doi.org/10.1177/1063426616661498
46.
ManalovR.VannestK. J. (2019). A visual aid and objective rule encompassing the data features of visual analysis. Behavior Modification. Advance online publication. https://doi.org/10.1177/0145445519854323
47.
MasonL. H.KubinaR. M.HooverT. (2011). Effects of quick writing instruction for high school students with emotional disturbances. Journal of Emotional and Behavioral Disorders, 21(3), 163–175. https://doi.org/10.1177/1063426611410429
48.
MasonL. H.KubinaR. K.ValasaL. L.CramerA. M. (2010). Effects of quick writing instruction for high school students with emotional disturbances. Journal of Emotional and Behavioral Disorders, 21(3), 163–175. https://doi.org/10.1177/1063426611410429
49.
MessengerM.CommonE. A.LaneK. L.OakesW. P.MenziesH. M.CantwellE. D.EnnisR. P. (2017). Increasing opportunities to respond for students with internalizing behaviors: The utility of choral and mixed responding. Behavioral Disorders, 42(4), 170–184. https://10.1177/01987429177112968
50.
MinkosM. L.ChafouleasS. M.BrayM. A.LaSalleT. P. (2018). Brief report: A preliminary investigation of a mindful breathing intervention to increase academic engagement in an alternative education setting. Behavioral Disorders, 43(4), 436–443. https://doi.org/10.1177/0198742917740870
51.
MongM. D.JohnsonK. N.MongK. W. (2011). Effects of check-in/checkout on behavioral indices and mathematics generalization. Behavioral Disorders, 36(4), 225–240.
52.
NinciJ.VannestK. J.WillsonV.ZhangN. (2015). Interrater agreement between visual analysts of single-case data: A meta-analysis. Behavior Modification, 39(4), 510–541. https://doi.org/10.1177/0145445515581327
53.
OakesW. P.MathurS. R.LaneK. L. (2010). Reading interventions for students with challenging behavior: A focus on fluency. Behavioral Disorders, 35(2), 120–139. https://doi.org/10.1177/019874291003500204
54.
OdomS. L.BartonE.ReichowB.SwaminathanH.PustejovskyJ. (2018). Between-case standardized effect size analysis of single case designs: Examination of two methods. Research in Developmental Disabilities, 79, 88–96. https://doi.org/10.1016/j.ridd.2018.05.009
55.
OdomS. L.BrantlingerE.GerstenR.HornerR. H.ThompsonB.HarrisK. B. (2005). Research in special education: Scientific methods and evidence-based practices. Exceptional Children, 71(2), 137–148. https://doi.org/10.1177/001440290507100201
56.
OttenbacherK. J. (1993). Interrater agreement of visual analysis in single-subject decisions: Quantitative review and analysis. American Journal on Mental Retardation, 98(1), 135–142.
57.
ParsonsonB.BaerD. (1978). The analysis and presentation of graphic data. In KratochwillT. (Ed.), Single subject research (pp. 101–166). Academic.
58.
PeltierC.VannestK. J. (2018). The effects of schema-based instruction on the mathematical problem solving of students with emotional and behavioral disorders. Behavioral Disorders, 43(2), 277–289. https://doi.org/10.1177/01987429177044647
59.
PerchaB.BaskervilleE. B.JohnsonM.DudleyJ. T.ZimmermanN. (2019). Designing robust N-of-1 studies for precision medicine: Simulation study and design recommendations. Journal of Medical Internet Research, 21(4). https://doi.org/10.2196/12641
60.
RadleyK. C.DartE. H.FischerA. J.CollinsT. A. (2020). Publication trends for single-case methodology in school psychology: A systematic review. Psychology in the Schools, 57, 683–698. https://doi.org/10.1002/pits.22349
61.
RadleyK. C.DartE. H.WrightS. J. (2018). The effect of data points per x- to y-axis ratio on visual analysts evaluation of single-case graphs. School Psychology Quarterly, 33(2), 214–322. https://doi.org/10.1037/spq0000243
62.
RickG. (1976). Single subject research design in the placement and organization of education for atypical students. Behavioral Disorders, 2(1), 62–64.
63.
Robinson-ErvinP.CartledgeG.Musti-RaoS.GibsonL.KeyesS. E. (2016). Social skills instruction for urban learners with emotional and behavioral disorders: A culturally responsive and computer-based intervention. Behavioral Disorders, 41(4), 209–225. https://doi.org/10.17988/bedi-41-04-209-255.1
SchraubenK. S.DeanA. J. (2019). Cover-copy-compare for multiplication with students with emotional and behavioral disorders: A brief report. Behavioral Disorders, 45(1), 22–28. https://doi.org/10.1177/0198742918808484
66.
SkibaR.CaseyA. (1985). Interventions for behaviorally disordered students: A quantitative review and methodological critique. Behavioral Disorders, 10(4), 239–252. https://doi.org/10.1177/019874298501000409
67.
SpearC. F.Strickland-CohenM. K.RomerN.AlbinR. W. (2013). An examination of social validity within single-case research with students with emotional and behavioral disorders. Remedial and Special Education, 34(6), 357–370. https://doi.org/10.1177/0741932513490809
68.
SreckovicM.CommonE.KnowlesM.LaneK. (2017). A review of self-regulated strategy development for writing for students with EBD. Behavioral Disorders, 39(2), 56–77. https://doi.org/10.1177/019874291303900203
69.
StrainP. S.WilsonK.DunlapG. (2011). Prevent-teach-reinforce: Addressing problem behaviors of students with autism in general education classrooms. Behavioral Disorders, 36(3), 160–171. https://doi.org/10.1177/019874291003600302
70.
TalbottE.MagginD. M.Van AckerE. Y.KummS. (2018). Quality indicators for reviews of research in special education. Exceptionality, 26(4), 245–265. https://doi.org/10.1080/09362835.2017.1283625
71.
TurtonA. M.UmbreitJ.MathurS. R. (2011). Systematic function-based intervention for adolescents with emotional and behavioral disorders in an alternative setting: Broadening the context. Behavioral Disorders, 36(2), 117–128. https://doi.org/10.1177/019874291103600203
72.
WattsG.BryantD. P.CarrollM. (2019). Students with emotional-behavioral disorders as cross-age tutors: A synthesis of the literature. Behavioral Disorders, 44(3), 131–147. https://doi.org/10.1177/0198742918771914
73.
WeedenM.WillsH. P.KottwitzE.KampsD. (2016). The effects of a class-wide behavior intervention for students with emotional and behavioral disorders. Behavioral Disorders, 42(1), 285–293. https://doi.org/10.17988/BD-14-12.1
74.
WexlerJ.ReedD. K.BartonE. E.MitchellM.ClancyE. (2018). The effects of a peer mediated reading intervention on juvenile offenders’ main idea statements and informational text. Behavioral Disorders, 43(2), 290–301. https://doi.org/10.1177/0198742917703359
75.
WolfeK.BartonE.MeadanH. (2019). Systematic protocols for the visual analysis of single-case research data. Behavior Analysis in Practice, 12(2), 491–502. https://doi.org/10.1007/s40617-019-00336-7
76.
WolfeK.SlocumT. A. (2015). A comparison of two approaches to training visual analysis of AB graphs. Journal of Applied Behavior Analysis, 48(2), 472–477. https://doi.org/10.1002/jaba.212
77.
WoodB. K.HanaganT. F. (2013). Increasing in-school food consumption of an elementary student with emotional/behavioral disorders: A case study. Behavioral Disorders, 38(2), 99–107. https://doi.org/10.1177/019874291303800205
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
