Single-Case Experimental Designs (SCEDs), or N-of-1 trials, are commonly used to estimate intervention effects in many disciplines including in the treatment of youth mental health problems. SCEDs consist of repeated measurements of an outcome over time for a single case (e.g., student or patient) throughout one or more baseline phases and throughout one or more intervention phases. The manipulation of the baseline and intervention phase make the SCED a type of interrupted time series design, which is considered one of the most effective experimental designs for causal inference. An important step towards understanding why interventions are effective at producing a change in the outcome is through the investigation of mediating mechanisms. Hypotheses of mediating mechanisms involve an intervention variable which is hypothesized to affect an outcome through its effect on a mediating variable. Little work has attempted to combine mediation analysis and ABAB reversal designs. Therefore, the goals of this paper are to define, estimate, and interpret mediation effects for ABAB reversal designs. An empirical example is used to demonstrate how to estimate and interpret the mediation effects. R code is provided for researchers interested in estimating mediation effects in single-case reversal designs.
AydinO.YassikayaM. Y. (2022). Validity and reliability analysis of the PlotDigitizer software program for data extraction from single-case graphs. Perspectives on Behavior Science, 45(1), 239–257. https://doi.org/10.1007/s40614-021-00284-0
2.
BarryL. M.HarawayD. L. (2005). Self-management and ADHD: A literature review. The Behavior Analyst Today, 6.
3.
BoxG. E. P.JenkinsG. M.ReinselG. C. (2008). Time series analysis: Forecasting and control. Hoboken, NJ.: John Wiley & Sons.
4.
BullockJ. G.GreenD. P.HaS. E. (2010). Yes, but what’s the mechanism? (don’t expect an easy answer). Journal of Personality and Social Psychology, 98(4), 550–558. https://doi.org/10.1037/a0018933
5.
CampbellN. C.MurrayE.DarbyshireJ.EmeryJ.FarmerA.GriffithsF.GuthrieB.LesterH.WilsonP.KinmonthA. L.KinmonthA. L. (2007). Designing and evaluating complex interventions to improve health care. BMJ, 334(7591), 455–459. https://doi.org/10.1136/bmj.39108.379965.BE
6.
EdwardsL.SalantV.HowardV. F.BrougherJ.Mc LaughlinT. F. (1995). Effectiveness of self-management on attentional behavior and reading comprehension for children with attention deficit disorder. Child & Family Behavior Therapy, 17(2), 1–17. https://doi.org/10.1300/j019v17n02_01
7.
GeukeG. G. M.MaricM.MiočevićM.WoltersL. H.de HaanE. (2019). Testing mediators of youth intervention outcomes using single-case experimental designs. New Directions for Child and Adolescent Development, 2019, 2019(167), 39–64. https://doi.org/10.1002/cad.20310
8.
GollobH. F.ReichardtC. S. (1991). Interpreting and estimating indirect effects assuming time lags really matter. In L. M. Collins & J. L. Horn (Eds.)Best Methods for the Analysis of Change: Recent Advances, Unanswered Questions, Future Directions. American Psychological Association.
9.
HayesA. F. (2017). Introduction to mediation, moderation, and conditional process analysis: A regression-based approach. Guilford Publications.
HongG. (2015). Causality in a social world: Moderation, mediation and spill-over. John Wiley & Sons.
13.
HuX.ZhengQ.LeeG. T. (2018). Using peer-mediated LEGO® play intervention to improve social interactions for Chinese children with autism in an inclusive setting. Journal of Autism and Developmental Disorders, 48(7), 2444–2457. https://doi.org/10.1007/s10803-018-3502-4
14.
HuitemaB. E.MckeanJ. W. (2000). Design specification issues in time-series intervention models. Educational and Psychological Measurement, 60(1), 38–58. https://doi.org/10.1177/00131640021970358
15.
ImaiK.KeeleL.TingleyD. (2010). A general approach to causal mediation analysis. Psychological Methods, 15(4), 309–334. https://doi.org/10.1037/a0020761
16.
ImaiK.KeeleL.YamamotoT. (2010). Identification, inference and sensitivity analysis for causal mediation effects. Statistical Science, 25(1), 51–71. https://doi.org/10.1214/10-sts321
17.
KazdinA. E. (2021). Single-case research designs: Method for clinical and applied settings (3rd ed.). Oxford University Press.
18.
LoeysT.RodenburgR. (2022). Dealing with autocorrelation in the single case ab-design: A study assessing the mediating effect of infant crying on the relation between responsive soothing and infant sleep. Evaluation & the Health Professions, 45(1), 22–35. https://doi.org/10.1177/01632787211069678
19.
MacKinnonD. P. (2008). Introduction to statistical mediation analysis. Erlbaum.
20.
MackinnonD. P.LockwoodC. M.WilliamsJ. (2004). Confidence limits for the indirect effect: Distribution of the product and resampling methods. Multivariate Behavioral Research, 39(1), 99–128. https://doi.org/10.1207/s15327906mbr3901_4
21.
MacKinnonD. P.PirlottA. G. (2015). Statistical approaches for enhancing causal interpretation of the M to Y relation in mediation analysis. Personality and Social Psychology Review, 19(1), 30–43. https://doi.org/10.1177/1088868314542878
22.
MacKinnonD. P.SmythH. L.SomersJ.HoE.NorgetJ.MiočevićM. (2022). A randomization permutation test for single subject mediation. Evaluation & the Health Professions, 45(1), 54–65. https://doi.org/10.1177/01632787211070811
23.
MacKinnonD. P.ValenteM. J.GonzalezO. (2020). The correspondence between causal and traditional mediation analysis: The link is the mediator by treatment interaction. Prevention Science: The Official Journal of the Society for Prevention Research, 21(2), 147–157. https://doi.org/10.1007/s11121-019-01076-4
24.
MaricM.KokS. I. (2023). How did the treatment work for robin? And for Dylan? Studying individual youth treatment mediators using single-case experimental designs. Clinical Child and Family Psychology Review, 26(3), 721–726. https://doi.org/10.1007/s10567-023-00442-7
25.
MaricM.WiersR. W.PrinsP. J. (2012). Ten ways to improve the use of statistical mediation analysis in the practice of child and adolescent treatment research. Clinical Child and Family Psychology Review, 15(3), 177–191. https://doi.org/10.1007/s10567-012-0114-y
26.
McDonaldS.VieiraR.GodfreyA.O’BrienN.WhiteM.SniehottaF. F. (2017). Changes in physical activity during the retirement transition: A series of novel n-of-1 natural experiments. International Journal of Behavioral Nutrition and Physical Activity, 14, 167–212. https://doi.org/10.1186/s12966-017-0623-7
27.
MeekerW. Q.CornwellL. W.AroianL. A. (1981). The product of two normally distributed random variables (No. 7). American Mathematical Society.
28.
MiočevićM.KlaassenF.GeukeG.MoeyaertM.MaricM. (2020). Using Bayesian methods to test mediators of intervention outcomes in single-case experimental designs. Evidence-Based Communication Assessment and Intervention, 1–17.
29.
MiočevićM.MoeyaertM.KlaassenF.GeukeG. (2023). Optimal practices for mediation analysis in AB single case experimental designs. The Journal of Experimental Education. https://doi.org/10.1080/00220973.2023.2243593
30.
MoeyaertM.UgilleM.FerronJ. M.BeretvasS. N.Van den NoortgateW. (2014). The influence of the design matrix on treatment effect estimates in the quantitative analyses of single-subject experimental design research. Behavior Modification, 38(5), 665–704. https://doi.org/10.1177/0145445514535243
31.
MorganS. L.WinshipC. (2015). Counterfactuals and causal inference. Cambridge University Press.
32.
MüllerA. R.BrandsM. M.van de VenP. M.RoesK. C.CornelM. C.van KarnebeekC. D.WijburgF. A.DaamsJ. G.BootE.van EeghenA. M.van EeghenA. M. (2021). Systematic review of N-of-1 studies in rare genetic neurodevelopmental disorders: The power of 1. Neurology, 96(11), 529–540. https://doi.org/10.1212/WNL.0000000000011597
33.
MuthénB. O.AsparouhovT. (2015). Causal effects in mediation modeling: An introduction with applications to latent variables. Structural Equation Modeling: A Multidisciplinary Journal, 22(1), 12–23. https://doi.org/10.1080/10705511.2014.935843
34.
PearlJ. (2001). Direct and indirect effects. Proceedings of the seventeenth conference on uncertainty in artifical intelligence.
35.
PearlJ. (2012). The causal mediation formula—A guide to the assessment of pathways and mechanisms. Prevention Science: The Official Journal of the Society for Prevention Research, 13(4), 426–436. https://doi.org/10.1007/s11121-011-0270-1
36.
PearlJ. (2014). Interpretation and identification of causal mediation. Psychological Methods, 19(4), 459–481. https://doi.org/10.1037/a0036434
37.
PinheiroJ.BatesD.R Core Team. (2023). nlme: Linear and nonlinear mixed effects models. R package version 3.1-162.
38.
PreacherK. J.SeligJ. P. (2012). Advantages of Monte Carlo confidence intervals for indirect effects. Communication Methods and Measures, 6(2), 77–98. https://doi.org/10.1080/19312458.2012.679848
39.
ReichardtC. S. (2019). Quasi-experimentation: A guide to design and analysis. Guilford Publications.
RubinD. B. (1974). Estimating causal effects of treatments in randomized and nonrandomized studies. Journal of Educational Psychology, 66(5), 688–701. https://doi.org/10.1037/h0037350
42.
RubinD. B. (1990). [On the application of probability theory to agricultural experiments. Essay on principles. Section 9.] comment: Neyman (1923) and causal inference in experiments and observational studies. Statistical Science, 5(4), 472–480. https://doi.org/10.1214/ss/1177012032
43.
SchorkN. J. (2015). Personalized medicine: Time for one-person trials. Nature, 520(7549), 609–611. https://doi.org/10.1038/520609a
44.
ShadishW. R.CookT. D.CampbellD. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. Houghton Mifflin.
45.
ShadishW. R.KyseE. N.RindskopfD. M. (2013). Analyzing data from single-case designs using multilevel models: New applications and some agenda items for future research. Psychological Methods, 18(3), 385–405. https://doi.org/10.1037/a0032964
46.
ShadishW. R.SullivanK. J. (2011). Characteristics of single-case designs used to assess intervention effects in 2008. Behavior Research Methods, 43(4), 971–980.
47.
ShihC. H.YehJ. C.ShihC. T.ChangM. L. (2011). Assisting children with attention deficit hyperactivity disorder actively reduces limb hyperactive behavior with a Nintendo Wii remote controller through controlling environmental stimulation. Research in Developmental Disabilities, 32(5), 1631–1637. https://doi.org/10.1016/j.ridd.2011.02.014
48.
TheodoreL. A.BrayM. A.KehleT. J.JensonW. R. (2001). Randomization of group contingencies and reinforcers to reduce classroom disruptive behavior. Journal of School Psychology, 39(3), 267–277. https://doi.org/10.1016/s0022-4405(01)00068-1
49.
TofighiD.MacKinnonD. P. (2016). Monte Carlo confidence intervals for complex functions of indirect effects. Structural Equation Modeling: A Multidisciplinary Journal, 23(2), 194–205. https://doi.org/10.1080/10705511.2015.1057284
50.
ValenteM. J.RijnhartJ. J.MiočevićM. (2022). Causal mediation effects in single case experimental designs. Psychological Methods. https://doi.org/10.1037/met0000497
51.
ValeriL.VanderweeleT. J. (2013). Mediation analysis allowing for exposure-mediator interactions and causal interpretation: Theoretical assumptions and implementation with SAS and SPSS macros. Psychological Methods, 18(2), 137–150. https://doi.org/10.1037/a0031034
52.
VanderWeeleT. J. (2015). Explanation in causal inference: Methods for mediation and interaction. Oxford University Press.
53.
VanderWeeleT. J.VansteelandtS. (2009). Conceptual issues concerning mediation, interventions and composition. Statistics and Its Interface, 2(4), 457–468. https://doi.org/10.4310/sii.2009.v2.n4.a7
54.
What Works Clearinghouse (2022). What Works ClearinghouseTM procedures and standards handbook(Version 5.0). Retrieved fromhttps://ies.ed.gov/ncee/wwc/Handbooks
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
