The number of trials aimed at evaluating treatments for autism spectrum disorder has been increasing progressively. However, it is not clear which outcome measures should be used to assess their efficacy, especially for treatments which target core symptoms. The present review aimed to provide a comprehensive overview regarding the outcome measures used in clinical trials for people with autism spectrum disorder. We systematically searched the Web of KnowledgeSM database between 1980 and 2016 to identify published controlled trials investigating the efficacy of interventions in autism spectrum disorder. We included 406 trials in the final database, from which a total of 327 outcome measures were identified. Only seven scales were used in more than 5% of the studies, among which only three measured core symptoms (Autism Diagnostic Observation Schedule, Childhood Autism Rating Scale, and Social Responsiveness Scale). Of note, 69% of the tools were used in the literature only once. Our systematic review has shown that the evaluation of efficacy in intervention trials for autism spectrum disorder relies on heterogeneous and often non-specific tools for this condition. The fragmentation of tools may significantly hamper the comparisons between studies and thus the discovery of effective treatments for autism spectrum disorder. Greater consensus regarding the choice of these measures should be reached.
AmanM. G.NovotnyS.Samango-SprouseC.LecavalierL.LeonardE.GadowK. D.. . . ChezM. (2004). Outcome measures for clinical drug trials in autism. CNS Spectrums, 9, 36–47.
2.
AmanM. G.SinghN. N.StewartA. W.FieldC. J. (1985). The aberrant behavior checklist: A behavior rating scale for the assessment of treatment effects. American Journal of Mental Deficiency, 89, 485–491.
3.
AnagnostouE. (2018). Clinical trials in autism spectrum disorder: Evidence, challenges and future directions. Current Opinion in Neurology, 31, 119–125. doi:10.1097/wco.0000000000000542
4.
AnagnostouE.JonesN.HuertaM.HalladayA. K.WangP.ScahillL.. . . DawsonG. (2015). Measuring social communication behaviors as a treatment endpoint in individuals with autism spectrum disorder. Autism, 19, 622–636. doi:10.1177/1362361314542955
5.
AyresM.ParrJ. R.RodgersJ.MasonD.AveryL.FlynnD. (2018). A systematic review of quality of life of adults on the autism spectrum. Autism, 22, 774–783. doi:10.1177/1362361317714988
6.
BangerterA.NessS.AmanM. G.EsbensenA. J.GoodwinM. S.DawsonG.. . . PandinaG. (2017). Autism Behavior Inventory: A novel tool for assessing core and associated symptoms of autism spectrum disorder. Journal of Child and Adolescent Psychopharmacology, 27, 814–822. doi:10.1089/cap.2017.0018
7.
BaxterA. J.BrughaT. S.ErskineH. E.ScheurerR. W.VosT.ScottJ. G. (2015). The epidemiology and global burden of autism spectrum disorders. Psychological Medicine, 45, 601–613. doi:10.1017/s003329171400172x
8.
BenekeM.RasmusW. (1992). ‘Clinical global impressions’ (ECDEU): Some critical comments. Pharmacopsychiatry, 25, 171–176. doi:10.1055/s-2007–1014401
9.
BieleninikL.PosserudM. B.GeretseggerM.ThompsonG.ElefantC.GoldC. (2017). Tracing the temporal stability of autism spectrum diagnosis and severity as measured by the autism diagnostic observation schedule: A systematic review and meta-analysis. PLoS ONE, 12(9), e0183160. doi:10.1371/journal.pone.0183160
10.
BolteE. E.DiehlJ. J. (2013). Measurement tools and target symptoms/skills used to assess treatment response for individuals with autism spectrum disorder. Journal of Autism and Developmental Disorders, 43, 2491–2501. doi:10.1007/s10803-013-1798-7
11.
BrughaT. S.DoosL.TempierA.EinfeldS.HowlinP. (2015). Outcome measures in intervention trials for adults with autism spectrum disorders; a systematic review of assessments of core autism features and associated emotional and behavioural problems. International Journal of Methods in Psychiatric Research, 24, 99–115. doi:10.1002/mpr.1466
12.
BurgessA. F.GutsteinS. E. (2007). Quality of life for people with autism: Raising the standard for evaluating successful outcomes. Child and Adolescent Mental Health, 12, 80–86. doi:10.1111/j.1475-3588.2006.00432.x
13.
CampbellM.KafantarisV.MaloneR. P.KowalikS. C.LocascioJ. J. (1991). Diagnostic and assessment issues related to pharmacotherapy for children and adolescents with autism. Behavior Modification, 15, 326–354. doi:10.1177/01454455910153004
14.
CarterA. S.VolkmarF. R.SparrowS. S.WangJ. J.LordC.DawsonG.SchoplerE. (1998). The Vineland Adaptive Behavior Scales: supplementary norms for individuals with autism. Journal of Autism and Developmental Disorders, 28, 287–302.
15.
CassidyS. A.BradleyL.BowenE.WighamS.RodgersJ. (2018a). Measurement properties of tools used to assess depression in adults with and without autism spectrum conditions: A systematic review. Autism Research, 11, 738–754.
16.
CassidyS. A.BradleyL.BowenE.WighamS.RodgersJ. (2018b). Measurement properties of tools used to assess suicidality in autistic and general population adults: A systematic review. Clinical Psychology Review, 62, 56–60.
17.
ChathamC. H.TaylorK. I.CharmanT.Liogier D’ardhuyX.EuleE.FedeleA.. . . BolognaniF. (2018). Adaptive behavior in autism: Minimal clinically important differences on the Vineland-II. Autism Research, 11, 270–283. doi:10.1002/aur.1874
18.
ConnersC. K. (1969). A teacher rating scale for use in drug studies with children. The American Journal of Psychiatry, 126, 884–888. doi:10.1176/ajp.126.6.884
19.
ConstantinoJ. N.DavisS. A.ToddR. D.SchindlerM. K.GrossM. M.BrophyS. L.. . . ReichW. (2003). Validation of a brief quantitative measure of autistic traits: Comparison of the social responsiveness scale with the autism diagnostic interview-revised. Journal of Autism and Developmental Disorders, 33, 427–433. doi:10.1023/A:1025014929212
20.
Del Valle RubidoM.McCrackenJ. T.HollanderE.ShicF.NoeldekeJ.BoakL.. . . UmbrichtD. (2018). In search of biomarkers for autism spectrum disorder. Autism Research, 11, 1567–1579. doi:10.1002/aur.2026
21.
DwanK.AltmanD. G.ArnaizJ. A.BloomJ.ChanA. W.CroninE.. . . SimesJ. (2008). Systematic review of the empirical evidence of study publication bias and outcome reporting bias. PLoS ONE, 3(8), e3081.
22.
EstesA.OlsonE.SullivanK.GreensonJ.WinterJ.DawsonG.MunsonJ. (2013). Parenting-related stress and psychological distress in mothers of toddlers with autism spectrum disorders. Brain & Development, 35, 133–138. doi:10.1016/j.braindev.2012.10.004
23.
HanleyG. P.JinC. S.VanselowN. R.HanrattyL. A. (2014). Producing meaningful improvements in problem behavior of children with autism via synthesized analyses and treatments. Journal of Applied Behavior Analysis, 47, 16–36. doi:10.1002/jaba.106
24.
HanrattyJ.LivingstoneN.RobalinoS.TerweeC. B.GlodM.OonoI. P.. . . McConachieH. (2015). Systematic review of the measurement properties of tools used to measure behaviour problems in young children with autism. PLoS ONE, 10(12), e0144649.
25.
HansenS. N.SchendelD. E.ParnerE. T. (2015). Explaining the increase in the prevalence of autism spectrum disorders: The proportion attributable to changes in reporting practices. JAMA Pediatrics, 169, 56–62. doi:10.1001/jamapediatrics.2014.1893
26.
HigginsJ. P.AltmanD. G.GotzscheP. C.JuniP.MoherD.OxmanA. D.. . . Cochrane Statistical Methods Group. (2011). The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials. British Medical Journal, 343, d5928. doi:10.1136/bmj.d5928
27.
HollocksM. J.LerhJ. W.MagiatiI.Meiser-StedmanR.BrughaT. S. (2018). Anxiety and depression in adults with autism spectrum disorder: A systematic review and meta-analysis. Psychological Medicine, 49, 559–572. doi:10.1017/s0033291718002283
28.
HowesO. D.RogdakiM.FindonJ. L.WichersR. H.CharmanT.KingB. H.. . . MurphyD. G. (2018). Autism spectrum disorder: Consensus guidelines on assessment, treatment and research from the British Association for Psychopharmacology. Journal of Psychopharmacology, 32, 3–29. doi:10.1177/0269881117741766
29.
JohannesR.JonathanW. L. M. J.JessicaB. (2010). A comparison of adults with intellectual disabilities with and without ASD on parallel measures of challenging behaviour: The Behavior Problems Inventory-01 (BPI-01) and Autism Spectrum Disorders-Behavior Problems for Intellectually Disabled Adults (ASD-BPA). Journal of Applied Research in Intellectual Disabilities, 23, 179–185. doi:10.1111/j.1468-3148.2009.00519.x
30.
KasariC. (2002). Assessing change in early intervention programs for children with autism. Journal of Autism and Developmental Disorders, 32, 447–461.
31.
KernsC. M.RennoP.KendallP. C.WoodJ. J.StorchE. A. (2017). Anxiety disorders interview schedule-autism addendum: Reliability and validity in children with autism spectrum disorder. Journal of Clinical Child & Adolescent Psychology, 46, 88–100. doi:10.1080/15374416.2016.1233501
32.
KimS. H.GrzadzinskiR.MartinezK.LordC. (2018). Measuring treatment response in children with autism spectrum disorder: Applications of the Brief Observation of Social Communication Change to the Autism Diagnostic Observation Schedule. Autism. Advance online publication. doi:10.1177/1362361318793253
33.
KingB. H.NavotN.BernierR.WebbS. J. (2014). Update on diagnostic classification in autism. Current Opinion in Psychiatry, 27, 105–109. doi:10.1097/YCO.0000000000000040
34.
LaiM. C.LombardoM. V.Baron-CohenS. (2014). Autism. The Lancet, 383, 896–910. doi:10.1016/s0140-6736(13)61539-1
35.
LecavalierL.WoodJ. J.HalladayA. K.JonesN. E.AmanM. G.CookE. H.. . . ScahillL. (2014). Measuring anxiety as a treatment endpoint in youth with autism spectrum disorder. Journal of Autism and Developmental Disorders, 44, 1128–1143. doi:10.1007/s10803-013-1974-9
36.
LiberatiA.AltmanD. G.TetzlaffJ.MulrowC.GøtzscheP. C.IoannidisJ. P. A.. . . MoherD. (2009). The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. PLoS Medicine, 6(7), e1000100. doi:10.1371/journal.pmed.1000100
37.
LordC.RutterM.GoodeS.HeemsbergenJ.JordanH.MawhoodL.SchoplerE. (1989). Autism diagnostic observation schedule: A standardized observation of communicative and social behavior. Journal of Autism and Developmental Disorders, 19, 185–212.
38.
LordC.WagnerA.RogersS.SzatmariP.AmanM.CharmanT.. . . YoderP. (2005). Challenges in evaluating psychosocial interventions for autistic spectrum disorders. Journal of Autism and Developmental Disorders, 35, 695–708. doi:10.1007/s10803-005-0017-6
39.
MagiatiI.MossJ.YatesR.CharmanT.HowlinP. (2011). Is the Autism Treatment Evaluation Checklist a useful tool for monitoring progress in children with autism spectrum disorders?Journal of Intellectual Disability Research, 55, 302–312. doi:10.1111/j.1365-2788.2010.01359.x
40.
MatsonJ. L.DempseyT.LoVulloS. V.FodstadJ. C.KnightC.SevinJ. A.SharpB. (2013). The moderating effects of intellectual development on core symptoms of autism and PDD-NOS in toddlers and infants. Research in Developmental Disabilities, 34, 573–578. doi:10.1016/j.ridd.2012.03.031
41.
McConachieH.MasonD.ParrJ. R.GarlandD.WilsonC.RodgersJ. (2018). Enhancing the validity of a quality of life measure for autistic people. Journal of Autism and Developmental Disorders, 48, 1596–1611. doi:10.1007/s10803-017-3402-z
42.
McConachieH.ParrJ. R.GlodM.HanrattyJ.LivingstoneN.OonoI. P.. . . WilliamsK. (2015). Systematic review of tools to measure outcomes for young children with autism spectrum disorder. Health Technolassess, 19(41), 1–506. doi:10.3310/hta19410
43.
McPartlandJ. C. (2017). Developing clinically practicable biomarkers for autism spectrum disorder. Journal of Autism and Developmental Disorders, 47, 2935–2937. doi:10.1007/s10803-017-3237-7
44.
NorrisM.AmanM. G.MazurekM. O.ScherrJ. F.ButterE. M. (2019). Psychometric characteristics of the aberrant behavior checklist in a well-defined sample of youth with autism spectrum disorder. Research in Autism Spectrum Disorders, 62, 1–9.
45.
PayakachatN.TilfordJ. M.KovacsE.KuhlthauK. (2012). Autism spectrum disorders: A review of measures for clinical, health services and cost–effectiveness applications. Expert Review of Pharmacoeconomics & Outcomes Research, 12, 485–503. doi:10.1586/erp.12.29
46.
PensonD.KrishnaswamiS.JulesA.McPheetersM. L. (2013). Effectiveness of hormonal and surgical therapies for cryptorchidism: A systematic review. Pediatrics, 131(6), e1897–e1907. doi:10.1542/peds.2013-0072
47.
PijlM. K.RommelseN. N.HendriksM.De KorteM. W.BuitelaarJ. K.OosterlingI. J. (2018). Does the brief observation of social communication change help moving forward in measuring change in early autism intervention studies?Autism, 22, 216–226. doi:10.1177/1362361316669235
48.
RodgersJ.WighamS.McConachieH.FreestonM.HoneyE.ParrJ. R. (2016). Development of the anxiety scale for children with autism spectrum disorder (ASC-ASD). Autism Research, 9, 1205–1215. doi:10.1002/aur.1603
49.
RojahnJ.WilkinsJ.MatsonJ. L.BoisjoliJ. (2010). A comparison of adults with intellectual disabilities with and without ASD on parallel measures of challenging behaviour: The Behavior Problems Inventory-01 (BPI-01) and Autism Spectrum Disorders–Behavior Problems for Intellectually Disabled Adults (ASD-BPA). Journal of Applied Research in Intellectual Disabilities, 23, 179–185. doi:10.1111/j.1468-3148.2009.00519.x
50.
ScahillL.AmanM. G.LecavalierL.HalladayA. K.BishopS. L.BodfishJ. W.. . . DawsonG. (2015). Measuring repetitive behaviors as a treatment endpoint in youth with autism spectrum disorder. Autism, 19, 38–52. doi:10.1177/1362361313510069
51.
SchoplerE.ReichlerR.RennerB. R. (1988). The Childhood Autism Rating Scale (CARS). Los Angeles, CA: Western Psychological Services.
52.
ShumwayS.FarmerC.ThurmA.JosephL.BlackD.GoldenC. (2012). The ADOS calibrated severity score: Relationship to phenotypic variables and stability over time. Autism Research, 5, 267–276. doi:10.1002/aur.1238
53.
SparrowS. S.BallaD. A.CicchettiD.V. (1984) Vineland adaptive behavior scales. Circle Pines, MN: American Guidance Service.
54.
SusanW. W.AngelaS.CaitlinM. C.BrennaB. M.SarayB. (2014). Evaluating change in social skills in high-functioning adults with autism spectrum disorder using a laboratory-based observational measure. Focus on Autism and Other Developmental Disabilities, 30, 3–12. doi:10.1177/1088357614539836
55.
The WHOQoL Group. (1998). The World Health Organization quality of life assessment (WHOQOL): Development and general psychometric properties. Social Science and Medicine, 46(12), 1569–1585.
56.
US Department of Health and Human Services (2017). Estimates of funding for various research, condition, and disease categories (RCDC). Retrieved from https://report.nih.gov/categorical_spending.aspx
57.
van HeijstB. F.GeurtsH. M. (2015). Quality of life in autism across the lifespan: A meta-analysis. Autism, 19, 158–167. doi:10.1177/1362361313517053
58.
Virues-OrtegaJ. (2010). Applied behavior analytic intervention for autism in early childhood: Meta-analysis, meta-regression and dose-response meta-analysis of multiple outcomes. Clinical Psychology Review, 30, 387–399. doi:10.1016/j.cpr.2010.01.008
59.
WeisbrotD. M.GadowK. D.DeVincentC. J.PomeroyJ. (2005). The presentation of anxiety in children with pervasive developmental disorders. Journal of Child and Adolescent Psychopharmacology, 15, 477–496. doi:10.1089/cap.2005.15.477
60.
WighamS.McConachieH. (2014). Systematic review of the properties of tools used to measure outcomes in anxiety intervention studies for children with autism spectrum disorders. PLoS ONE, 9(1), e85268.
61.
XuG.StrathearnL.LiuB.BaoW. (2018). Prevalence of autism spectrum disorder among us children and adolescents, 2014–2016. Journal of the American Medical Association, 319, 81–82. doi:10.1001/jama.2017.17812
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
