The field of early autism research is in dire need of outcome measures that adequately reflect subtle changes in core autistic behaviors. This article compares the ability of a newly developed measure, the Brief Observation of Social Communication Change (BOSCC), and the Autism Diagnostic Observation Schedule (ADOS) to detect changes in core symptoms of autism in 44 toddlers. The results provide encouraging evidence for the Brief Observation of Social Communication Change as a candidate outcome measure, as reflected in sufficient inter- and intra-rater reliability, independency from other child characteristics, and sensitivity to capture change. Although the Brief Observation of Social Communication Change did not evidently outperform the Autism Diagnostic Observation Schedule on any of these quality criteria, the instrument may be better able to capture subtle, individual changes in core autistic symptoms. The promising findings warrant further study of this new instrument.
AchenbachTMRescorlaLA (2000) Manual for the ASEBA Preschool Forms & Profiles. Burlington, VT: The University of Vermont, Research Center for Children, Youth and Families.
2.
American Psychiatric Association (2013) Diagnostic and Statistical Manual of Mental Disorders. 5th ed.Arlington, VA: American Psychiatric Publishing.
3.
AnagnostouEJonesNHuertaM. (2014) Measuring social communication behaviors as a treatment endpoint in individuals with autism spectrum disorder. Autism. Epub ahead of print 5August. DOI: 10.1177/1362361314542955.
4.
BenjaminiYHochbergY (1995) Controlling the false discovery rate—a practical and powerful approach to multiple testing. Journal of the Royal Statistical Society Series B-Methodological57: 289–300.
5.
BolteEEDiehlJJ (2013) Measurement tools and target symptoms/skills used to assess treatment response for individuals with autism spectrum disorder. Journal of Autism and Developmental Disorders43: 2491–2501.
6.
CohenJ (1988) Statistical Power Analysis for the Behavioral Science, 2nd edition. Hillsdale, NJ: Erlbaum.
7.
CunninghamAB (2012) Measuring change in social interaction skills of young children with autism. Journal of Autism and Developmental Disorders42: 593–605.
8.
DawsonGRogersSMunsonJ. (2010) Randomized, controlled trial of an intervention for toddlers with autism: the Early Start Denver Model. Pediatrics125: e17–e23.
9.
De BildtAOosterlingIJVan LangND. (2011) Standardized ADOS scores: measuring severity of autism spectrum disorders in a Dutch sample. Journal of Autism and Developmental Disorders41: 311–319.
10.
EstesAMunsonJRogersSJ. (2015) Long-term outcomes of early intervention in 6-year-old children with autism spectrum disorder. Journal of the American Academy of Child and Adolescent Psychiatry54: 580–587.
11.
FensonLDalePSReznickJS. (1993) The MacArthur Communicative Developmental Inventories: User’s Guide and Technical Manual. Baltimore, MD: Paul H. Brookes Publishing.
12.
FleissJL (1986) The Design and Analysis of Clinical Experiments. New York: John Wiley & Sons.
13.
Fletcher-WatsonSPetrouAScott-BarrettJ. (2015) A trial of an iPad™ intervention targeting social communication skills in children with autism. Autism. Epub ahead of print 26October. DOI: 10.1177/1362361315605624.
14.
GothamKPicklesALordC (2009) Standardizing ADOS scores for a measure of severity in autism spectrum disorders. Journal of Autism and Developmental Disorders39: 693–705.
15.
GothamKPicklesALordC (2012) Trajectories of autism severity in children using standardized ADOS scores. Pediatrics130: e1278–e1284.
16.
GothamKRisiSDawsonG. (2008) A replication of the Autism Diagnostic Observation Schedule (ADOS) revised algorithms. Journal of the American Academy of Child and Adolescent Psychiatry47: 642–651.
17.
GothamKRisiSPicklesA. (2007) The Autism Diagnostic Observation Schedule: revised algorithms for improved diagnostic validity. Journal of Autism and Developmental Disorders37: 613–627.
18.
GreenJCharmanTMcConachieH. (2010) Parent-mediated communication-focused treatment in children with autism (PACT): a randomised controlled trial. The Lancet375: 2152–2160.
19.
GrzadzinskiRCarrTColombiC. (2016) Measuring changes in social communication behaviors: preliminary development of the Brief Observation of Social Communication Change (BOSCC). Journal of Autism and Developmental Disorders46: 2464–2479.
20.
HavenELMananganCNSparrowJK. (2014) The relation of parent-child interaction qualities to social skills in children with and without autism spectrum disorders. Autism18: 292–300.
21.
HusVGothamKLordC (2014) Standardizing ADOS domain scores: separating severity of social affect and restricted and repetitive behaviors. Journal of Autism and Developmental Disorders44: 2400–2412.
22.
JacobsonNSTruaxP (1991) Clinical significance: a statistical approach to defining meaningful change in psychotherapy research. Journal of Consulting and Clinical Psychology59: 12–19.
23.
KasariC (2002) Assessing change in early intervention programs for children with autism. Journal of Autism and Developmental Disorders32: 447–461.
24.
KitzerowJTeufelKWilkerC. (2015) Using the Brief Observation of Social Communication Change (BOSCC) to measure autism-specific development. Autism Research. Epub ahead of print 8December. DOI: 10.1002/aur.1588.
25.
KraemerHCMorganGALeechNL. (2003) Measures of clinical significance. Journal of the American Academy of Child and Adolescent Psychiatry42: 1524–1529.
26.
LordCRisiSLambrechtL. (2000) The Autism Diagnostic Observation Schedule-Generic: a standard measure of social and communication deficits associated with the spectrum of autism. Journal of Autism and Developmental Disorders30: 205–223.
27.
LordCRutterMDiLavoreP. (1999) Autism Diagnostic Observation Schedule (ADOS) Manual. Los Angeles, CA: Western Psychological Services.
28.
LordCRutterMDiLavoreP. (2012) Autism Diagnostic Observation Schedule: Second Edition (ADOS-2). Los Angeles, CA: Western Psychological Services.
29.
LordCWagnerARogersS. (2005) Challenges in evaluating psychosocial interventions for autistic spectrum disorders. Journal of Autism and Developmental Disorders35: 695–708; discussion 709–611.
30.
McConachieHParrJRGlodM. (2015) Systematic review of tools to measure outcomes for young children with autism spectrum disorder. Health Technology Assessment19: 1–506.
31.
MullenE (1995) Mullen Scales of Early Learning: AGS Edition. Circle Pines, MN: American Guidance Service.
32.
Nordahl-HansenAFletcher-WatsonSMcConachieH. (2016) Relations between specific and global outcome measures in a social-communication intervention for children with autism spectrum disorder. Research in Autism Spectrum Disorders29: 19–29.
33.
OosterlingIVisserJSwinkelsS. (2010) Randomized controlled trial of the focus parent training for toddlers with autism: 1-year outcome. Journal of Autism and Developmental Disorders40: 1447–1458.
34.
SchoplerEReichlerRJBashfordA. (1990) The Psychoeducational Profile Revised (PEP-R). Austin, TX: Pro-Ed.
35.
ShumwaySFarmerCThurmA. (2012) The ADOS calibrated severity score: relationship to phenotypic variables and stability over time. Autism Research5: 267–276.
36.
SwinkelsSHDietzCVan DaalenE. (2006) Screening for autistic spectrum in children aged 14 to 15 months. I: the development of the Early Screening of Autistic Traits Questionnaire (ESAT). Journal of Autism and Developmental Disorders36: 723–732.
WiseEA (2004) Methods for analyzing psychotherapy outcomes: a review of clinical significance, reliable change, and recommendations for future directions. Journal of Personality Assessment82: 50–59.
39.
ZanderEWillforsCBerggrenS. (2016) The objectivity of the Autism Diagnostic Observation Schedule (ADOS) in naturalistic clinical settings. European Child & Adolescent Psychiatry25: 769–780.
40.
ZinkILejaegereM (2002) N-CDI: Lijsten voor communicatieve ontwikkeling. Leuven: Acco.
41.
ZwaigenbaumLBaumanMLChoueiriR. (2015) Early intervention for children with autism spectrum disorder under 3 years of age: recommendations for practice and research. Pediatrics136(Suppl. 1): S60–S81.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
