Restricted accessResearch articleFirst published online 2021-1
A Psychometric Analysis of the Social Anxiety Scale for Adolescents Among Youth With Autism Spectrum Disorder: Caregiver–Adolescent Agreement,Factor Structure,and Validity
Social anxiety is common among adolescents with autism spectrum disorder (ASD). An ongoing challenge for both research and clinical practice in ASD is the assessment of anxious symptomatology. Despite its widespread use in samples of youth with ASD, the Social Anxiety Scale for Adolescents (SAS-A) has not received psychometric evaluation within this population; thus, the validity of its use in research and clinical practice for ASD remains unclear. The present study conducted a psychometric analysis of caregiver and adolescent SAS-A forms in a sample of adolescents with ASD (N = 197). Results revealed (1) poor caregiver–adolescent item-level agreement, (2) a two-factor structure, (3) lack of measurement invariance between reporters, and (4) modest evidence for convergent and discriminant validity. Overall, findings suggest that this measure demonstrates reasonable psychometric properties in an ASD sample. Lack of measurement invariance, however, calls for careful interpretation of research involving the SAS-A in ASD samples, particularly when the primary goal is to compare adolescent and caregiver reports. The implications of these findings for future research and clinical practice are discussed.
AickinM.GenslerH. (1996). Adjusting for multiple testing when reporting research results: The Bonferroni vs Holm methods. American Journal of Public Health, 86, 726-728.
2.
American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Washington, DC: Author.
3.
AngoldA.CostelloE. J.MesserS. C.PicklesA. (1995). Development of a short questionnaire for use in epidemiological studies of depression in children and adolescents. International Journal of Methods in Psychiatric Research, 5, 237-249.
4.
BelliniS. (2004). Social skill deficits and anxiety in high-functioning adolescents with autism spectrum disorders. Focus on Autism and Other Developmental Disabilities, 19, 78-86.
5.
BelliniS. (2006). The development of social anxiety in adolescents with autism spectrum disorders. Focus on Autism and Other Developmental Disabilities, 21, 138-145.
6.
BirmaherB.KhetarpalS.BrentD.CullyM.BalachL.KaufmanJ.NeerS. M. (1997). The Screen for Child Anxiety Related Emotional Disorders (SCARED): Scale construction and psychometric characteristics. Journal of the American Academy of Child and Adolescent Psychiatry, 36, 545-553.
7.
Blakeley-SmithA.ReavenJ.RidgeK.HepburnS. (2012). Parent–child agreement of anxiety symptoms in youth with autism spectrum disorders. Research in Autism Spectrum Disorders, 6, 707-716.
8.
BradyE. U.KendallP. C. (1992). Comorbidity of anxiety and depression in children and adolescents. Psychological Bulletin, 111, 244-255.
9.
BrownE. J.TurovskyJ.HeimbergR. G.JusterH. R.BrownT. A.BarlowD. H. (1997). Validation of the Social Interaction Anxiety Scale and the Social Phobia Scale across the anxiety disorders. Psychological Assessment, 9, 21-27.
10.
BrowneM. W.CudeckR. (1993). Alternative ways of assessing model fit. In BollenK. A.LongJ. S. (Eds.), Testing structural equation models (pp. 136-162). Newbury Park, CA: Sage.
11.
BurnetteC. P.MundyP. C.MeyerJ. A.SuttonS. K.VaughanA. E.CharakD. (2005). Weak central coherence and its relations to theory of mind and anxiety in autism. Journal of Autism and Developmental Disorders, 35, 63-73.
12.
BurrowsC. A.UsherL. V.Becker-HaimesE. M.McMahonC. M.MundyP. C.Jensen-DossA.HendersonH. A. (2018). Profiles and correlates of parent–child agreement on social anxiety symptoms in youth with autism spectrum disorder. Journal of Autism and Developmental Disorders, 48, 2023-2037.
13.
ChangY.-C.QuanJ.WoodJ. J. (2012). Effects of anxiety disorder severity on social functioning in children with autism spectrum disorders. Journal of Developmental and Physical Disabilities, 24, 235-245.
14.
ChevallierC.KohlsG.TroianiV.BrodkinE. S.SchultzR. T. (2012). The social motivation theory of autism. Trends in Cognitive Sciences, 16, 231-239.
15.
ComerJ. S.KendallP. C. (2004). A symptom-level examination of parent–child agreement in the diagnosis of anxious youths. Journal of the American Academy of Child and Adolescent Psychiatry, 43, 878-886.
16.
ConstantinoJ. N.DavisS. A.ToddR. D.SchindlerM. K.GrossM. M.BrophyS. L.. . . ReichW. (2003). Validation of a brief quantitative measure of autistic traits: Comparison of the Social Responsiveness Scale with the Autism Diagnostic Interview-Revised. Journal of Autism and Developmental Disorders, 33, 427-433.
17.
ConstantinoJ. N.GruberC. P. (2005). Social Responsiveness Scale (SRS). Los Angeles, CA: Western Psychological Services.
18.
CostelloE. J.AngoldA. (1988). Scales to assess child and adolescent depression: Checklists, screens, and nets. Journal of the American Academy of Child and Adolescent Psychiatry, 27, 726-737.
19.
CummingsC. M.CaporinoN. E.KendallP. C. (2014). Comorbidity of anxiety and depression in children and adolescents: 20 Years after. Psychological Bulletin, 140, 816-845.
20.
De Los ReyesA.KazdinA. E. (2005). Informant discrepancies in the assessment of childhood psychopathology: A critical review, theoretical framework, and recommendations for further study. Psychological Bulletin, 131, 483-509.
21.
DuvekotJ.EndeJ.VerhulstF. C.Greaves-LordK. (2017). Examining bidirectional effects between the autism spectrum disorder (ASD) core symptom domains and anxiety in children with ASD. Journal of Child Psychology and Psychiatry, 59, 277-284.
22.
FactorR. S.RyanS. M.FarleyJ. P.OllendickT. H.ScarpaA. (2017). Does the presence of anxiety and ADHD symptoms add to social impairment in children with autism spectrum disorder?Journal of Autism and Developmental Disorders, 47, 1122-1134.
23.
FinchH. (2006). Comparison of the performance of varimax and promax rotations: Factor structure recovery for dichotomous items. Journal of Educational Measurement, 43(1), 39-52.
24.
García-LópezL. J.OlivaresJ.HidalgoM. D.BeidelD. C.TurnerS. M. (2001). Psychometric properties of the social phobia and anxiety inventory, the Social Anxiety Scale for Adolescents, the Fear of Negative Evaluation Scale, and the Social Avoidance and Distress Scale in an adolescent Spanish-speaking sample. Journal of Psychopathology and Behavioral Assessment, 23, 51-59.
25.
Hall-LandeJ. A.EisenbergM. E.ChristensonS. L.Neumark-SztainerD. (2007). Social isolation, psychological health, and protective factors in adolescence. Adolescence, 42(166), 265-286.
26.
HendersonH.SchwartzC.MundyP.BurnetteC.SuttonS.ZahkaN.PradellaA. (2006). Response monitoring, the error-related negativity, and differences in social behavior in autism. Brain and Cognition, 61, 96-109.
27.
HolmS. (1979). A simple sequentially rejective multiple test procedure. Scandinavian Journal of Statistics, 6, 65-70.
28.
HuL.BentlerP. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1-55.
29.
HurtigT.KuusikkoS.MattilaM.-L.HaapsamoH.EbelingH.JussilaK.. . . MoilanenI. (2009). Multi-informant reports of psychiatric symptoms among high-functioning adolescents with Asperger syndrome or autism. Autism, 13, 583-598.
30.
Inderbitzen-NolanH. M.WaltersK. S. (2000). Social Anxiety Scale for adolescents: Normative data and further evidence of construct validity. Journal of Clinical Child Psychology, 29, 360-371.
31.
JitlinaK.ZumboB.MirendaP.FordL.BennettT.GeorgiadesS.. . . DukuE. (2017). Psychometric properties of the Spence Children’s Anxiety Scale: Parent report in children with autism spectrum disorder. Journal of Autism and Developmental Disorders, 47, 3847-3856.
32.
KaboskiJ. R.DiehlJ. J.BeriontJ.CrowellC. R.VillanoM.WierK.TangK. (2015). Brief report: A pilot summer robotics camp to reduce social anxiety and improve social/vocational skills in adolescents with ASD. Journal of Autism and Developmental Disorders, 45, 3862-3869.
33.
KentL.VostanisP.FeehanC. (1997). Detection of major and minor depression in children and adolescents: Evaluation of the Mood and Feelings Questionnaire. Journal of Child Psychology and Psychiatry, 38, 565-573.
34.
KernsC.KendallP. C.BerryL.SoudersM. C.FranklinM. E.SchultzR. T.. . . HerringtonJ. (2014). Traditional and atypical presentations of anxiety in youth with autism spectrum disorder. Journal of Autism and Developmental Disorders, 44, 2851-2861.
35.
KernsC. M.RennoP.KendallP. C.WoodJ. J.StorchE. A. (2017). Anxiety Disorders Interview Schedule–Autism addendum: Reliability and validity in children with autism spectrum disorder. Journal of Clinical Child and Adolescent Psychology, 46, 88-100.
36.
KernsC. M.RumpK.WorleyJ.KratzH.McVeyA.HerringtonJ.MillerJ. (2016). The differential diagnosis of anxiety disorders in cognitively-able youth with autism. Cognitive and Behavioral Practice, 23, 530-547.
37.
KuusikkoS.Pollock-WurmanR.JussilaK.CarterA. S.MattilaM.-L.EbelingH.. . .MoilanenI. (2008). Social anxiety in high-functioning children and adolescents with autism and Asperger syndrome. Journal of Autism and Developmental Disorders, 38, 1697-1709.
38.
La GrecaA. M.DandesS. K.WickP.ShawK.StoneW. L. (1988). Development of the Social Anxiety Scale for Children: Reliability and concurrent validity. Journal of Clinical Child Psychology, 17, 84-91.
39.
La GrecaA. M.LopezN. (1998). Social anxiety among adolescents: Linkages with peer relations and friendships. Journal of Abnormal Child Psychology, 26, 83-94.
40.
La GrecaA. M.StoneW. L. (1993). Social Anxiety Scale for Children-Revised: Factor structure and concurrent validity. Journal of Clinical Child Psychology, 22, 17-27.
41.
LaugesonE.EllingsenR.TucciL. C.BolourianY.BatesS. (2015). Using parent-assistance and teacher-facilitation to teach social skills in the classroom: Treatment outcome for the PEERS® school-based curriculum. Retrieved from https://imfar.confex.com/imfar/2015/webprogram/Paper19151.html
42.
LaugesonE. A.FrankelF.GantmanA.DillonA. R.MogilC. (2012). Evidence-based social skills training for adolescents with autism spectrum disorders: The UCLA PEERS program. Journal of Autism and Developmental Disorders, 42, 1025-1036.
43.
LeeI. A.PreacherK. J. (2013). Calculation for the test of the difference between two dependent correlations with one variable in common [Computer software]. Retrieved from http://quantpsy.org
44.
LeyferO. T.FolsteinS. E.BacalmanS.DavisN. O.DinhE.MorganJ.. . . LainhartJ. E. (2006). Comorbid psychiatric disorders in children with autism: Interview development and rates of disorders. Journal of Autism and Developmental Disorders, 36, 849-861.
45.
LiuY.MillsapR. E.WestS. G.TeinJ.-Y.TanakaR.GrimmK. J. (2017). Testing measurement invariance in longitudinal data with ordered-categorical measures. Psychological Methods, 22, 486-506.
46.
LopataC.ToomeyJ. A.FoxJ. D.VolkerM. A.ChowS. Y.ThomeerM. L.. . . SmerbeckA. M. (2010). Anxiety and depression in children with HFASDs: Symptom levels and source differences. Journal of Abnormal Child Psychology, 38, 765-776.
47.
LordC.RutterM.DiLavoreP. C.RisiS.GothamK.BishopS. L. (2001). Autism Diagnostic Observation Schedule (ADOS). Los Angeles: Western Psychological Services.
48.
MagiatiI.ChanJ. Y.TanW.-L. J.PoonK. K. (2014). Do non-referred young people with autism spectrum disorders and their caregivers agree when reporting anxiety symptoms? A preliminary investigation using the Spence Children’s Anxiety Scale. Research in Autism Spectrum Disorders, 8, 546-558.
49.
MarchJ. S. (2013). Multidimensional Anxiety Scale for Children (2nd ed.). Toronto, Ontario, Canada: Multi-Health Systems.
50.
MattickR. P.ClarkeJ. C. (1998). Development and validation of measures of social phobia scrutiny fear and social interaction anxiety. Behaviour Research and Therapy, 36, 455-470.
51.
MayT.CornishK.RinehartN. J. (2015). Parent-child agreement using the Spence Children’s Anxiety Scale and a thermometer in children with autism spectrum disorder. Autism Research and Treatment, 2015, 315495. doi:10.1155/2015/315495
52.
MayesS. D.CalhounS. L.MurrayM. J.ZahidJ. (2011). Variables associated with anxiety and depression in children with autism. Journal of Developmental and Physical Disabilities, 23, 325-337.
53.
MazefskyC. A.KaoJ.OswaldD. P. (2011). Preliminary evidence suggesting caution in the use of psychiatric self-report measures with adolescents with high-functioning autism spectrum disorders. Research in Autism Spectrum Disorders, 5, 164-174.
54.
McPartlandJ. C.CrowleyM. J.PerszykD. R.MukerjiC. E.NaplesA. J.WuJ.MayesL. C. (2012). Preserved reward outcome processing in ASD as revealed by event-related potentials. Journal of Neurodevelopmental Disorders, 4(1), 16. doi:10.1186/1866-1955-4-16
55.
McVeyA. J.SchiltzH. K.HaendelA. D.DolanB. K.WillarK. S.PleissS. S.. . . MurphyC. C. (2018). Social difficulties in youth with autism with and without anxiety and ADHD symptoms. Autism Research, 11, 1679-1689.
56.
MeyerJ. A.MundyP. C.Van HeckeA. V.DurocherJ. S. (2006). Social attribution processes and comorbid psychiatric symptoms in children with Asperger syndrome. Autism, 10, 383-402.
57.
MuthénL. K.MuthénB. O. (1998-2012). Mplus user’s guide (7th ed.). Los Angeles, CA: Muthén & Muthén.
58.
MyersM. G.SteinM. B.AaronsG. A. (2002). Cross validation of the Social Anxiety Scale for Adolescents in a high school sample. Journal of Anxiety Disorders, 16, 221-232.
59.
OlinoT. M.FinsaasM.DoughertyL. R.KleinD. N. (2018). Is parent–child disagreement on child anxiety explained by differences in measurement properties? An examination of measurement invariance across informants and time. Frontiers in Psychology, 9, 1295. doi:10.3389/fpsyg.2018.01295
60.
OoiY. P.WengS.-J.MagiatiI.AngR. P.GohT. J.FungD. S.SungM. (2016). Factors influencing agreement between parent and child reports of anxiety symptoms among children with high-functioning autism spectrum disorders. Journal of Developmental and Physical Disabilities, 28, 407-424.
61.
PatelS.DayT. N.JonesN.MazefskyC. A. (2017). Association between anger rumination and autism symptom severity, depression symptoms, aggression, and general dysregulation in adolescents with autism spectrum disorder. Autism, 21, 181-189.
62.
PuglieseC. E.FritzM. S.WhiteS. W. (2015). The role of anger rumination and autism spectrum disorder–linked perseveration in the experience of aggression in the general population. Autism, 19, 704-712.
63.
RodebaughT. L.WoodsC. M.HeimbergR. G.LiebowitzM. R.SchneierF. R. (2006). The factor structure and screening utility of the Social Interaction Anxiety Scale. Psychological Assessment, 18, 231-237.
64.
RodgersJ.WighamS.McConachieH.FreestonM.HoneyE.ParrJ. R. (2016). Development of the anxiety scale for children with autism spectrum disorder (ASC-ASD). Autism Research, 9, 1205-1215.
65.
SchiltzH.McIntyreN.Swain-LerroL.ZajicM.MundyP. (2017). The stability of self-reported anxiety in youth with autism versus ADHD or typical development. Journal of Autism and Developmental Disorders, 47, 3756-3764.
66.
SchohlK. A.Van HeckeA. V.CarsonA. M.DolanB.KarstJ.StevensS. (2014). A replication and extension of the PEERS intervention: Examining effects on social skills and social anxiety in adolescents with autism spectrum disorders. Journal of Autism and Developmental Disorders, 44, 532-545.
67.
SharpC.GoodyerI. M.CroudaceT. J. (2006). The Short Mood and Feelings Questionnaire (SMFQ): A unidimensional item response theory and categorical data factor analysis of self-report ratings from a community sample of 7- through 11-year-old children. Journal of Abnormal Child Psychology, 34, 365-377.
68.
SpenceS. H. (1998). A measure of anxiety symptoms among children. Behaviour Research and Therapy, 36, 545-566.
69.
SterlingL.DawsonG.EstesA.GreensonJ. (2008). Characteristics associated with presence of depressive symptoms in adults with autism spectrum disorder. Journal of Autism and Developmental Disorders, 38, 1011-1018.
70.
StorchE. A.Masia-WarnerC.DentH. C.RobertiJ. W.FisherP. H. (2004). Psychometric evaluation of the Social Anxiety Scale for Adolescents and the Social Phobia and Anxiety Inventory for Children: Construct validity and normative data. Journal of Anxiety Disorders, 18, 665-679.
71.
StratisE. A.LecavalierL. (2015). Informant agreement for youth with autism spectrum disorder or intellectual disability: A meta-analysis. Journal of Autism and Developmental Disorders, 45, 1026-1041.
72.
SuttonS. K.BurnetteC. P.MundyP. C.MeyerJ.VaughanA.SandersC.YaleM. (2005). Resting cortical brain activity and social behavior in higher functioning children with autism. Journal of Child Psychology and Psychiatry, 46, 211-222.
73.
SwainD.ScarpaA.WhiteS.LaugesonE. (2015). Emotion dysregulation and anxiety in adults with ASD: Does social motivation play a role?Journal of Autism and Developmental Disorders, 45, 3971-3977.
74.
ThaparA.McGuffinP. (1998). Validity of the shortened Mood and Feelings Questionnaire in a community sample of children and adolescents: A preliminary research note. Psychiatry Research, 81, 259-268.
75.
UljarevićM.HamiltonA. (2013). Recognition of emotions in autism: A formal meta-analysis. Journal of Autism and Developmental Disorders, 43, 1517-1526.
76.
UljarevićM.RichdaleA. L.McConachieH.HedleyD.CaiR. Y.MerrickH.. . . Le CouteurA. (2017). The Hospital Anxiety and Depression Scale: Factor structure and psychometric properties in older adolescents and young adults with autism spectrum disorder. Autism Research, 11, 258-269.
77.
UngD.McBrideN.CollierA.SellesR.SmallB.PharesV.StorchE. (2016). The relationship between peer victimization and the psychological characteristics of youth with autism spectrum disorder. Research in Autism Spectrum Disorders, 32, 70-79.
78.
UsherL. VBurrowsC. A.SchwartzC. B.HendersonH. A. (2015). Social competence with an unfamiliar peer in children and adolescents with high functioning autism: Measurement and individual differences. Research in Autism Spectrum Disorders, 17, 25-39.
79.
Van RoekelE.ScholteR. H. J.DiddenR. (2010). Bullying among adolescents with autism spectrum disorders: Prevalence and perception. Journal of Autism and Developmental Disorders, 40, 63-73.
van SteenselF. J. A.HeemanE. J. (2017). Anxiety levels in children with autism spectrum disorder: A meta-analysis. Journal of Child and Family Studies, 26, 1753-1767.
82.
WatsonD.FriendR. (1969). Measurement of social-evaluative anxiety. Journal of Consulting and Clinical Psychology, 33, 448-457.
83.
WhiteS. W.BrayB. C.OllendickT. H. (2012). Examining shared and unique aspects of social anxiety disorder and autism spectrum disorder using factor analysis. Journal of Autism and Developmental Disorders, 42, 874-884.
84.
WhiteS. W.LernerM. D.McLeodB. D.WoodJ. J.GinsburgG. S.KernsC.. . . WalkupJ. (2015). Anxiety in youth with and without autism spectrum disorder: Examination of factorial equivalence. Behavior Therapy, 46, 40-53.
WhiteS. W.Roberson-NayR. (2009). Anxiety, social deficits, and loneliness in youth with autism spectrum disorders. Journal of Autism and Developmental Disorders, 39, 1006-1013.
87.
WhiteS. W.ScarpaA.ConnerC. M.MaddoxB. B.BoneteS. (2015). Evaluating change in social skills in high-functioning adults with autism spectrum disorder using a laboratory-based observational measure. Focus on Autism and Other Developmental Disabilities, 30, 3-12.
88.
WhiteS. W.SchryA. R.MaddoxB. B. (2012). Brief report: The assessment of anxiety in high-functioning adolescents with autism spectrum disorder. Journal of Autism and Developmental Disorders, 42, 1138-1145.
89.
WilliamsD. (2010). Theory of own mind in autism: Evidence of a specific deficit in self-awareness?Autism, 14, 474-494.
90.
WoodJ. J.GadowK. D. (2010). Exploring the nature and function of anxiety in youth with autism spectrum disorders. Clinical Psychology: Science and Practice, 17, 281-292.
91.
ZablotskyB.BlackL. I.MaennerM. J.SchieveL. A.BlumbergS. J. (2015). Estimated prevalence of autism and other developmental disabilities following questionnaire changes in the 2014 National Health Interview Survey. National Health Statistics Reports, 87, 1-20.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
