Do the Autism Spectrum Quotient (AQ) and Autism Spectrum Quotient Short Form (AQ-S) Primarily Reflect General ASD Traits or Specific ASD Traits? A Bi-Factor Analysis
Restricted accessResearch articleFirst published online June, 2017
Do the Autism Spectrum Quotient (AQ) and Autism Spectrum Quotient Short Form (AQ-S) Primarily Reflect General ASD Traits or Specific ASD Traits? A Bi-Factor Analysis
In the current study, we fit confirmatory bi-factor models to the items of the Autism Spectrum Quotient (AQ) and Autism Spectrum Quotient Short Form (AQ-S) in order to assess the extents to which the items of each reflect general versus specific factors. The models were fit in a combined sample of individuals with and without a clinical diagnosis of autism spectrum disorders. Results indicated that, with the exception of the Attention to Details factor in the AQ and the Numbers/Patterns factors in the AQ-S, items primarily reflected a general factor. This suggests that when attempting to estimate an association between a specific symptom measured by the AQ or AQ-S and some criterion, associations will be confounded by the general factor. To resolve this, we recommend using a bi-factor measurement model or factor scores from a bi-factor measurement whenever hypotheses about specific symptoms are being assessed.
American Psychiatric Association. (1994). Diagnostic and statistical manual of mental disorders (4th ed.). Washington, DC: Author.
2.
American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Washington, DC: Author.
3.
Baron-CohenS.WheelwrightS.SkinnerR.MartinJ.ClubleyE. (2001). The autism-spectrum quotient (AQ): Evidence from Asperger syndrome/high-functioning autism, males and females, scientists and mathematicians. Journal of Autism and Developmental Disorders, 31, 5-17.
4.
BaumanM. L. (2010). Medical comorbidities in autism: Challenges to diagnosis and treatment. Neurotherapeutics, 7, 320-327.
5.
Ben-SassonA.HenL.FlussR.CermakS. A.Engel-YegerB.GalE. (2009). A meta-analysis of sensory modulation symptoms in individuals with autism spectrum disorders. Journal of Autism and Developmental Disorders, 39, 1-11.
6.
BoothT.MurrayA. L.McKenzieK.KuenssbergR.O’DonnellM.BurnettH. (2013). Brief report: An evaluation of the AQ-10 as a brief screening instrument for ASD in adults. Journal of Autism and Developmental Disorders, 43, 2997-3000.
7.
BraekenJ. (2011). A boundary mixture approach to violations of conditional independence. Psychometrika, 76, 57-76.
8.
BuckT. R.ViskochilJ.FarleyM.CoonH.McMahonW. M.MorganJ.BilderD. A. (2014). Psychiatric comorbidity and medication use in adults with autism spectrum disorder. Journal of Autism and Developmental Disorders, 44, 3063-3071.
9.
BurkeJ. D.BoylanK.RoweR.DukuE.SteppS. D.HipwellA. E.WaldmanI. D. (2014). Identifying the irritability dimension of ODD: Application of a modified bifactor model across five large community samples of children. Journal of Abnormal Psychology, 123, 841-851.
10.
CaspiA.HoutsR. M.BelskyD. W.Goldman-MellorS. J.HarringtonH.IsraelS.. . . MoffittT. E. (2014). The p factor: One general psychopathology factor in the structure of psychiatric disorders?Clinical Psychological Science, 2, 119-137.
11.
DawsonG.WebbS. J.McPartlandJ. (2005). Understanding the nature of face processing impairment in autism: Insights from behavioral and electrophysiological studies. Developmental Neuropsychology, 27, 403-424.
12.
DeMarsC. E. (2013). A tutorial on interpreting bifactor model scores. International Journal of Testing, 13, 354-378.
GillbergC.GillbergC.RåstamM.WentzE. (2001). The Asperger syndrome (and high-functioning autism) Diagnostic Interview (ASDI): A preliminary study of a new structured clinical interview. Autism, 5, 57-66.
15.
HabermanS. J. (2008). When can subscores have value?. Journal of Educational and Behavioral Statistics, 33, 204-229.
16.
HappéF.BoothR.CharltonR.HughesC. (2006). Executive function deficits in autism spectrum disorders and attention-deficit/hyperactivity disorder: Examining profiles across domains and ages. Brain and Cognition, 61, 25-39.
17.
HappéF.FrithU. (2006). The weak coherence account: Detail-focused cognitive style in autism spectrum disorders. Journal of Autism and Developmental Disorders, 36, 5-25.
18.
HarrisonD. A.McLaughlinM. E.CoalterT. M. (1996). Context, cognition, and common method variance: Psychometric and verbal protocol evidence. Organizational Behavior and Human Decision Processes, 68, 246-261.
19.
HoekstraR. A.VinkhuyzenA. A.WheelwrightS.BartelsM.BoomsmaD. I.Baron-CohenS.. . . van der SluisS. (2011). The construction and validation of an abridged version of the autism-spectrum quotient (AQ-Short). Journal of Autism and Developmental Disorders, 41, 589-596.
20.
HuL. T.BentlerP. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6, 1-55.
21.
JohnsonS. A.FilliterJ. H.MurphyR. R. (2009). Discrepancies between self- and parent-perceptions of autistic traits and empathy in high functioning children and adolescents on the autism spectrum. Journal of Autism and Developmental Disorders, 39, 1706-1714.
22.
KuenssbergR.MurrayA. L.BoothT.McKenzieK. (2014). Structural validation of the abridged Autism Spectrum Quotient–Short Form in a clinical sample of people with autism spectrum disorders. Autism, 18, 69-75.
23.
LaheyB. B.ApplegateB.HakesJ. K.ZaldD. H.HaririA. R.RathouzP. J. (2012). Is there a general factor of prevalent psychopathology during adulthood?Journal of Abnormal Psychology, 121, 971-977.
24.
LaheyB. B.RathouzP. J.KeenanK.SteppS. D.LoeberR.HipwellA. E. (2015). Criterion validity of the general factor of psychopathology in a prospective study of girls. Journal of Child Psychology and Psychiatry, 56, 415-422.
25.
LecavalierL.GadowK. D.DeVincentC. J.HoutsC.EdwardsM. C. (2009). Deconstructing the PDD clinical phenotype: Internal validity of the DSM-IV. Journal of Child Psychology and Psychiatry, 50, 1246-1254.
26.
LopezB. R.LincolnA. J.OzonoffS.LaiZ. (2005). Examining the relationship between executive functions and restricted, repetitive symptoms of autistic disorder. Journal of Autism and Developmental Disorders, 35, 445-460.
27.
LordC.RutterM.Le CouteurA. (1994). Autism Diagnostic Interview-Revised: A revised version of a diagnostic interview for caregivers of individuals with possible pervasive developmental disorders. Journal of Autism and Developmental Disorders, 24, 659-685.
28.
MandyW.CharmanT.PuuraK.SkuseD. (2014). Investigating the cross-cultural validity of DSM-5 autism spectrum disorder: Evidence from Finnish and UK samples. Autism, 18, 45-54.
29.
MatsonJ. L.ShoemakerM. (2009). Intellectual disability and its relationship to autism spectrum disorders. Research in Developmental Disabilities, 30, 1107-1114.
30.
Maydeu-OlivaresA.CoffmanD. L. (2006). Random intercept item factor analysis. Psychological Methods, 11, 344-362.
31.
McDonaldR. P. (1999). Test theory: A unified treatment. Mahwah, NJ: LEA.
32.
MurrayA. L.BoothT.McKenzieK.KuenssbergR.O’DonnellM. (2014). Are autistic traits measured equivalently in individuals with and without an autism spectrum disorder? An invariance analysis of the Autism Spectrum Quotient Short Form. Journal of Autism and Developmental Disorders, 44, 55-64.
33.
MurrayA. L.JohnsonW. (2013). The limitations of model fit in comparing the bi-factor versus higher-order models of human cognitive ability structure. Intelligence, 41, 407-422.
34.
MurrayA. L.McKenzieK.KuenssbergR.O’DonnellM. (2014). Are we under-estimating the association between autism symptoms? The importance of considering simultaneous selection when using samples of individuals who meet diagnostic criteria for an autism spectrum disorder. Journal of Autism and Developmental Disorders, 44, 2921-2930.
35.
MuthénL. K.MuthénB. O. (1998-2013). Mplus user’s guide (6th ed.). Los Angeles, CA: Muthén & Muthén.
36.
PosserudM. B.BreivikK.GillbergC.LundervoldA. J. (2013). ASSERT—The autism symptom self-report for adolescents and adults: Bifactor analysis and validation in a large adolescent population. Research in Developmental Disabilities, 34, 4495-4503.
37.
R Core Team (2014). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing. Retrieved from http://www.R-project.org/
38.
ReiseS. P. (2012). Invited paper: The rediscovery of bifactor measurement models. Multivariate Behavioral Research, 47, 667-696.
39.
ReiseS. P.BonifayW. E.HavilandM. G. (2013). Scoring and modeling psychological measures in the presence of multidimensionality. Journal of Personality Assessment, 95, 129-140.
40.
ReiseS. P.MooreT. M.HavilandM. G. (2010). Bifactor models and rotations: Exploring the extent to which multidimensional data yield univocal scale scores. Journal of Personality Assessment, 92, 544-559.
41.
ReiseS. P.MorizotJ.HaysR. D. (2007). The role of the bifactor model in resolving dimensionality issues in health outcomes measures. Quality of Life Research, 16, 19-31.
42.
RevelleW. (1979). Hierarchical cluster analysis and the internal structure of tests. Multivariate Behavioral Research, 14, 57-74.
43.
RevelleW.ZinbargR. E. (2009). Coefficients alpha, beta, omega, and the glb: Comments on Sijtsma. Psychometrika, 74, 145-154.
Russell-SmithS. N.MayberyM. T.BaylissD. M. (2011). Relationships between autistic-like and schizotypy traits: An analysis using the Autism Spectrum Quotient and Oxford-Liverpool Inventory of Feelings and Experiences. Personality and Individual Differences, 51, 128-132.
47.
Schermelleh-EngelK.MoosbruggerH.MullerH. (2003). Evaluating the fit of structural equation models: Test of significance and descriptive goodness-of-fit measures. Methods of Psychological Research, 8, 23-74.
48.
SimmsL. J.GrösD. F.WatsonD.O’HaraM. W. (2008). Parsing the general and specific components of depression and anxiety with bifactor modeling. Depression and Anxiety, 25, E34-E46.
49.
SnowA. V.LecavalierL.HoutsC. (2009). The structure of the Autism Diagnostic Interview-Revised: Diagnostic and phenotypic implications. Journal of Child Psychology and Psychiatry, 50, 734-742.
50.
StewartM. E.AustinE. J. (2009). The structure of the Autism-Spectrum Quotient (AQ): Evidence from a student sample in Scotland. Personality and Individual Differences, 47, 224-228.
51.
van der MaasH. L.DolanC. V.GrasmanR. P.WichertsJ. M.HuizengaH. M.RaijmakersM. E. (2006). A dynamical model of general intelligence: The positive manifold of intelligence by mutualism. Psychological Review, 113, 842-861.
52.
WatkinsM. W.CanivezG. L.JamesT.JamesK.GoodR. (2013). Construct validity of the WISC–IVUK with a large referred Irish sample. International Journal of School & Educational Psychology, 1, 102-111.
53.
WatsonD.O’HaraM. W.SimmsL. J.KotovR.ChmielewskiM.McDade-MontezE. A.. . . StuartS. (2007). Development and validation of the Inventory of Depression and Anxiety Symptoms (IDAS). Psychological Assessment, 19, 253-268.
54.
WechslerD. (2003). Wechsler intelligence scale for children (4th ed.). San Antonio, TX: Psychological Corporation.
55.
WilliamsD. M.BowlerD. M. (2014). Autism spectrum disorder: Fractionable or coherent?Autism, 18, 2-5.
56.
WilloughbyM. T.BlantonZ. E. (2015). Replication and external validation of a bi-factor parameterization of attention deficit/hyperactivity symptomatology. Journal of Clinical Child & Adolescent Psychology, 44, 68-79.
