The Broad Autism Phenotype–International Test (BAP-IT): A two-domain-based test for the assessment of the broad autism phenotype

Abstract

The broad autism phenotype is the phenotypic expression of the primary characteristics of autism. However, currently available tests do not agree with the two-domain operationalization of broad autism phenotype or autism, and their internal structure has shown instability across applications. This study presents the Broad Autism Phenotype–International Test, the first such test designed to target a two-domain operationalization in Spain and the United Kingdom. A broad pilot study was conducted in three community samples, two from Spain (ES1, N = 970; ES2, N = 460) and one from the United Kingdom (N = 530). The Broad Autism Phenotype–International Test consists of 20 items distributed into the SOCIAL-BAP and RIRE-BAP dimensions, representing the seven autistic subdomains. Common factor approaches were used to find a simple and invariant factor structure between countries. The Broad Autism Phenotype–International Test presents full metric invariance between two Spanish samples, partial invariance between countries, and adequate omega reliability estimation. Evidence-based results on the relationships of the SOCIAL-BAP and RIRE-BAP to other variables (the Social Responsiveness Scale-2 and the Broad Autism Phenotype Questionnaire) support the interpretation of its scores for the intended uses. The evidence provided in this article shows that the Broad Autism Phenotype–International Test functions adequately compared to other available broad autism phenotype tests, such as the Broad Autism Phenotype Questionnaire.

Lay abstract

The broad autism phenotype refers to a group of behaviors related to autism spectrum disorder, but that appear to a lesser extent. Its assessment has been performed through outdated broad autism phenotype/autism spectrum disorder definitions and tests. To address this problem, this study presents the development of a new test, the Broad Autism Phenotype–International Test, a 20-item measure consisting of two dimensions, SOCIAL-BAP and RIRE-BAP, targeting the two-domain operationalization of autism spectrum disorder in Spain and the United Kingdom. Unlike the Broad Autism Phenotype Questionnaire, this test received empirical support as a quick and effective broad autism phenotype measure that can facilitate both broad autism phenotype/autism spectrum disorder research and interventions. This is the first step to studying the BAP in several Spanish and English-speaking countries.

Keywords

autism spectrum disorder broad autism phenotype test construction test invariance validity evidence

Get full access to this article

View all access options for this article.

References

American Educational Research Association. (2014). Standards for educational and psychological testing. American Educational Research Association, American Psychological Association, National Council on Measurement in Education.

American Psychiatric Association. (1994). Diagnostic and statistical manual of mental disorders (DSM-IV). American Psychiatric Association.

American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (DSM-5®). American Psychiatric Publishing.

Asparouhov

Muthén

(2009). Exploratory structural equation modeling. Structural Equation Modeling: A Multidisciplinary Journal, 16(3), 397–438. https://doi.org/10.1080/10705510903008204

Baron-Cohen

Wheelwright

Skinner

Martin

Clubley

(2001). The autism-spectrum quotient (AQ): Evidence from Asperger syndrome/high-functioning autism, males and females, scientists, and mathematicians. Journal of Autism and Developmental Disorders, 31, 5–17. https://doi.org/10.1023/A:1005653411471

Bölte

Poustka

Constantino

J. N.

(2008). Assessing autistic traits: Cross-cultural validation of the social responsiveness scale (SRS). Autism Research, 1(6), 354–363. https://doi.org/10.1002/aur.49

Bolton

P. F.

Pickles

Murphy

Rutter

(1998). Autism, affective and other psychiatric disorders: Patterns of familial aggregation. Psychological Medicine, 28, 385–395. https://doi.org/10.1017/S0033291797006004

Bond

T. G.

Fox

C. M.

(2015). Applying the Rasch model: Fundamental measurement in the human sciences (3rd ed.). Lawrence Erlbaum.

Broderick

Wade

J. L.

Meyer

J. P.

Hull

Reeve

R. E.

(2015). Model invariance across genders of the Broad Autism Phenotype Questionnaire. Journal of Autism and Developmental Disorders, 45(10), 3133–3147. https://doi.org/3133-3147.10.1007/s10803-015-2472-z

10.

Brown

T. A.

(2015). Confirmatory factor analysis for applied research. Guilford Publications.

11.

Buz

Prieto

. (2013). Analysis of the de Jong Gierveld loneliness scale using the Rasch model. Universitas Psychologica, 12(3). https://doi.org/10.11144/Javeriana.upsy12-3.aesd

12.

Byrne

B. M.

Shavelson

R. J.

Muthén

(1989). Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance. Psychological Bulletin, 105(3), 456–466. https://doi.org/10.1037/0033-2909.105.3.456

13.

Camodeca

(2019). Theory of mind performance in broad autism phenotype groups: Between-group differences and predictor variables. Journal of Autism and Developmental Disorders, 49, 4079–4096. https://doi.org/10.1007/s10803-019-04126-6

14.

Cheung

F. M.

van de Vijver

F. J. R.

Leong

F. T. L.

(2011). Toward a new approach to the study of personality in culture. American Psychologist, 66(7), 593–603. https://doi.org/10.1037/a0022389

15.

Christensen

A. P.

Golino

(2021). Estimating the stability of psychological dimensions via bootstrap exploratory graph analysis: A Monte Carlo simulation and tutorial. Psych, 3, 479–500. https://doi.org/10.3390/psych3030032

16.

Connor

K. M.

Davidson

J. R.

Churchill

L. E.

Sherwood

Weisler

R. H.

Foa

(2000). Psychometric properties of the Social Phobia Inventory (SPIN): New self-rating scale. The British Journal of Psychiatry, 176(4), 379–386. https://doi.org/10.1192/bjp.176.4.379

17.

Constantino

J. N.

Charman

(2016). Diagnosis of autism spectrum disorder: Reconciling the syndrome, its diverse origins, and variation in expression. The Lancet Neurology, 15(3), 279–291. https://doi.org/10.1016/S1474-4422(15)00151-9

18.

Constantino

J. N.

Gruber

C. P.

(2012). Social Responsiveness Scale: SRS-2. Western Psychological Services.

19.

Constantino

J. N.

Gruber

C. P.

(2017). Social Responsiveness Scale Spanish: SRS-2. Western Psychological Services.

20.

Constantino

J. N.

Todd

R. D.

(2003). Autistic traits in the general population: A twin study. Archives of General Psychiatry, 60(5), 524–530. https://doi.org/10.1016/S0140-6736(18)31129-2

21.

De Jong Gierveld

Kamphuis

F. H

. (1985). The development of a Rasch-type loneliness scale. Applied Psychological Measurement, 9, 289–299. https://doi.org/10.1177/014662168500900307

22.

Dorans

N. J.

Middleton

(2012). Addressing the extreme assumptions of presumed linkings. Journal of Educational Measurement, 49(1), 1–18. https://doi.org/10.1111/j.1745-3984.2011.00157.x

23.

Downing

S. M.

(2002). Threats to the validity of locally developed multiple-choice tests in medical education: Construct-irrelevant variance and construct underrepresentation. Advances in Health Sciences Education, 7, 235–241. https://doi.org/10.1023/A:1021112514626

24.

Downing

S. M.

Haladyna

(2006). Handbook of test development. Lawrence Erlbaum.

25.

Faso

D. J.

Corretti

C. A.

Ackerman

R. A.

Sasson

N. J.

(2016). The broad autism phenotype predicts relationship outcomes in newly formed college roommates. Autism, 20(4), 412–424. https://doi.org/10.1177/1362361315585733

26.

Foa

E. B.

Huppert

J. D.

Leiberg

Langner

Kichic

Hajcak

Salkovskis

P. M.

(2002). The Obsessive-Compulsive Inventory: Development and validation of a short version. Psychological Assessment, 14(4), 485–496. https://doi.org/10.1037/1040-3590.14.4.485

27.

Frazier

T. W.

Ratliff

K. R.

Gruber

Zhang

Law

P. A.

Constantino

J. N.

(2014). Confirmatory factor analytic structure and measurement invariance of quantitative autistic traits measured by the Social Responsiveness Scale-2. Autism, 18, 31–44. https://doi.org/10.1177/1362361313500382

28.

Freeth

Milne

Sheppard

Ramachandran

(2014). Autism across cultures: Perspectives from non-western cultures and implications for research. In Volkmar

F. R.

Paul

Rogers

S. J.

Pelphrey

K. A.

(Eds.), Handbook of autism and pervasive developmental disorders (4th ed., pp. 997–1013). Wiley. https://doi.org/10.1002/9781118911389.hautc43

29.

Freitag

C. M.

Kleser

Schneider

von Gontard

(2007). Quantitative assessment of neuromotor function in adolescents with high functioning autism and Asperger syndrome. Journal of Autism and Developmental Disorders, 37(5), 948–959. https://doi.org/10.1007/s10803-006-0235-6

30.

Fullana

M. A.

Tortella-Feliu

Caseras

Andión

Ó.

Torrubia

Mataix-Cols

(2005). Psychometric properties of the Spanish version of the Obsessive–Compulsive Inventory—Revised in a non-clinical sample. Journal of Anxiety Disorders, 19(8), 893–903. https://doi.org/10.1016/j.janxdis.2004.10.004

31.

García-López

L. J.

Bermejo

R. M.

Hidalgo

M. D.

(2010). Social Phobia Inventory–Spanish Version (SPIN) [Database record]. APA PsycTests. https://doi.org/10.1037/t49524-000

32.

Godoy-Giménez

González-Rodríguez

Cañadas

Estévez

A. F.

Sayans-Jiménez

(2018). Psychometric properties of the Spanish Version of the Broad Autism Phenotype Questionnaire: Strengths, weaknesses, and future improvements. Journal of Autism and Developmental Disorders, 48(3), 770–783. https://doi.org/10.1007/s10803-017-3438-0

33.

Godoy-Giménez

González-Rodríguez

Cañadas

Estévez

A. F.

Sayans-Jiménez

(2022). Is it possible to assess the two-domain definition of the Broad Autism Phenotype using the available measurement tools? Journal of Autism and Developmental Disorders, 52, 2884–2895. https://doi.org/10.1007/s10803-021-05158-7

34.

Godoy-Giménez

Gonzalez-Rodriguez

Estévez

A. F.

Cañadas

Sayans-Jimenez

(2022). Applying a Rasch model to the Broad Autism Phenotype Questionnaire: Item severity analysis and differential test functioning of the English and Spanish versions. Current Psychology, 42, 1–15. https://doi.org/10.1007/s12144-022-02789-6

35.

Hambleton

R. K.

(2006). Good practices for identifying differential item functioning. Medical Care, 44(11), S182–S188. https://doi.org/10.1097/01.mlr.0000245443.86671.c4

36.

Hodges

Fealko

Soares

(2020). Autism spectrum disorder: Definition, epidemiology, causes, and clinical evaluation. Translational Pediatrics, 9(Suppl. 1), S55–S65. https://doi.org/10.21037/tp.2019.09.09

37.

Hurley

R. S.

Losh

Parlier

Reznick

J. S.

Piven

(2007). The Broad Autism Phenotype Questionnaire. Journal of Autism and Developmental Disorders, 37(9), 1679–1690. https://doi.org/10.1007/s10803-006-0299-3

38.

Ingersoll

Hambrick

D. Z.

(2011). The relationship between the broader autism phenotype, child severity, and stress and depression in parents of children with autism spectrum disorders. Research in Autism Spectrum Disorders, 5, 337–344. https://doi.org/10.1016/j.rasd.2010.04.017

39.

Ingersoll

Hopwood

C. J.

Wainer

Donnellan

M. B.

(2011). A comparison of three self-report measures of the broader autism phenotype in a non-clinical sample. Journal of Autism and Developmental Disorders, 41, 1646–1657. https://doi.org/10.1007/s10803-011-1192-2

40.

International Test Commission. (2017). The ITC guidelines for translating and adapting tests (2nd ed.). www.InTestCom.org

41.

Jobe

L. E.

White

S. W.

(2007). Loneliness, social relationships, and a broader autism phenotype in college students. Personality and Individual Differences, 42(8), 1479–1489. https://doi.org/10.1016/j.paid.2006.10.021

42.

Jöreskog

K. G.

(1966). Testing a simple structure hypothesis in factor analysis. Psychometrika, 31(2), 165–178. https://doi.org/10.1007/BF02289505

43.

Jöreskog

K. G.

Sörbom

(1979). Advances in factor analysis and structural equation models. Abt.

44.

Kanai

Iwanami

Hashimoto

Ota

Tani

Yamada

Kato

(2011). Clinical characterization of adults with Asperger’s syndrome assessed by self-report questionnaires based on depression, anxiety, and personality. Research in Autism Spectrum Disorders, 5(4), 1451–1458. https://doi.org/10.1016/j.rasd.2011.02.005

45.

Kane

M. T.

(2013). Validating the interpretations and uses of test scores. Journal of Educational Measurement, 50(1), 1–73. https://doi.org/10.1111/jedm.12000

46.

Kloosterman

P. H.

Keefer

K. V.

Kelley

E. A.

Summerfeldt

L. J.

Parker

J. D.

(2011). Evaluation of the factor structure of the Autism-Spectrum Quotient. Personality and Individual Differences, 50(2), 310–314. https://doi.org/10.1016/j.paid.2010.10.015

47.

Klusek

Thurman

A. J.

Abbeduto

(2022). Maternal pragmatic language difficulties in the FMR1 premutation and the broad autism phenotype: Associations with individual and family outcomes. Journal of Autism and Developmental Disorders, 52, 835–851. https://doi.org/10.1007/s10803-021-04980-3

48.

Kurtz

M. R.

Kana

R. K.

Rivera

D. L.

Newman

S. D.

(2023). The role of the broader autism phenotype in anxiety and depression in college-aged adults. Frontiers in Psychiatry, 14, Article 1187298. https://doi.org/10.3389/fpsyt.2023.1187298

49.

Liew

S. M.

Thevaraja

Hong

R. Y.

Magiati

(2015). The relationship between autistic traits and social anxiety, worry, obsessive–compulsive, and depressive symptoms: Specific and non-specific mediators in a student sample. Journal of Autism and Developmental Disorders, 45, 858–872. https://doi.org/10.1007/s10803-014-2238-z

50.

Lin

Dai

Zeng

Yang

Liu

. . .Ou

(2021). The Broad Autism Phenotype Questionnaire (BAPQ): Strengths, weaknesses, and future improvements in the Chinese version. Asian Journal of Psychiatry, 60, 102655. https://doi.org/10.1016/j.ajp.2021.102655

51.

Loevinger

(1957). Objective tests as instruments of psychological theory. Psychological Reports, 3(3), 635–694. https://doi.org/10.2466/pr0.1957.3.3.635

52.

MacCallum

(1986). Specification searches in covariance structure modeling. Psychological Bulletin, 100, 107–120. https://doi.org/10.1037/0033-2909.100.1.107

53.

Marsh

H. W.

Morin

A. J.

Parker

P. D.

Kaur

(2014). Exploratory structural equation modeling: An integration of the best features of exploratory and confirmatory factor analysis. Annual Review of Clinical Psychology, 10(1), 85–110. https://doi.org/10.1146/annurev-clinpsy-032813-153700

54.

Matson

J. L.

Matheis

Burns

C. O.

Esposito

Venuti

Pisula

. . .Goldin

(2017). Examining cross-cultural differences in autism spectrum disorder: A multinational comparison from Greece, Italy, Japan, Poland, and the United States. European Psychiatry, 42, 70–76. https://doi.org/10.1016/j.eurpsy.2016.10.007

55.

Maxwell

C. R.

Parish-Morris

Hsin

Bush

J. C.

Schultz

R. T

(2013). The broad autism phenotype predicts child functioning in autism spectrum disorders. Journal of Neurodevelopmental Disorders, 5, 25. https://doi.org/10.1186/1866-1955-5-25

56.

McCrae

R. R.

Costa

P. T.

(2010). NEO inventories for the NEO Personality Inventory-3 (NEO-PI-3), NEO Five-Factor Inventory-3 (NEO-FFI-3), NEO Personality Inventory-Revised (NEO PI-R): Professional manual. Psychological Assessment Resources.

57.

McDonald

R. P.

(1999). Test theory: A unified treatment. Erlbaum.

58.

Meera

S. S.

Girimaji

S. C.

Seshadri

S. P.

Philip

Shivashankar

Morgan

Piven

(2015). Translation of the Broad Autism Phenotype Questionnaire to an Indian language: A description of the process. Asian Journal of Psychiatry, 15, 62–67. https://doi.org/10.1016/j.ajp.2015.04.013

59.

Messick

(1994). Validity of Psychological Assessment: Validation of Inferences from Persons’ responses and Performances as Scientific Inquiry into Score Meaning. ETS Research Report Series, 1994(2), i–28. https://doi.org/10.1002/j.2333-8504.1994.tb01618.x

60.

Morrison

K. E.

Chambers

L. K.

Faso

D. J.

Sasson

N. J.

(2018). The content and function of interests in the broad autism phenotype. Research in Autism Spectrum Disorders, 49, 25–33. https://doi.org/10.1016/j.rasd.2018.02.002

61.

Muthén

L. K.

Muthén

B. O.

(1998-2012). Mplus user’s guide (7th ed.).

62.

National Statistics Institute (2020). Spain-INE . Spanish population in 2020. https://ine.es/en/index.htm

63.

Nayar

Sealock

J. M.

Maltman

Bush

Cook

E. H.

Davis

L. K.

Losh

(2021). Elevated polygenic burden for autism spectrum disorder is associated with the broad autism phenotype in mothers of individuals with autism spectrum disorder. Biological Psychiatry, 89(5), 476–485. https://doi.org/10.1016/j.biopsych.2020.08.029

64.

Office for National Statistics. (2020). English population in 2020. https://www.ons.gov.uk/

65.

Piven

Palmer

Jacobi

Childress

Arndt

(1997a). Broader autism phenotype: Evidence from a family history study of multiple-incidence autism families. American Journal of Psychiatry, 154(2), 185–190. https://doi.org/10.1176/ajp.154.2.185

66.

Piven

Palmer

Landa

Santangelo

Jacobi

Childress

(1997b). Personality and language characteristics in parents from multiple-incidence autism families. American Journal of Medical Genetics, 74(4), 398–411. https://doi.org/10.1002/(SICI)1096-8628(19970725)74:4<398::AID-AJMG11>3.0.CO;2-D

67.

R Core Team (2021). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. https://www.r-project.org/

68.

Radloff

L. S.

(1977). The CES-D Scale: A self-report depression scale for research in the general population. Applied Psychological Measurement, 1(3), 385–401. https://doi.org/10.1177/014662167700100306

69.

Raykov

(2019). Strong consistency of reliability estimators for multiple-component measuring instruments. Structural Equation Modeling: A Multidisciplinary Journal, 26(5), 750–756. https://doi.org/10.1080/10705511

70.

Raykov

Marcoulides

G. A.

(2011). Introduction to psychometric theory. Routledge.

71.

Rosseel

(2012). Lavaan: An r package for structural equation modeling. Journal of Statistical Software, 48(2), 1–36. https://doi.org/10.18637/jss.v048.i02

72.

Sasson

N. J.

Lam

K. S. L.

Childress

Parlier

Daniels

J. L.

Piven

(2013). The Broad Autism Phenotype Questionnaire: Prevalence and diagnostic classification. Autism Research, 6, 134–143. https://doi.org/10.1002/aur.1272

73.

Sasson

N. J.

Nowlin

R. B.

Pinkham

A. E.

(2013). Social cognition, social skill, and the broad autism phenotype. Autism, 17(6), 655–667. https://doi.org/10.1177/1362361312455704

74.

Satorra

Bentler

P. M.

(2001). A scaled difference chi-square test statistic for moment structure analysis. Psychometrika, 66(4), 507–514. https://doi.org/10.1007/BF02296192

75.

Schmittmann

V. D.

Cramer

A. O.

Waldorp

L. J.

Epskamp

Kievit

R. A.

Borsboom

(2013). Deconstructing the construct: A network perspective on psychological phenomena. New Ideas in Psychology, 31(1), 43–53. https://doi.org/10.1016/j.newideapsych.2011.02.007

76.

Sharma

Bhushan

(2018). The Hindi adaptation and standardization of BAPQ: A brief tool for assessing broad autism phenotype. Asian Journal of Psychiatry, 38, 16–19. https://doi.org/10.1016/j.ajp.2018.10.008

77.

Shi

L.-J.

J.-J.

Gong

J.-B.

Wang

S.-H.

Zhou

Y.-Y.

Zhu

F.-R.

. . .Luo

X.-R.

(2015). Broad autism phenotype features of Chinese parents with autistic children and their associations with severity of social impairment in probands. BMC Psychiatry, 15(1), 168. https://doi.org/10.1186/s12888-015-0568-9

78.

Sivathasan

Philibert-Lignières

Quintin

E. M.

(2022). Individual differences in autism traits, personality, and emotional responsiveness to music in the general population. Musicae Scientiae, 26(3), 538–557. https://doi.org/10.1177/1029864920988160

79.

Spurgeon

S. L.

(2017). Evaluating the unintended consequences of assessment practices: Construct irrelevance and construct underrepresentation. Measurement and Evaluation in Counseling and Development, 50(4), 275–281. https://doi.org/10.1080/07481756.2017.1339563

80.

Stewart

M. E.

Austin

E. J.

(2009). The structure of the Autism-Spectrum Quotient (AQ): Evidence from a student sample in Scotland. Personality and Individual Differences, 47(3), 224–228. https://doi.org/10.1016/j.paid.2009.03.004

81.

Stojković

Dučić

Kaljača

Đorđević

(2018). Construction and psychometric evaluation of a short form of the Broad Autism Phenotype Questionnaire. Psihologija, 51(2), 243–258. https://doi.org/10.2298/PSI170619014S

82.

Sucksmith

Roth

Hoekstra

R.A.

(2011). Autistic traits below the clinical threshold: Re-examining the broader autism phenotype in the 21st century. Neuropsychology Review, 21, 360–389. https://doi.org/10.1007/s11065-011-9183-9

83.

Thurstone

L. L.

(1947). Multiple-factor analysis; a development and expansion of The Vectors of Mind. University of Chicago Press.

84.

Vandenberg

R. J.

Lance

C. E.

(2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3, 4–70. https://doi.org/10.1177/109442810031002

85.

Vázquez

F. L.

Blanco

López

(2007). An adaptation of the Center for Epidemiologic Studies Depression Scale for use in non-psychiatric Spanish populations. Psychiatry Research, 149(1–3), 247–252. https://doi.org/10.1016/j.psychres.2006.03.004

86.

Wainer

A. L.

Ingersoll

B. R.

Hopwood

C. J.

(2011). The structure and nature of the broader autism phenotype in a non-clinical sample. Journal of Psychopathology and Behavioral Assessment, 33, 459–469. https://doi.org/10.1007/s10862-011-9259-0

87.

Wakabayashi

Baron-Cohen

Wheelwright

Tojo

(2006). The Autism-Spectrum Quotient (AQ) in Japan: A cross-cultural comparison. Journal of Autism and Developmental Disorders, 36(2), 263–270. https://doi.org/10.1007/s10803-005-0061-2

88.

Warrier

Chee

Smith

Chakrabarti

Baron-Cohen

(2015). A comprehensive meta-analysis of common genetic variants in autism spectrum conditions. Molecular Autism, 6(1), 1–11. https://doi.org/10.1186/s13229-015-0041-0

89.

World Health Organization. (1996, December). The World Health Organization Quality of Life (WHOQOL)-BREF: Introduction, administration, scoring and generic version of the assessment. https://iris.who.int/bitstream/handle/10665/63529/WHOQOL-BREF.pdf?sequence=1

90.

World Health Organization. (2022). International Classification of Diseases Eleventh Revision (ICD-11). https://www.who.int/

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

1.13 MB