Measurement Invariance of the First Years Inventory (FYIv3.1) Across Age and Sex for Early Detection of Autism in a Community Sample of Infants

Abstract

The use of parent-report screeners for early detection of autism is time- and cost-efficient in clinical settings but their utility may vary by respondent characteristics. This study aimed to examine the degree to which infants’ age and sex impacted parental reports of early behavioral signs of autism captured by the First Years Inventory Version 3.1 (FYIv3.1). The current sample included 6,454 caregivers of infants aged 6 to 16 months recruited through the North Carolina vital records. Using moderated nonlinear factor analysis for each of the seven FYIv3.1, we identified differential item functioning in small to medium effect sizes across 18 out of 69 items, with the majority of biases associated with infants’ age (e.g., object mouthing, walking, pretend, and imitation), while sex-related biases were minimal. This indicates that differential scoring algorithms by infants’ age and more closely spaced monitoring may be needed for these constructs for more accurate identification of autism in infancy.

Keywords

differential item functioning measurement invariance early autism screening infant sensory motor and social communication development community sample behavioral risk markers

Get full access to this article

View all access options for this article.

References

Baranek

G. T.

Sideris

Chen

Y. J.

Crais

Turner-Brown

Watson

L. R.

(2022). Early measurement of autism risk constructs in the general population: A new factor structure of the First Years Inventory (FYIv3.1) for ages 6-16 months. Autism Research, 15(5), 915–928. https://doi.org/10.1002/aur.2691

Baranek

G. T.

Watson

L. R.

Crais

Reznick

(2003). First Year Inventory (FYI) 2.0. University of North Carolina at Chapel Hill.

Baranek

G. T.

Watson

L. R.

Crais

Turner-Brown

Reznick

(2013). First Years Inventory (FYI) 3.1. University of North Carolina at Chapel Hill.

Barbu

Cabanes

Le Maner-Idrissi

(2011). Boys and girls on the playground: Sex differences in social development are not stable across early childhood. PLOS ONE, 6(1), e16407. https://doi.org/10.1371/journal.pone.0016407

Bauer

D. J.

(2017). A more general model for testing measurement invariance and differential item functioning. Psychological Methods, 22(3), 507–526. https://doi.org/10.1037/met0000077

Bennetts

S. K.

Mensah

F. K.

Westrupp

E. M.

Hackworth

N. J.

Reilly

(2016). The agreement between parent-reported and directly measured child language and parenting behaviors. Frontiers in Psychology, 7, 1710. https://doi.org/10.3389/fpsyg.2016.01710

Brydges

C. R.

(2019). Effect size guidelines, sample size calculations, and statistical power in gerontology. Innovation in Aging, 3(4), igz036. https://doi.org/10.1093/geroni/igz036

Canu

Van der Paelt

Canal-Bedia

Posada

Vanvuchelen

Roeyers

(2021). Early non-social behavioural indicators of autism spectrum disorder (ASD) in siblings at elevated likelihood for ASD: A systematic review. European Child & Adolescent Psychiatry, 30(4), 497–538. https://doi.org/10.1007/s00787-020-01487-7

Carpenter

Nagell

Tomasello

Butterworth

Moore

(1998). Social cognition, joint attention, and communicative competence from 9 to 15 months of age. Monographs of the Society for Research in Child Development, 63(4), i-174. https://doi.org/10.2307/1166214

10.

Chalmers

R. P.

Counsell

Flora

D. B.

(2016). It might not make a big DIF: Improved differential test functioning statistics that account for sampling variability. Educational and Psychological Measurement, 76(1), 114–140. https://doi.org/10.1177/0013164415584576

11.

Cherney

I. D.

Kelly-Vance

Gill Glover

Ruane

A. M. Y.

Oliver Ryalls

(2003). The effects of stereotyped toys and gender on play assessment in children aged 18-47 months. Educational Psychology, 23(1), 95–106. https://doi.org/10.1080/01443410303222

12.

Christensen

D. L.

Braun

K. V. N.

Baio

Bilder

Charles

Constantino

J. N.

Daniels

Durkin

M. S.

Fitzgerald

R. T.

Kurzius-Spencer

Lee

L.-C.

Pettygrove

Robinson

Schulz

Wells

Wingate

M. S.

Zahorodny

Yeargin-Allsopp

(2018). Prevalence and characteristics of autism spectrum disorder among children aged 8 years—Autism and developmental disabilities monitoring network, 11 sites, United States, 2012. MMWR Surveillance Summaries, 65(13), 1–23. https://doi.org/10.15585/mmwr.ss6513a1

13.

Classe

Kern

(2024). Detecting differential item functioning in multidimensional graded response models with recursive partitioning. Applied Psychological Measurement, 48(3), 83–103. https://doi.org/10.1177/01466216241238743

14.

Corsello

Hus

Pickles

Risi

Cook

E. H.

Jr. Leventhal

B. L.

Lord

(2007). Between a ROC and a hard place: Decision making and making decisions about using the SCQ. The Journal of Child Psychology and Psychiatry, 48(9), 932–940. https://doi.org/10.1111/j.1469-7610.2007.01762.x

15.

Crais

Douglas

Campbell

(2004). The intersection of gestures and intentionality. Journal of Speech, Language, and Hearing Research, 47(3), 678–694. https://doi.org/10.1044/1092-4388(2004/052)

16.

Dillon

E. F.

Kanne

Landa

R. J.

Annett

Bernier

Bradley

, SPARK Consortium. (2021). Sex differences in autism: Examining intrinsic and extrinsic factors in children and adolescents enrolled in a national ASD cohort. Journal of Autism and Developmental Disorders, 53, 1305–1318. https://doi.org/10.1007/s10803-021-05385-y

17.

DuBay

Watson

L. R.

(2019). Translation and cultural adaptation of parent-report developmental assessments: Improving rigor in methodology. Research in Autism Spectrum Disorders, 62, 55–65. https://doi.org/10.1016/j.rasd.2019.02.005

18.

Eapen

Črnčec

Woolfenden

Blackmore

(2014). Screening for Autism Spectrum Disorders using the PEDS and M-CHAT. Journal of Mental Health Research in Intellectual Disabilities, 7(1), 1–13. https://doi.org/10.1080/19315864.2012.704489

19.

Elsabbagh

Johnson

M. H.

(2007). Infancy and autism: Progress, prospects, and challenges. Progress in Brain Research, 164, 355–383. https://doi.org/10.1016/S0079-6123(07)64020-5

20.

Finch

W. H.

Hernández Finch

M. E.

French

B. F.

(2016). Recursive partitioning to identify potential causes of differential item functioning in cross-national data. International Journal of Testing, 16(1), 21–53. https://doi.org/10.1080/15305058.2015.1039644

21.

Gignac

G. E.

Szodorai

E. T.

(2016). Effect size guidelines for individual differences researchers. Personality and Individual Differences, 102, 74–78. https://doi.org/10.1016/j.paid.2016.06.069

22.

Glascoe

F. P.

(2000). Early detection of developmental and behavioral problems. Pediatrics in Review, 21(8), 272–280. https://doi.org/10.1542/pir.21.8.272

23.

Goldberg

Lewis

(1969). Play behavior in the year-old infant: Early sex differences. Child Development, 40(1), 21–31. https://doi.org/10.2307/1127152

24.

Goldman

(2013). Opinion: Sex, gender and the diagnosis of autism—A biosocial view of the male preponderance. Research in Autism Spectrum Disorders, 7(6), 675–679. https://doi.org/10.1016/j.rasd.2013.02.006

25.

Gonzalez

Pelham

W. E

III . (2021). When does differential item functioning matter for screening? A method for empirical evaluation. Assessment, 28(2), 446–456. https://doi.org/10.1177/1073191120913618

26.

Guthrie

Wallis

Bennett

Brooks

Dudley

Gerdes

Pandey

Levy

S. E.

Schultz

R. T.

Miller

J. S.

(2019). Accuracy of autism screening in a large pediatric network. Pediatrics, 144(4), e20183963. https://doi.org/10.1542/peds.2018-3963

27.

Harrop

Green

Hudry , & PACT Consortium. (2017). Play complexity and toy engagement in preschoolers with autism spectrum disorder: Do girls and boys differ? Autism, 21(1), 37–50. https://doi.org/10.1177/1362361315622410

28.

L. T.

Bentler

P. M.

(1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6, 1–55. https://doi.org/10.1080/10705519909540118

29.

Hudry

Chetcuti

Hocking

D. R.

(2020). Motor functioning in developmental psychopathology: A review of autism as an example context. Research in Developmental Disabilities, 105, 103739. https://doi.org/10.1016/j.ridd.2020.103739

30.

Inada

Kamio

Koyama

(2010). Developmental chronology of preverbal social behaviors in infancy using the M-CHAT: Baseline for early detection of atypical social development. Research in Autism Spectrum Disorders, 4(4), 605–611. https://doi.org/10.1016/j.rasd.2009.12.003

31.

Johnson

C. P.

(2008). Recognition of autism before age 2 years. Pediatrics in Review, 29(3), 86–96. https://doi.org/10.1542/pir.29.3.86

32.

Jones

R. N.

(2019). Differential item functioning and its relevance to epidemiology. Current Epidemiology Reports, 6(2), 174–183. https://doi.org/10.1007/s40471-019-00194-5

33.

Kalb

L. G.

Singh

Hong

J. S.

Holingue

Ludwig

N. N.

Pfeiffer

Reetzke

Gross

A. L.

Landa

(2022). Analysis of race and sex bias in the Autism Diagnostic Observation Schedule (ADOS-2). JAMA Network Open, 5(4), e229498. https://doi.org/10.1001/jamanetworkopen.2022.9498

34.

Kim

S. H.

Lord

(2013). The behavioral manifestations of autism spectrum disorders. In Buxbaum

J. D.

Hof

P. R.

(Eds.), The neuroscience of autism spectrum disorders (pp. 25–37). Elsevier. https://doi.org/10.1016/B978-0-12-391924-3.00002-8

35.

Kleinman

Teresi

J. A.

(2016). Differential item functioning magnitude and impact measures from item response theory models. Psychological Test and Assessment Modeling, 58(1), 79–98.

36.

Kreiser

N. L.

White

S. W.

(2014). ASD in females: Are we overstating the gender difference in diagnosis? Clinical Child and Family Psychology Review, 17(1), 67–84. https://doi.org/10.1007/s10567-013-0148-9

37.

Lai

M. C.

Lombardo

M. V.

Auyeung

Chakrabarti

Baron-Cohen

(2015). Sex/gender differences and autism: Setting the scene for future research. Journal of the American Academy of Child & Adolescent Psychiatry, 54(1), 11–24. https://doi.org/10.1016/j.jaac.2014.10.003

38.

Lai

M. C.

Szatmari

(2020). Sex and gender impacts on the behavioural presentation and recognition of autism. Current Opinion in Psychiatry, 33(2), 117–123. https://doi.org/10.1097/YCO.0000000000000575

39.

Macari

S. L.

G. C.

Powell

K. K.

Fontenelle

Macris

D. M.

Chawarska

(2018). Do parents and clinicians agree on ratings of autism-related behaviors at 12 months of age? A study of infants at high and low risk for ASD. Journal of Autism and Developmental Disorders, 48(4), 1069–1080. https://doi.org/10.1007/s10803-017-3410-z

40.

Martinková

Drabinová

Liaw

Y. L.

Sanders

E. A.

McFarland

J. L.

Price

R. M.

(2017). Checking equity: Why differential item functioning analysis should be a routine part of developing conceptual assessments. CBE—Life Sciences Education, 16(2), rm2. https://doi.org/10.1187/cbe.16-10-0307

41.

McDonnell

C. G.

DeLucia

E. A.

Hayden

E. P.

Penner

Curcin

Anagnostou

Nicolson

Kelley

Georgiades

Liu

Stevenson

R. A.

(2021). Sex differences in age of diagnosis and first concern among children with autism spectrum disorder. Journal of Clinical Child & Adolescent Psychology, 50(5), 645–655. https://doi.org/10.1080/15374416.2020.1823850

42.

Meera

S. S.

Donovan

Wolff

J. J.

Zwaigenbaum

Elison

J. T.

Kinh

& IBIS Network. (2021). Towards a data-driven approach to screen for autism risk at 12 months of age. Journal of the American Academy of Child & Adolescent Psychiatry, 60(8), 968–977. https://doi.org/10.1016/j.jaac.2020.10.015

43.

Meredith

(1993). Measurement invariance, factor analysis and factorial invariance. Psychometrika, 58(4), 525–543. https://doi.org/10.1007/BF02294825

44.

Messinger

D. S.

Young

G. S.

Webb

S. J.

Ozonoff

Bryson

S. E.

Carter

Carver

Charman

Chawarska

Curtin

Dobkins

Hertz-Picciotto

Hutman

Iverson

J. M.

Landa

Nelson

C. A.

Stone

W. L.

Tager-Flusberg

Zwaigenbaum

(2015). Early sex differences are not autism-specific: A Baby Siblings Research Consortium (BSRC) study. Molecular Autism, 6(1), 1–12. https://doi.org/10.1186/s13229-015-0027-y

45.

Micai

Fulceri

Caruso

Guzzetta

Gila

Scattoni

M. L.

(2020). Early behavioral markers for neurodevelopmental disorders in the first 3 years of life: An overview of systematic reviews. Neuroscience & Biobehavioral Reviews, 116, 183–201. https://doi.org/10.1016/j.neubiorev.2020.06.027

46.

Murray

A. L.

Allison

Smith

P. L.

Baron-Cohen

Booth

Auyeung

(2017). Investigating diagnostic bias in autism spectrum conditions: An item response theory analysis of sex bias in the AQ-10. Autism Research, 10(5), 790–800. https://doi.org/10.1002/aur.1724

47.

Muthén

L. K.

Muthén

(2018). Mplus. The Comprehensive Modelling Program for Applied Researchers: User’s Guide, 5.

48.

Øien

R. A.

Hart

Schjølberg

Wall

C. A.

Kim

E. S.

Nordahl-Hansen

Eisemann

M. R.

Chawarska

Volkmar

F. R.

Shic

(2017). Parent-endorsed sex differences in toddlers with and without ASD: Utilizing the M-CHAT. Journal of Autism and Developmental Disorders, 47(1), 126–134. https://doi.org/10.1007/s10803-016-2945-8

49.

Oosterling

Rommelse

De Jonge

Van Der Gaag

R. J.

Swinkels

Roos

Visser

Buitelaar

(2010). How useful is the Social Communication Questionnaire in toddlers at risk of autism spectrum disorder? The Journal of Child Psychology and Psychiatry, 51(11), 1260–1268. https://doi.org/10.1111/j.1469-7610.2010.02246.x

50.

Ozonoff

Young

G. S.

Belding

Hill

Hutman

Johnson

Miller

Rogers

S. J.

Schwichtenberg

A. J.

Steinfeld

Iosif

A. M.

(2014). The broader autism phenotype in infancy: When does it emerge? Journal of the American Academy of Child & Adolescent Psychiatry, 53(4), 398–407. https://doi.org/10.1016/j.jaac.2013.12.020

51.

Pandey

Verbalis

Robins

D. L.

Boorstein

Klin

Babitz

Chawarska

Volkmar

Green

Barton

Fein

(2008). Screening for autism in older and younger toddlers with the Modified Checklist for Autism in Toddlers. Autism, 12(5), 513–535. https://doi.org/10.1177/1362361308094503

52.

Pellegrini

A. D.

Nathan

P. E.

(Eds.). (2011). The Oxford handbook of the development of play. Oxford Library of Psychology.

53.

Putnick

D. L.

Bornstein

M. H.

(2016). Measurement invariance conventions and reporting: The state of the art and future directions for psychological research. Developmental Review, 41, 71–90. https://doi.org/10.1016/j.dr.2016.06.004

54.

Ramsey

R. K.

Nichols

Ludwig

N. N.

Fein

Adamson

L. B.

Robins

D. L.

(2018). Brief report: Sex differences in parental concerns for toddlers with autism risk. Journal of Autism and Developmental Disorders, 48(12), 4063–4069. https://doi.org/10.1007/s10803-018-3583-0

55.

Reznick

J. S.

Baranek

G. T.

Reavis

Watson

L. R.

Crais

E. R.

(2007). A parent-report instrument for identifying one-year-olds at risk for an eventual diagnosis of autism: The first year inventory. Journal of Autism and Developmental Disorders, 37(9), 1691–1710. https://doi.org/10.1007/s10803-006-0303-y

56.

Ronkin

Tully

E. C.

Branum-Martin

Cohen

L. L.

Hall

Dilly

Tone

E. B.

(2022). Sex differences in social communication behaviors in toddlers with suspected autism spectrum disorder as assessed by the ADOS-2 toddler module. Autism, 26(5), 1282–1295. https://doi.org/10.1177/13623613211047070

57.

Sacrey

L. A. R.

Zwaigenbaum

Bryson

Brian

Smith

I. M.

Roberts

Szatmari

Roncadin

Garon

Novak

Vaillancourt

McCormick

MacKinnon

Jilderda

Armstrong

(2015). Can parents’ concerns predict autism spectrum disorder? A prospective study of high-risk siblings from 6 to 36 months of age. Journal of the American Academy of Child & Adolescent Psychiatry, 54(6), 470–478. https://doi.org/10.1016/j.jaac.2015.03.014

58.

Schiltz

H. K.

Magnus

B. E.

(2021). Differential item functioning based on autism features, IQ, and age on the screen for child anxiety related disorders (scared) among youth on the autism spectrum. Autism Research, 14(6), 1220–1236. https://doi.org/10.1002/aur.2481

59.

Schjølberg

Shic

Volkmar

F. R.

Nordahl-Hansen

Stenberg

Torske

Larsen

Riley

Sukhodolsky

D. G.

Leckman

J. F.

Chawarska

Øien

R. A.

(2022). What are we optimizing for in autism screening? Examination of algorithmic changes in the M-CHAT. Autism Research, 15(2), 296–304. https://doi.org/10.1002/aur.2643

60.

Sturner

Howard

Bergmann

Morrel

Landa

Walton

Marks

(2017). Accurate autism screening at the 18-month well-child visit requires different strategies than at 24 months. Journal of Autism and Developmental Disorders, 47(10), 3296–3310. https://doi.org/10.1007/s10803-017-3231-0

61.

Teresi

J. A.

Ramirez

Jones

R. N.

Choi

Crane

P. K.

(2012). Modifying measures based on differential item functioning (DIF) impact analyses. Journal of Aging and Health, 24(6), 1044–1076. https://doi.org/10.1177/0898264312436877

62.

Thelen

(1979). Rhythmical stereotypies in normal human infants. Animal Behaviour, 27, 699–715. https://doi.org/10.1016/0003-3472(79)90006-X

63.

Tien

I. S.

Kim

Johnson

A. R.

Wood

J. J.

(2024). Gender differences: Confirmatory factor analysis of the ADOS-II. Journal of Autism and Developmental Disorders. Epub ahead of print. PMID: 38652372. https://doi.org/10.1007/s10803-024-06346-x

64.

Tippett

(2014, June 30). 2013 County population estimates: Race & ethnicity. Carolina Demography. https://carolinademography.cpc.unc.edu/2014/06/30/2013-county-population-estimates-race-ethnicity

65.

Towle

P. O.

Patrick

P. A.

(2016). Autism spectrum disorder screening instruments for very young children: A systematic review. Autism Research and Treatment, 2016, 4624829. https://doi.org/10.1155/2016/4624829

66.

Turner-Brown

L. M.

Baranek

G. T.

Reznick

J. S.

Watson

L. R.

Crais

E. R.

(2013). The First Year Inventory: A longitudinal follow-up of 12-month-old to 3-year-old children. Autism, 17(5), 527–540. https://doi.org/10.1177/1362361312439633

67.

Walker

C. M.

(2011). What’s the DIF? Why differential item functioning analyses are an important part of instrument development and validation. Journal of Psychoeducational Assessment, 29(4), 364–376. https://doi.org/10.1177/0734282911406666

68.

Watson

L. R.

Baranek

G. T.

Crais

E. R.

Reznick

J. S.

Dykstra

Perryman

(2007). The first year inventory: Retrospective parent responses to a questionnaire designed to identify one-year-olds at risk for autism. Journal of Autism and Developmental Disorders, 37(1), 49–61. https://doi.org/10.1007/s10803-006-0334-4

69.

Wei

Chesnut

S. R.

Barnard-Brak

Richman

(2015). Psychometric analysis of the Social Communication Questionnaire using an item-response theory framework: Implications for the use of the lifetime and current forms. Journal of Psychopathology and Behavioral Assessment, 37(3), 469–480. https://doi.org/10.1007/s10862-014-9468-4

70.

Wetherby

A. M.

Brosnan-Maddox

Peace

Newton

(2008). Validation of the Infant—Toddler Checklist as a broadband screener for autism spectrum disorders from 9 to 24 months of age. Autism, 12(5), 487–511. https://doi.org/10.1177/1362361308094501

71.

Wolff

J. J.

Boyd

B. A.

Elison

J. T.

(2016). A quantitative measure of restricted and repetitive behaviors for early childhood. Journal of Neurodevelopmental Disorders, 8(1), 1–10. https://doi.org/10.1186/s11689-016-9161-x

72.

Zwaigenbaum

Bauman

M. L.

Fein

Pierce

Buie

Davis

P. A.

Newschaffer

Robins

D. L.

Wetherby

Choueiri

Kasari

Stone

W. L.

Yirmiya

Estes

Hansen

R. L.

McPartland

J. C.

Natowicz

M. R.

Carter

Granpeesheh

. . .Wagner

(2015). Early screening of autism spectrum disorder: Recommendations for practice and research. Pediatrics, 136(Supplement 1), S41–S59. https://doi.org/10.1542/peds.2014-3667D

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

1.36 MB