The use of parent-report screeners for early detection of autism is time- and cost-efficient in clinical settings but their utility may vary by respondent characteristics. This study aimed to examine the degree to which infants’ age and sex impacted parental reports of early behavioral signs of autism captured by the First Years Inventory Version 3.1 (FYIv3.1). The current sample included 6,454 caregivers of infants aged 6 to 16 months recruited through the North Carolina vital records. Using moderated nonlinear factor analysis for each of the seven FYIv3.1, we identified differential item functioning in small to medium effect sizes across 18 out of 69 items, with the majority of biases associated with infants’ age (e.g., object mouthing, walking, pretend, and imitation), while sex-related biases were minimal. This indicates that differential scoring algorithms by infants’ age and more closely spaced monitoring may be needed for these constructs for more accurate identification of autism in infancy.
BaranekG. T.SiderisJ.ChenY. J.CraisE.Turner-BrownL.WatsonL. R. (2022). Early measurement of autism risk constructs in the general population: A new factor structure of the First Years Inventory (FYIv3.1) for ages 6-16 months. Autism Research, 15(5), 915–928. https://doi.org/10.1002/aur.2691
2.
BaranekG. T.WatsonL. R.CraisE.ReznickS. (2003). First Year Inventory (FYI) 2.0. University of North Carolina at Chapel Hill.
3.
BaranekG. T.WatsonL. R.CraisE.Turner-BrownL.ReznickS. (2013). First Years Inventory (FYI) 3.1. University of North Carolina at Chapel Hill.
4.
BarbuS.CabanesG.Le Maner-IdrissiG. (2011). Boys and girls on the playground: Sex differences in social development are not stable across early childhood. PLOS ONE, 6(1), e16407. https://doi.org/10.1371/journal.pone.0016407
5.
BauerD. J. (2017). A more general model for testing measurement invariance and differential item functioning. Psychological Methods, 22(3), 507–526. https://doi.org/10.1037/met0000077
6.
BennettsS. K.MensahF. K.WestruppE. M.HackworthN. J.ReillyS. (2016). The agreement between parent-reported and directly measured child language and parenting behaviors. Frontiers in Psychology, 7, 1710. https://doi.org/10.3389/fpsyg.2016.01710
7.
BrydgesC. R. (2019). Effect size guidelines, sample size calculations, and statistical power in gerontology. Innovation in Aging, 3(4), igz036. https://doi.org/10.1093/geroni/igz036
8.
CanuD.Van der PaeltS.Canal-BediaR.PosadaM.VanvuchelenM.RoeyersH. (2021). Early non-social behavioural indicators of autism spectrum disorder (ASD) in siblings at elevated likelihood for ASD: A systematic review. European Child & Adolescent Psychiatry, 30(4), 497–538. https://doi.org/10.1007/s00787-020-01487-7
9.
CarpenterM.NagellK.TomaselloM.ButterworthG.MooreC. (1998). Social cognition, joint attention, and communicative competence from 9 to 15 months of age. Monographs of the Society for Research in Child Development, 63(4), i-174. https://doi.org/10.2307/1166214
10.
ChalmersR. P.CounsellA.FloraD. B. (2016). It might not make a big DIF: Improved differential test functioning statistics that account for sampling variability. Educational and Psychological Measurement, 76(1), 114–140. https://doi.org/10.1177/0013164415584576
11.
CherneyI. D.Kelly-VanceL.Gill GloverK.RuaneA. M. Y.Oliver RyallsB. (2003). The effects of stereotyped toys and gender on play assessment in children aged 18-47 months. Educational Psychology, 23(1), 95–106. https://doi.org/10.1080/01443410303222
12.
ChristensenD. L.BraunK. V. N.BaioJ.BilderD.CharlesJ.ConstantinoJ. N.DanielsJ.DurkinM. S.FitzgeraldR. T.Kurzius-SpencerM.LeeL.-C.PettygroveS.RobinsonC.SchulzE.WellsC.WingateM. S.ZahorodnyW.Yeargin-AllsoppM. (2018). Prevalence and characteristics of autism spectrum disorder among children aged 8 years—Autism and developmental disabilities monitoring network, 11 sites, United States, 2012. MMWR Surveillance Summaries, 65(13), 1–23. https://doi.org/10.15585/mmwr.ss6513a1
13.
ClasseF.KernC. (2024). Detecting differential item functioning in multidimensional graded response models with recursive partitioning. Applied Psychological Measurement, 48(3), 83–103. https://doi.org/10.1177/01466216241238743
14.
CorselloC.HusV.PicklesA.RisiS.CookE. H.Jr.LeventhalB. L.LordC. (2007). Between a ROC and a hard place: Decision making and making decisions about using the SCQ. The Journal of Child Psychology and Psychiatry, 48(9), 932–940. https://doi.org/10.1111/j.1469-7610.2007.01762.x
15.
CraisE.DouglasD.CampbellC. (2004). The intersection of gestures and intentionality. Journal of Speech, Language, and Hearing Research, 47(3), 678–694. https://doi.org/10.1044/1092-4388(2004/052)
16.
DillonE. F.KanneS.LandaR. J.AnnettR.BernierR.BradleyC., SPARK Consortium. (2021). Sex differences in autism: Examining intrinsic and extrinsic factors in children and adolescents enrolled in a national ASD cohort. Journal of Autism and Developmental Disorders, 53, 1305–1318. https://doi.org/10.1007/s10803-021-05385-y
17.
DuBayM.WatsonL. R. (2019). Translation and cultural adaptation of parent-report developmental assessments: Improving rigor in methodology. Research in Autism Spectrum Disorders, 62, 55–65. https://doi.org/10.1016/j.rasd.2019.02.005
18.
EapenV.ČrnčecR.WoolfendenS.BlackmoreR. (2014). Screening for Autism Spectrum Disorders using the PEDS and M-CHAT. Journal of Mental Health Research in Intellectual Disabilities, 7(1), 1–13. https://doi.org/10.1080/19315864.2012.704489
FinchW. H.Hernández FinchM. E.FrenchB. F. (2016). Recursive partitioning to identify potential causes of differential item functioning in cross-national data. International Journal of Testing, 16(1), 21–53. https://doi.org/10.1080/15305058.2015.1039644
21.
GignacG. E.SzodoraiE. T. (2016). Effect size guidelines for individual differences researchers. Personality and Individual Differences, 102, 74–78. https://doi.org/10.1016/j.paid.2016.06.069
22.
GlascoeF. P. (2000). Early detection of developmental and behavioral problems. Pediatrics in Review, 21(8), 272–280. https://doi.org/10.1542/pir.21.8.272
23.
GoldbergS.LewisM. (1969). Play behavior in the year-old infant: Early sex differences. Child Development, 40(1), 21–31. https://doi.org/10.2307/1127152
24.
GoldmanS. (2013). Opinion: Sex, gender and the diagnosis of autism—A biosocial view of the male preponderance. Research in Autism Spectrum Disorders, 7(6), 675–679. https://doi.org/10.1016/j.rasd.2013.02.006
25.
GonzalezO.PelhamW. EIII. (2021). When does differential item functioning matter for screening? A method for empirical evaluation. Assessment, 28(2), 446–456. https://doi.org/10.1177/1073191120913618
26.
GuthrieW.WallisK.BennettA.BrooksE.DudleyJ.GerdesM.PandeyJ.LevyS. E.SchultzR. T.MillerJ. S. (2019). Accuracy of autism screening in a large pediatric network. Pediatrics, 144(4), e20183963. https://doi.org/10.1542/peds.2018-3963
27.
HarropC.GreenJ.Hudry, & PACT Consortium. (2017). Play complexity and toy engagement in preschoolers with autism spectrum disorder: Do girls and boys differ?Autism, 21(1), 37–50. https://doi.org/10.1177/1362361315622410
28.
HuL. T.BentlerP. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6, 1–55. https://doi.org/10.1080/10705519909540118
29.
HudryK.ChetcutiL.HockingD. R. (2020). Motor functioning in developmental psychopathology: A review of autism as an example context. Research in Developmental Disabilities, 105, 103739. https://doi.org/10.1016/j.ridd.2020.103739
30.
InadaN.KamioY.KoyamaT. (2010). Developmental chronology of preverbal social behaviors in infancy using the M-CHAT: Baseline for early detection of atypical social development. Research in Autism Spectrum Disorders, 4(4), 605–611. https://doi.org/10.1016/j.rasd.2009.12.003
JonesR. N. (2019). Differential item functioning and its relevance to epidemiology. Current Epidemiology Reports, 6(2), 174–183. https://doi.org/10.1007/s40471-019-00194-5
33.
KalbL. G.SinghV.HongJ. S.HolingueC.LudwigN. N.PfeifferD.ReetzkeR.GrossA. L.LandaR. (2022). Analysis of race and sex bias in the Autism Diagnostic Observation Schedule (ADOS-2). JAMA Network Open, 5(4), e229498. https://doi.org/10.1001/jamanetworkopen.2022.9498
34.
KimS. H.LordC. (2013). The behavioral manifestations of autism spectrum disorders. In BuxbaumJ. D.HofP. R. (Eds.), The neuroscience of autism spectrum disorders (pp. 25–37). Elsevier. https://doi.org/10.1016/B978-0-12-391924-3.00002-8
35.
KleinmanM.TeresiJ. A. (2016). Differential item functioning magnitude and impact measures from item response theory models. Psychological Test and Assessment Modeling, 58(1), 79–98.
36.
KreiserN. L.WhiteS. W. (2014). ASD in females: Are we overstating the gender difference in diagnosis?Clinical Child and Family Psychology Review, 17(1), 67–84. https://doi.org/10.1007/s10567-013-0148-9
37.
LaiM. C.LombardoM. V.AuyeungB.ChakrabartiB.Baron-CohenS. (2015). Sex/gender differences and autism: Setting the scene for future research. Journal of the American Academy of Child & Adolescent Psychiatry, 54(1), 11–24. https://doi.org/10.1016/j.jaac.2014.10.003
38.
LaiM. C.SzatmariP. (2020). Sex and gender impacts on the behavioural presentation and recognition of autism. Current Opinion in Psychiatry, 33(2), 117–123. https://doi.org/10.1097/YCO.0000000000000575
39.
MacariS. L.WuG. C.PowellK. K.FontenelleS.MacrisD. M.ChawarskaK. (2018). Do parents and clinicians agree on ratings of autism-related behaviors at 12 months of age? A study of infants at high and low risk for ASD. Journal of Autism and Developmental Disorders, 48(4), 1069–1080. https://doi.org/10.1007/s10803-017-3410-z
40.
MartinkováP.DrabinováA.LiawY. L.SandersE. A.McFarlandJ. L.PriceR. M. (2017). Checking equity: Why differential item functioning analysis should be a routine part of developing conceptual assessments. CBE—Life Sciences Education, 16(2), rm2. https://doi.org/10.1187/cbe.16-10-0307
41.
McDonnellC. G.DeLuciaE. A.HaydenE. P.PennerM.CurcinK.AnagnostouE.NicolsonR.KelleyE.GeorgiadesS.LiuX.StevensonR. A. (2021). Sex differences in age of diagnosis and first concern among children with autism spectrum disorder. Journal of Clinical Child & Adolescent Psychology, 50(5), 645–655. https://doi.org/10.1080/15374416.2020.1823850
42.
MeeraS. S.DonovanK.WolffJ. J.ZwaigenbaumL.ElisonJ. T.KinhT. & IBIS Network. (2021). Towards a data-driven approach to screen for autism risk at 12 months of age. Journal of the American Academy of Child & Adolescent Psychiatry, 60(8), 968–977. https://doi.org/10.1016/j.jaac.2020.10.015
MessingerD. S.YoungG. S.WebbS. J.OzonoffS.BrysonS. E.CarterA.CarverL.CharmanT.ChawarskaK.CurtinS.DobkinsK.Hertz-PicciottoI.HutmanT.IversonJ. M.LandaR.NelsonC. A.StoneW. L.Tager-FlusbergH.ZwaigenbaumL. (2015). Early sex differences are not autism-specific: A Baby Siblings Research Consortium (BSRC) study. Molecular Autism, 6(1), 1–12. https://doi.org/10.1186/s13229-015-0027-y
45.
MicaiM.FulceriF.CarusoA.GuzzettaA.GilaL.ScattoniM. L. (2020). Early behavioral markers for neurodevelopmental disorders in the first 3 years of life: An overview of systematic reviews. Neuroscience & Biobehavioral Reviews, 116, 183–201. https://doi.org/10.1016/j.neubiorev.2020.06.027
46.
MurrayA. L.AllisonC.SmithP. L.Baron-CohenS.BoothT.AuyeungB. (2017). Investigating diagnostic bias in autism spectrum conditions: An item response theory analysis of sex bias in the AQ-10. Autism Research, 10(5), 790–800. https://doi.org/10.1002/aur.1724
47.
MuthénL. K.MuthénB. (2018). Mplus. The Comprehensive Modelling Program for Applied Researchers: User’s Guide, 5.
48.
ØienR. A.HartL.SchjølbergS.WallC. A.KimE. S.Nordahl-HansenA.EisemannM. R.ChawarskaK.VolkmarF. R.ShicF. (2017). Parent-endorsed sex differences in toddlers with and without ASD: Utilizing the M-CHAT. Journal of Autism and Developmental Disorders, 47(1), 126–134. https://doi.org/10.1007/s10803-016-2945-8
49.
OosterlingI.RommelseN.De JongeM.Van Der GaagR. J.SwinkelsS.RoosS.VisserJ.BuitelaarJ. (2010). How useful is the Social Communication Questionnaire in toddlers at risk of autism spectrum disorder?The Journal of Child Psychology and Psychiatry, 51(11), 1260–1268. https://doi.org/10.1111/j.1469-7610.2010.02246.x
50.
OzonoffS.YoungG. S.BeldingA.HillM.HillA.HutmanT.JohnsonS.MillerM.RogersS. J.SchwichtenbergA. J.SteinfeldM.IosifA. M. (2014). The broader autism phenotype in infancy: When does it emerge?Journal of the American Academy of Child & Adolescent Psychiatry, 53(4), 398–407. https://doi.org/10.1016/j.jaac.2013.12.020
51.
PandeyJ.VerbalisA.RobinsD. L.BoorsteinH.KlinA.BabitzT.ChawarskaK.VolkmarF.GreenJ.BartonM.FeinD. (2008). Screening for autism in older and younger toddlers with the Modified Checklist for Autism in Toddlers. Autism, 12(5), 513–535. https://doi.org/10.1177/1362361308094503
52.
PellegriniA. D.NathanP. E. (Eds.). (2011). The Oxford handbook of the development of play. Oxford Library of Psychology.
53.
PutnickD. L.BornsteinM. H. (2016). Measurement invariance conventions and reporting: The state of the art and future directions for psychological research. Developmental Review, 41, 71–90. https://doi.org/10.1016/j.dr.2016.06.004
54.
RamseyR. K.NicholsL.LudwigN. N.FeinD.AdamsonL. B.RobinsD. L. (2018). Brief report: Sex differences in parental concerns for toddlers with autism risk. Journal of Autism and Developmental Disorders, 48(12), 4063–4069. https://doi.org/10.1007/s10803-018-3583-0
55.
ReznickJ. S.BaranekG. T.ReavisS.WatsonL. R.CraisE. R. (2007). A parent-report instrument for identifying one-year-olds at risk for an eventual diagnosis of autism: The first year inventory. Journal of Autism and Developmental Disorders, 37(9), 1691–1710. https://doi.org/10.1007/s10803-006-0303-y
56.
RonkinE.TullyE. C.Branum-MartinL.CohenL. L.HallC.DillyL.ToneE. B. (2022). Sex differences in social communication behaviors in toddlers with suspected autism spectrum disorder as assessed by the ADOS-2 toddler module. Autism, 26(5), 1282–1295. https://doi.org/10.1177/13623613211047070
57.
SacreyL. A. R.ZwaigenbaumL.BrysonS.BrianJ.SmithI. M.RobertsW.SzatmariP.RoncadinC.GaronN.NovakC.VaillancourtT.McCormickT.MacKinnonB.JilderdaS.ArmstrongV. (2015). Can parents’ concerns predict autism spectrum disorder? A prospective study of high-risk siblings from 6 to 36 months of age. Journal of the American Academy of Child & Adolescent Psychiatry, 54(6), 470–478. https://doi.org/10.1016/j.jaac.2015.03.014
58.
SchiltzH. K.MagnusB. E. (2021). Differential item functioning based on autism features, IQ, and age on the screen for child anxiety related disorders (scared) among youth on the autism spectrum. Autism Research, 14(6), 1220–1236. https://doi.org/10.1002/aur.2481
59.
SchjølbergS.ShicF.VolkmarF. R.Nordahl-HansenA.StenbergN.TorskeT.LarsenK.RileyK.SukhodolskyD. G.LeckmanJ. F.ChawarskaK.ØienR. A. (2022). What are we optimizing for in autism screening? Examination of algorithmic changes in the M-CHAT. Autism Research, 15(2), 296–304. https://doi.org/10.1002/aur.2643
60.
SturnerR.HowardB.BergmannP.MorrelT.LandaR.WaltonK.MarksD. (2017). Accurate autism screening at the 18-month well-child visit requires different strategies than at 24 months. Journal of Autism and Developmental Disorders, 47(10), 3296–3310. https://doi.org/10.1007/s10803-017-3231-0
61.
TeresiJ. A.RamirezM.JonesR. N.ChoiS.CraneP. K. (2012). Modifying measures based on differential item functioning (DIF) impact analyses. Journal of Aging and Health, 24(6), 1044–1076. https://doi.org/10.1177/0898264312436877
TienI. S.KimJ.JohnsonA. R.WoodJ. J. (2024). Gender differences: Confirmatory factor analysis of the ADOS-II. Journal of Autism and Developmental Disorders. Epub ahead of print. PMID: 38652372. https://doi.org/10.1007/s10803-024-06346-x
TowleP. O.PatrickP. A. (2016). Autism spectrum disorder screening instruments for very young children: A systematic review. Autism Research and Treatment, 2016, 4624829. https://doi.org/10.1155/2016/4624829
66.
Turner-BrownL. M.BaranekG. T.ReznickJ. S.WatsonL. R.CraisE. R. (2013). The First Year Inventory: A longitudinal follow-up of 12-month-old to 3-year-old children. Autism, 17(5), 527–540. https://doi.org/10.1177/1362361312439633
67.
WalkerC. M. (2011). What’s the DIF? Why differential item functioning analyses are an important part of instrument development and validation. Journal of Psychoeducational Assessment, 29(4), 364–376. https://doi.org/10.1177/0734282911406666
68.
WatsonL. R.BaranekG. T.CraisE. R.ReznickJ. S.DykstraJ.PerrymanT. (2007). The first year inventory: Retrospective parent responses to a questionnaire designed to identify one-year-olds at risk for autism. Journal of Autism and Developmental Disorders, 37(1), 49–61. https://doi.org/10.1007/s10803-006-0334-4
69.
WeiT.ChesnutS. R.Barnard-BrakL.RichmanD. (2015). Psychometric analysis of the Social Communication Questionnaire using an item-response theory framework: Implications for the use of the lifetime and current forms. Journal of Psychopathology and Behavioral Assessment, 37(3), 469–480. https://doi.org/10.1007/s10862-014-9468-4
70.
WetherbyA. M.Brosnan-MaddoxS.PeaceV.NewtonL. (2008). Validation of the Infant—Toddler Checklist as a broadband screener for autism spectrum disorders from 9 to 24 months of age. Autism, 12(5), 487–511. https://doi.org/10.1177/1362361308094501
71.
WolffJ. J.BoydB. A.ElisonJ. T. (2016). A quantitative measure of restricted and repetitive behaviors for early childhood. Journal of Neurodevelopmental Disorders, 8(1), 1–10. https://doi.org/10.1186/s11689-016-9161-x
72.
ZwaigenbaumL.BaumanM. L.FeinD.PierceK.BuieT.DavisP. A.NewschafferC.RobinsD. L.WetherbyA.ChoueiriR.KasariC.StoneW. L.YirmiyaN.EstesA.HansenR. L.McPartlandJ. C.NatowiczM. R.CarterA.GranpeeshehD.. . .WagnerS. (2015). Early screening of autism spectrum disorder: Recommendations for practice and research. Pediatrics, 136(Supplement 1), S41–S59. https://doi.org/10.1542/peds.2014-3667D
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
