Validity of caregiver response to a developmental screening instrument was examined in 571 caregivers (51.7% identifying as ethnic minority) of infants/toddlers (48% female) assessed longitudinally from birth to 18 months. Three embedded validity scales were designed to detect: atypical (ATP), negative (NRS), and positive (PRS) response styles. Rates of responding on the ATP, NRS, and PRS scales relative to established validity measures, temporal stability including test–retest reliability of the scales, and relations between response styles and maternal education were examined. Response bias was low; however, significant differences due to maternal education were evident. More variable scores (ATP) and more advanced development (PRS) was consistently reported by caregivers with lower education. Caregivers with higher education reported their infants’ development as less advanced (NRS). Base rates of uncommon responding ranged from 11.6% to 14.4% and 5.8% to 9.1% at liberal and conservative cut scores. Preliminary analysis of additional social-contextual sources of variation (e.g., caregiver mental health) in response styles suggests the need for complex modeling of multiple sources of bias in caregiver-reported developmental outcomes. These are the first embedded validity scales to be designed within a caregiver-reported instrument of infant/toddler development.
ArmijoI.SchonhautL.CorderoM. (2015). Validation of the Chilean version of the Ages and Stages Questionnaire (ASQ-CL) in community health settings. Early Human Development, 91(12), 671–676. doi: 10.1016/j.earlhumdev.2015.10.001
3.
AssariS. (2021). Parents’ perceived neighborhood safety and children’s internalizing symptoms: Race and socioeconomic status differences. Journal Mental Health and Clinical Psychology, 5(1), 19–33.
4.
Ben-PorathY. S.TellegenA. (2020). Minnesota Multiphasic Personality Inventory-3 (MMPI-3): Manual for administration, scoring, and interpretation. University of Minnesota Press.
5.
BiglerE. D. (2015). Neuroimaging as a biomarker in symptom validity and performance validity testing. Brain Imaging and Behavior, 9(3), 421–444. https://doi.org/10.1007/s11682-015-9409-1
6.
BlairL. M.FordJ. L. (2019). Neighborhood context and the risk for developmental disabilities in early childhood. Maternal and Child Health Journal, 23(9), 1213–1219. https://doi.org/10.1007/s10995-019-02757-w
7.
BoskovicI.AkcaA. Y. E.GirominiL. (2022). Symptom coaching and symptom validity tests: An analog study using the structured inventory of malingered symptomatology, Self-Report Symptom Inventory, and Inventory of Problems-29. Applied Neuropsychology: Adult, 1–13. https://doi.org/10.1080/23279095.2022.2057856
8.
BrothersK. B.Page GlascoeF.RobertshawN. S. (2008). PEDS: Developmental milestones—An accurate brief tool for surveillance and screening. Clinical Pediatrics, 47(3), 271–279. https://doi.org/10.1177/0009922807309419
9.
BushS. S.HeilbronnerR. L.RuffR. M. (2014). Psychological assessment of symptom and performance validity, response bias, and malingering: Official position of the Association for Scientific Advancement in Psychological Injury and Law. Psychological Injury and Law, 73(3), 197–205.
ChafetzM. D.WilliamsM. A.Ben-PorathY. S.BianchiniK. J.BooneK. B.KirkwoodM. W.LarrabeeG. J.OrdJ. S. (2015). Official position of the American Academy of Clinical Neuropsychology Social Security Administration policy on validity testing: Guidance and recommendations for change. The Clinical Neuropsychologist, 29(6), 723–740.
12.
ConneryA. K.LeeA. H.PetersonR. L.DichiaroM.ChiesaA. (2024). Caregiver report of social-emotional functioning in infants and young children after inflicted traumatic brain injury. Child Neuropsychology. https://doi.org/10.1080/09297049.2024.2302684
13.
ConneryA. K.RaghunathanR. S.ColbertA. M.ErdodiL.WarschauskyS.Huth-BocksA.Gerry TaylorH.RaghunathanT.BerglundP.StaplesA. D.LukomskiA.KirklandJ.CanoJ.Lajiness-O’NeillR. (2023). The influence of sociodemographic factors and response style on caregiver report of infant developmental status. Frontiers in Pediatrics, 10. https://doi.org/10.3389/fped.2022.1080163
14.
CoxJ.HoldenJ.SagovskyR. (1987). Detection of postnatal depression. Development of the 10-item Edinburgh Postnatal Depression Scale. British Journal of Psychiatry, 150, 782–786.
15.
Dandachi-FitzGeraldB.PondsR. W. H. M.MertenT. (2013). Symptom validity and neuropsychological assessment: A survey of practices and beliefs on neuropsychologists in six European countries. Archives of Clinical Neuropsychology, 28, 771–873.
16.
DeJosephM. L.HerzbergM. P.SifreR. D.BerryD.ThomasK. M. (2022). Measurement matters: An individual differences examination of family socioeconomic factors, latent dimensions of children’s experiences, and resting state functional brain connectivity in the ABCD sample. Developmental Cognitive Neuroscience, 53. https://doi.org/10.1016/j.dcn.2021.101043
17.
DerogatisL.MelisaratosN. (1983). The Brief Symptom Inventory: An introductory report. Psychological Medicine, 13(3), 595–605.
18.
Doss RobertsM.ChristiansenA.JansenE.AugustynM. (2023). Quality matters developmentally-trained primary care clinicians: A pipeline to improved access?www.jdbp.org
19.
ErdodiL. A.AbeareC. A.MedoffB.SekeK. R.SagarS.KirschN. L. (2018). A single error is one too many: The Forced Choice Recognition trial on the CVLT-II as a measure of performance validity in adults with TBI. Archives of Clinical Neuropsychology, 33(7), 845–860. https://doi.org/10.1093/arclin/acx110
20.
ErdodiL. A. (2021). Five shades of gray: Conceptual and methodological issues around multivariate models of performance validity. Neurorehabilitation, 49(2), 179–213. https://doi.org/10.3233/NRE-218020
21.
ErdodiL. A. (2023). Multivariate models of performance validity: The Erdodi Index captures the dual nature of non-credible responding (continuous and categorical). Assessment, 30(5), 1467–1485. https://doi.org/10.1177/10731911221101910
22.
ErtemI. O.AtayG.DoganD. G.BayhanA.BingolerB. E.GokC. G.OzbasS.HaznedarogluD.IsikliS. (2007). Mothers’ knowledge of young child development in a developing country. Child: Care, Health and Development, 33(6), 728–737. https://doi.org/10.1111/j.1365-2214.2007.00751.x
23.
FeldmanH. M.DollaghanC. A.CampbellT. F.Kurs-LaskyM.JanoskyJ. E.ParadiseJ. L. (2000). Measurement properties of the MacArthur communicative development inventories at ages one and two years. Child Development, 71(2), 310–322. https://doi.org/10.1111/1467-8624.00146
24.
GegnerJ.ErdodiL. A.GirominiL.ViglioneD. J.BosiJ.BrusadelliE. (2022). An Australian study on feigned mTBI using the Inventory of Problems – 29 (IOP-29), its Memory Module (IOP-M), and the Rey Fifteen Item Test (FIT). Applied Neuropsychology: Adult, 29(5), 1221–1230. https://doi.org/10.1080/23279095.2020.1864375
25.
GioiaG. A.EspyK. A.IsquithP. K. (2002). Behavior rating inventory of executive function: Preschool version. Psychological Assessment Resources.
26.
GioiaG. A.IsquithP. K.GuyS. C.KenworthyL. (2015). Behavior Rating Inventory of Executive Function®, second edition (BRIEF®2). PAR, Inc.
27.
GirominiL.ViglioneD. J.PignoloC.ZennaroA. (2018). A clinical comparison, simulation study testing the validity of SIMS and IOP-29 with an Italian sample. Psychological Injury and Law, 11(4), 340–350. https://doi.org/10.1007/s12207-018-9314-1
28.
GlascoeF. P.MarksK. P. (2011). Detecting children with developmental- behavioral problems: The value of collaborating with parents. Psychological Test and Assessment Modeling, 53(2), 258–279.
29.
Health Resources and Services Administration. (2023). Health workforce shortage areas.
30.
HeilbronnerR. L.SweetJ. J.MorjanJ. E.LarrabeeG. J.MillisS. R., & Conference Participants. (2009). American Academy of Clinical Neuropsychology consensus conference statement on the neuropsychological assessment of effort, response bias, and malingering. The Clinical Neuropsychologist, 23, 1093–1129. https://doi.org/10.1080/13854040903155063
31.
HolcombM.PyneS.CutlerL.OikleD. A.ErdodiL. A. (2023). Take their word for it: The Inventory of Problems provides valuable information on both symptom and performance validity. Journal of Personality Assessment, 105(4), 520–530. https://doi.org/10.1080/00223891.2022.2114358
32.
Huth-BocksA.FranzS.BerglundP. A.SchroederH. M.StaplesA. D.RaghunathanT.WarschauskyS.TaylorH. G.LedouxG.DieterL.RosenblumK.Lajiness-O’neillR. (2024). Measuring early relational health using PediaTracTM in a diverse sample of infant-caregiver dyads. Journal of Developmental and Behavioral Pediatrics, 45(3), e225–e234. https://doi.org/10.1097/DBP.0000000000001248
33.
Lajiness-O’NeillR.BerglundP.WarschauskyS.Huth-BocksA.TaylorH. G.LobermeierM.StaplesA.LukomskiA.RaghunathanT. (2025). Latent social communication cognition growth trajectories of term and preterm infants/toddlers based on caregiver report. Pediatric Research. Advance online publication. https://doi.org/10.1038/s41390-025-04112-y
34.
Lajiness-O’NeillR.BrooksJ.LukomskiA.SchillingS.Huth-BocksA.WarschauskyS.FloresA.-M.SwickC.NymanT.AndersenT.MorrisN.SchmittT. A.Bell-SmithJ.MoirB.HodgesE. K.LyddyJ. E. (2018). Development and validation of PediaTracTM: A web-based tool to track developing infants. Infant Behavior and Development, 50, 224–237. https://doi.org/10.1016/j.infbeh.2018.01.008
35.
Lajiness-O’NeillR.WarschauskyS.Huth-BocksA.TaylorH. G.BerglundP.StaplesA. D.LukomskiA.BrooksJ.CanoJ.RaghunathanT. (2023). Caregiver-reported development in term and preterm infants from birth to nine months of age: Psychometrics of the PediaTrac social/communication/cognition domain. Psychological Assessment, 35(7), 589–601. https://doi.org/10.1037/pas0001235
36.
Lajiness-O’NeillR.WarschauskyS.Huth-BocksA.TaylorH. G.BrooksJ.LukomskiA.RaghunathanT. E.BerglundP.StaplesA. D.ErdodiL.SchillingS. (2021). PediaTrac V.3.0 protocol: A prospective, longitudinal study of the development and validation of a web-based tool to measure and track infant and toddler development from birth through 18 months. BMJ Open, 11(12), Article e050488. https://doi.org/10.1136/bmjopen-2021-050488
37.
LefkovicsE.RigóJ.JrKovácsI.TalabérJ.SzitaB.KecskemétiA.SzabóL.SomogyváriZ.BajiI. (2018). Effect of maternal depression and anxiety on mother’s perception of child and the protective role of social support. Journal of Reproductive and Infant Psychology, 36(4), 434–448.
38.
LipkinP. H.MaciasM. M.HymanS. L.LevyS. E.SpoonerS. A.RodgersB.KuoD. Z.ApkonS.DavidsonL. F.EllerbeckK. A.FosterJ. E. A.HymanS. L.NoritzG. H.O’Connor LeppertM.SaundersB. S.StilleC.YinL.BreiT.DavisB. E.. . .HighP. C. (2020). Promoting optimal development: Identifying infants and young children with developmental disorders through developmental surveillance and screening. Pediatrics, 145(1), 1–19. https://doi.org/10.1542/PEDS.2019-3449
39.
LockhartM.ChauxR.ChevinM.CelleM.Raia-BarjatT.PaturalH.ChabrierS.GiraudA. (2023). Classification performance of the ages and stages questionnaire: Influence of maternal education level. Children, 10(3), 449. https://doi.org/10.3390/children10030449
40.
MartinP. K.SchroederR. W.OdlandA. P. (2015). Neuropsychologists’ validity testing beliefs and practices: A survey of North American Professionals. The Clinical Neuropsychologist, 29(6), 741–746.
41.
McCuneY. D.RichardsonM. M.PowellJ. A. (1984). Psychosocial health issues in pediatric practices: Parents’ knowledge and concerns. Pediatrics, 74(2). https://doi.org/10.1542/peds.74.2.183
42.
MertenT.Dandachi-FitzGeraldB.HallV.SchmanddB. A.SantamarjaeP.González-OrdiH. (2013). Symptom validity assessment in European countries: Development and state of the art. Clínica y Salud, 24(3), 129–138.
43.
MoreyL. C. (1991). Personality Assessment Inventory; Professional manual. Psychological Assessment Resources.
44.
MoreyL. C. (2014). The Personality Assessment Inventory. In ArcherR. P.SmithS. R. (Eds.), Personality assessment (pp. 181–228). Routledge/Taylor & Francis Group.
45.
NiestenI. J.MerckelbachH.Dandachi-FitzGeraldB.JelicicM. (2020). The iatrogenic power of labeling medically unexplained symptoms: A critical review and meta-analysis of “diagnosis threat” in mild head injury. Psychology of Consciousness: Theory, Research, and Practice, 10(4), 454–474. https://doi.org/10.1037/cns0000224
46.
Pearson. (2009). Advanced clinical solutions for the WAIS-IV and WMS-IV—Technical manual.
47.
PignoloC.GirominiL.AlesF.ZennaroA. (2021). Detection of feigning of different symptom presentations with the PAI and IOP-29. Assessment, 30(3), 565–579. https://doi.org/10.1177/10731911211061282
48.
PomésM.SquiresJ.YovanoffP. (2016). Psychometric examination of a Spanish translation of a developmental screening instrument. Journal of Early Childhood Research, 14(2), 132–145. https://doi.org/10.1177/1476718X14529279
49.
RaspaM.LevisD. M.Kish-DotoJ.WallaceI.RiceC.BargerB.GreenK. K.WolfR. B. (2015). Examining parents’ experiences and information needs regarding early identification of developmental delays: Qualitative research to inform a public health campaign. Journal of Developmental and Behavioral Pediatrics, 36(8), 575–585. https://doi.org/10.1097/DBP.0000000000000205
50.
R Core Team. (2020). R: A language and environment for statistical computing. R Foundation for Statistical Computing. https://www.R-project.org/
51.
ReynoldsC. R.KamphausR. W. (2004). Behavior assessment system for children, second edition. Pearson, Inc.
52.
RobinsonA.ReedC.DavisK.DiversR.MillerL.ErdodiL. A.CalamiaM. (2023). Settling the score: Can CPT-3 embedded validity indicators distinguish between credible and non-credible responders referred for ADHD and/or SLD?Journal of Attention Disorders, 27(1), 80–88. https://doi.org/10.1177/10870547221121781
53.
RomeoD. M.CowanF. M.HaatajaL.RicciD.PedeE.GalliniF.CotaF.BrognaC.VentoG.RomeoM. G.MercuriE. (2021). Hammersmith Infant Neurological Examination for infants born preterm: Predicting outcomes other than cerebral palsy. Developmental Medicine and Child Neurology, 63(8), 939–946. https://doi.org/10.1111/dmcn.14768
54.
RomeoD. M.RicciM.PicilliM.FotiB.CordaroG.MercuriE. (2020). Early neurological assessment and long-term neuromotor outcomes in late preterm infants: A critical review. Medicina (Lithuania), 56(9), 1–13. https://doi.org/10.3390/medicina56090475
55.
RussellD. N.MoreyL. C. (2019). Use of validity indicators on the personality assessment inventory to detect feigning of post-traumatic stress disorder. Psychological Injury and Law, 12(3–4), 204–211. https://doi.org/10.1007/s12207-019-09349-7
56.
SabellisA.MessaI.GirominiL.LichtensteinJ.MayN.ErdodiL, A. (2021). Symptom versus performance validity in patients with mild TBI: Independent sources of non-credible responding. Psychological Injury and Law, 14(2). https://doi.org/10.1007/s12207-021-09400-6
57.
SheldrickR. C.PerrinE. C. (2013). Evidence-based milestones for surveillance of cognitive, language, and motor development. Academic Pediatrics, 13(6), 577–586. https://doi.org/10.1016/j.acap.2013.07.001
58.
ShoreyS.CheeC. Y. I.NgE. D.ChanY. H.San TamW. W.ChongY. S. (2018). Prevalence and incidence of postpartum depression among healthy mothers: A systematic review and meta-analysis. Journal of Psychiatric Research, 104, 235–248.
59.
SömenM. M.LesjakS.MajaronT.LavopaL.GirominiL.ViglioneD.PodlesekA. (2021). Using the Inventory of Problems-29 (IOP-29) with the Inventory of Problems Memory (IOP-M) in malingering-related assessments: A study with a Slovenian sample of experimental feigners. Psychological Injury and Law, 14(2), 104–113.
60.
SquiresJ.BrickerD.TwomblyE. (2009). Ages & stages questionnaires: A parent-completed child monitoring system-3. Paul H. Brookes Publishing.
61.
SullivanB. A.DoshiA.ChernyavskiyP.HusainA.BinaiA.SahniR.FairchildK. D.MoormanJ. R.TraversC. P.VesoulisZ. A. (2023). Neighborhood deprivation and association with neonatal intensive care unit mortality and morbidity for extremely premature infants. JAMA Network Open, 6(5), Article e2311761. https://doi.org/10.1001/jamanetworkopen.2023.11761
62.
SweetJ. J.HeilbronnerR. L.MorganJ. E.LarrabeeG. J.RohlingM. L.BooneK. B.KirkwoodM. W.SchroederR. W.SuhrJ. A. (2021). American Academy of Clinical Neuropsychology (AACN) 2021 consensus statement on validity assessment: Update of the 2009 AACN consensus conference statement on neuropsychological assessment of effort, response bias, and malingering. Clinical Neuropsychologist, 35(6), 1053–1106. https://doi.org/10.1080/13854046.2021.1896036
63.
TylickiJ. L. (2021). Examining the utility of the MMPI-3 overreporting scales in a forensic disability sample [Doctoral dissertation, Kent State University]. OhioLINK Electronic Theses and Dissertations Center. http://rave.ohiolink.edu/etdc/view?acc_num=kent162246449505713
64.
van HeerdenA.HsiaoC.MatafwaliB.LouwJ.RichterL. (2017). Support for the feasibility of the ages and stages questionnaire as a developmental screening tool: A cross-sectional study of South African and Zambian children aged2-60 months. BMC Pediatrics, 17(1), 55. https://doi.org/10.1186/s12887-017-0802-3
65.
ViglioneD. J.GirominiL.LandisP. (2017). The development of the Inventory of Problems–29 : A brief self-administered measure for discriminating bona fide from feigned psychiatric and cognitive complaints for discriminating bona fide from feigned psychiatric and cognitive complaints. Journal of Personality Assessment, 99(5), 534–544. https://doi.org/10.1080/00223891.2016.1233882
66.
ViglioneD. J.GirominiL. (2020). Inventory of Problems–29 professional manual. IOP-Test LLC.VillagomezA. N.MunozF. M.PetersonR. L.ColbertA. M.GladstoneM.MacDonaldB.WilsonR.FairlieL.GernerG. J.PattersonJ.BoghossianN. S.BurtonV. J.CortésM.KatikaneniL. D.LarsonJ. C. G.AnguloA. S.JoshiJ.NesinM.PadulaM. A.KochharS., . . . Brighton Collaboration Neurodevelopmental Delay Working Group. (2019). Neurodevelopmental delay: Case definition & guidelines for data collection, analysis, and presentation of immunization safety data. Vaccine, 37(52), 7623–7641. https://doi.org/10.1016/j.vaccine.2019.05.027
67.
WarschauskyS.Gidley LarsonJ. C.RaghunathanT. E.BerglundP.Huth-BocksA.TaylorH. G.StaplesA. D.CanoJ.BrooksJ.LukomskiA.BarksJ.Lajiness-O’NeillR. (2023). Longitudinal caregiver-reported term and preterm infant motor development from birth to twelve months of age: Latent trait analysis. Developmental Medicine & Child Neurology. https://doi.org/10.1111/dmcn.15816
68.
WarschauskyS.RaghunathanT.BerglundP.LarsonJ. C. G.Huth-BocksA.TaylorH. G.StaplesA. D.LukomskiA.Lajiness-O’NeillR. (2025). Latent motor growth trajectories of term and preterm infants based on caregiver report. Child Neuropsychology. https://doi.org/10.1080/09297049.2025.2451323
69.
WebberT. A.Sullivan-BacaE.ModianoY. A.TaiwoZ.GrabyanJ. M. (2022). Validity of informant report interpretations: Role of examinee performance and symptom invalidity. Psychological Assessment, 34(2), 125–138. https://doi.org/10.1037/pas0001074
70.
WintersC. L.GirominiL.CrawfordT. J.AlesF.ViglioneD. J.WarmelinkL. (2021). An Inventory of Problems–29 (IOP–29) study investigating feigned schizophrenia and random responding in a British community sample. Psychiatry, Psychology and Law, 28(2), 235–254. https://doi.org/10.1080/13218719.2020.1767720
71.
YueA.JiangQ.WanB.AbbeyC.MedinaA.ShiY.RozelleS. (2019). Concurrent validity of the ages and stages questionnaire and the bayley scales of infant development III in China. PLoS One, 14(9), e0221675. https://doi.org/0.1371/journal.pone.0221675
ZuccatoB. G.TysonB. T.ErdodiL. A. (2018). Early bird fails the PVT? The effects of timing artifacts on performance validity tests. Psychological Assessment, 30(11), 1491–1498. https://doi.org/10.1037/pas0000596
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
