Reliability and Associations of English and Mandarin Vocabulary Measures in Infants and Toddlers Growing Up in a Multilingual Society

Abstract

This paper aims to understand the reliability of English and Mandarin vocabulary measures, and their associations, among infants and toddlers growing up in a multilingual society. Reliability was examined via item-response Rasch models across English and Mandarin word categories. Parents reported on 137 children’s (age = 5 to 27 months) English and Mandarin vocabulary with a newly developed measure, the developmental vocabulary checklist (DVC). High reliability (alpha .91 to .99) was observed across English and Mandarin DVC categories. Wright maps suggest a lack of sensitivity at the tail end of the language-ability distribution. One-way ANOVAs indicating a significant difference across expected categories of DVC words was found. Higher exposure associated with a higher composite score across DVC categories, but only in Mandarin and only among older children in the 1-to-2 year band. A threshold account is discussed as an explanation for differential association of exposure in Mandarin but not English.

Keywords

assessing vocabulary reliability age/maturation effects bilingualism psychometric assessments

Get full access to this article

View all access options for this article.

References

Ackermann

Hepach

Mani

(2020). Children learn words easier when they are interested in the category to which the word belongs. Developmental Science, 23(3), e12915. https://doi.org/10.1111/desc.12915

Agarwal

P. K.

Xie

Rema

A. S. S.

Meaney

M. J.

Godfrey

K. M.

Rajadurai

V. S.

Daniel

L. M.

(2024). Concurrent validity of the ages and stages questionnaires with bayley scales of infant Development-III at 2 years–Singapore cohort study. Pediatrics & Neonatology, 65(1), 48–54. https://doi.org/10.1016/j.pedneo.2023.03.013

Agarwal

P. K.

Xie

Rema

A. S. S.

Rajadurai

V. S.

Lim

S. B.

Meaney

Daniel

L. M.

(2020). Evaluation of the ages and stages questionnaire (ASQ 3) as a developmental screener at 9, 18, and 24 months. Early Human Development, 147, 105081. https://doi.org/10.1016/j.earlhumdev.2020.105081

Bayley

(2006). Bayley scales of infant and toddler Development– third edition: Administration manual. Harcourt Assessment.

Bialystok

Luk

Peets

K. F.

Yang

(2010). Receptive vocabulary differences in monolingual and bilingual children. Bilingualism: Language and Cognition, 13(4), 525–531. https://doi.org/10.1017/S1366728909990423

Boone

W. J.

Staver

J. R.

(2020). Advances in rasch analyses in the human sciences (pp. 287–302): Springer.

Borovsky

Ellis

E. M.

Evans

J. L.

Elman

J. L.

(2016). Lexical leverage: Category knowledge boosts real‐time novel word recognition in 2‐year‐olds. Developmental Science, 19(6), 918–932. https://doi.org/10.1111/desc.12343

Choo

R. Q.

Styles

S. J.

(2024). Kinship terms of address and reference among families in Singapore [Poster]. Open Science Framework. https://doi.org/10.17605/OSF.IO/4FR52

Dale

(2015). Adaptations, not translations. MacArthur–Bates Communicative Development Inventories. https://mb-cdi.stanford.edu/documents/AdaptationsNotTranslations2015.pdf

10.

Dixon

L. Q.

(2005). Bilingual education policy in Singapore: An analysis of its sociohistorical roots and current academic outcomes. International Journal of Bilingual Education and Bilingualism, 8(1), 25–47. https://doi.org/10.1080/jbeb.v8.i1.pg25

11.

Goh

S. K.

Tham

E. K.

Magiati

Sim

Sanmugam

Qiu

… Rifkin-Graboi

(2017). Analysis of item-level bias in the Bayley-III language subscales: the validity and utility of standardized language assessment in a multilingual setting. Journal of Speech, Language, and Hearing Research, 60(9), 2663–2671.

12.

Goh

S. K.

Yang

Tsotsi

Qiu

Chong

Y. S.

Tan

K. H.

… Rifkin-Graboi

(2020). Mitigation of a prospective association between early language delay at toddlerhood and ADHD among bilingual preschoolers: evidence from the GUSTO cohort. Journal of Abnormal Child Psychology, 48(4), 511–523.

13.

Gómez Díaz

Fibla

Tsui

R. K. Y.

Byers-Heinlein

(2024). Testing theories of the vocabulary spurt with monolingual and bilingual infants. Developmental Psychology, 60(8), 1357–1371. https://doi.org/10.1037/dev0001777

14.

Graham

J. W.

(2009). Missing data analysis: Making it work in the real world. Annual Review of Psychology, 60(1), 549–576. https://doi.org/10.1146/annurev.psych.58.110405.085530

15.

S. C.

O'Brien

B. A.

Fritzsche

(2020). Child, family, and school factors in bilingual preschoolers’ vocabulary development in heritage languages. Journal of Child Language, 47(4), 817–843. https://doi.org/10.1017/S0305000919000904

16.

Hoff

(2021). Why bilingual development is not easy. Advances in Child Development and Behavior, 61, 129–167. https://doi.org/10.1016/bs.acdb.2021.03.002

17.

Holm

Hansen

P. B.

Romøren

A. S. H.

Garmann

N. G.

(2023). The Norwegian CDI-III as an assessment tool for lexical and grammatical development in preschoolers. Frontiers in Psychology, 14, 1175658. https://doi.org/10.3389/fpsyg.2023.1175658

18.

Kachergis

Marchman

V. A.

Dale

P. S.

Mankewitz

Frank

M. C.

(2022). Online computerized adaptive tests of children's vocabulary development in English and Mexican Spanish. Journal of Speech, Language, and Hearing Research, 65(6), 2288–2308. https://doi.org/10.1044/2022_JSLHR-21-00372

19.

Kašćelan

Prévost

Serratrice

Tuller

Unsworth

De Cat

(2022). A review of questionnaires quantifying bilingual experience in children: Do they document the same constructs? Bilingualism: Language and Cognition, 25(1), 29–41. https://doi.org/10.1017/s1366728921000390

20.

Law

Roy

(2008). Parental report of infant language skills: A review of the development and application of the communicative development inventories. Child and Adolescent Mental Health, 13(4), 198–206. https://doi.org/10.1111/j.1475-3588.2008.00503.x

21.

Lim

Chan

Yoong

(1994). Denver developmental screening test (DDST). Singapore Medical Journal, 35(2), 156–160.

22.

Linacre

J. M.

(2002). What do infit and outfit, mean-square and standardized mean. Rasch Measurement Transactions, 16(2), 878.

23.

Mallinson

Kozlowski

A. J.

Johnston

M. V.

Weaver

Terhorst

Grampurohit

Ehrlich-Jones

Heinemann

A. W.

Melvin

Sood

Van de Winckel

(2022). Rasch reporting guideline for rehabilitation research (RULER): The RULER statement. Archives of Physical Medicine and Rehabilitation, 103(7), 1477–1486. https://doi.org/10.1016/j.apmr.2022.03.013

24.

McAvinue

L. P.

(2025). The association between socioeconomic status and oral vocabulary in young children: A quantitative meta-analysis. First Language, 01427237251397678. https://doi.org/10.1177/01427237251397678

25.

Ministry of Education . (2010). Nurturing active learners and proficient users. In: Mother tongue languages review committee report. Singapore: Ministry of Education.

26.

Oller

D. K.

Pearson

B. Z.

Cobo-Lewis

A. B.

(2007). Profile effects in early bilingual language and literacy. Applied Psycholinguistics, 28(2), 191–230. https://doi.org/10.1017/S0142716407070117

27.

Pakir

(1993). Two tongue tied: Bilingualism in Singapore. Journal of Multilingual & Multicultural Development, 14(1-2), 73–90. https://doi.org/10.1080/01434632.1993.9994521

28.

Pérez-Navarro

Lallier

(2025). The contribution of the amount of linguistic exposure to bilingual language development: Longitudinal evidence from preschool years. Child Development, 96(1), 176–191. https://doi.org/10.1111/cdev.14164

29.

Pratt

A. S.

Durant

Peña

E. D.

Bedore

L. M.

(2024). Modeling dimensionality of bilingual kindergarteners’ language knowledge in Spanish and English. Journal of Speech, Language, and Hearing Research, 67(7), 2244–2268. https://doi.org/10.1044/2024_JSLHR-22-00140

30.

Rifkin-Graboi

Khng

K. H.

Cheung

Tsotsi

Sun

Kwok

Xie

Yang

Chen

C. C.

P. L.

Tan

N. C.

(2019). Will the future BE POSITIVE? Early life experience as a signal to the developing brain pre school entry. Learning: Research and Practice, 5(2), 99–125. https://doi.org/10.1080/23735082.2019.1674907

31.

Singapore Department of Statistics . (2022). Population trends 2022. https://www.singstat.gov.sg/-/media/files/publications/population/population2022.pdf

32.

Singh

Cheng

Tan

S. H.

Tan

Low

Y. L.

(2022). Language acquisition in a multilingual society: English vocabulary norms and predictors in Singaporean children. Child Development, 93(1), 288–305. https://doi.org/10.1111/cdev.13676

33.

Squires

Twombly

Bricker

Potter

(2009). ASQ-3 user’s guide (3rd ed.). Paul H. Brookes Publishing Co.

34.

Styles

S. J.

Plunkett

(2009). What is ‘word understanding’ for the parent of a one-year-old? Matching the difficulty of a lexical comprehension task to parental CDI report. Journal of Child Language, 36(4), 895–908. https://doi.org/10.1017/S0305000908009264

35.

Sun

Yin

Amsah

N. F. B. B.

O’brien

B. A.

(2018). Differential effects of internal and external factors in early bilingual vocabulary learning: The case of Singapore. Applied Psycholinguistics, 39(2), 383–411. https://doi.org/10.1017/s014271641700039x

36.

Thordardottir

(2011). The relationship between bilingual exposure and vocabulary development. International Journal of Bilingualism, 15(4), 426–445. https://doi.org/10.1177/1367006911403202

37.

Weisleder

Friend

Tsui

A. S. M.

Marchman

V. A.

(2024). Using parent report to measure vocabulary in young bilingual children: A scoping review. Language Learning, 74(2), 468–505. https://doi.org/10.1111/lang.12617

38.

Woon

F. T.

(2018). Linguistic sound symbolism and reading development: Sound-shape matching and predictors of reading in multilingual Singapore: Nanyang Technological University. Master’s thesis.

39.

Woon

F. T.

Cai

Styles

S. J.

(2020). Understanding the puzzle of vocabulary development in multilingual Singapore and its missing pieces. In: International congress of infant studies (ICIS 2020).

40.

Woon

F. T.

Styles

S. J.

(2021). Red-dot baby-talk quiz. DR-NTU.

41.

C. Y.

O’Brien

B. A.

Styles

S. J.

Chen

S. H. A.

(2020). The impact of bilingualism on skills development and education. In: Transforming teaching and learning in higher education: A chronicle of research and development in a Singaporean context (pp. 47–69). Springer Nature.