Differential Item Functioning Analysis of the Preschool Language Scale—4 Between English-Speaking Hispanic and European American Children From Low-Income Families
Restricted accessResearch articleFirst published online November, 2009
Differential Item Functioning Analysis of the Preschool Language Scale—4 Between English-Speaking Hispanic and European American Children From Low-Income Families
The study examined whether item bias is present in the Preschool Language Scale—4 (PLS-4). Participants were 440 children (3—5 years old; 86% English-speaking Hispanic and 14% European American) who were enrolled in Head Start programs. The PLS-4 items were analyzed for differential item functioning (DIF) using logistic regression and a one-parameter item response theory (IRT) model. The logistic regression analysis identified Auditory Comprehension (AC) Item 35 as having non-uniform DIF. Using IRT, AC Item 55 and Expressive Communication (EC) Items 30 and 31 displayed statistical evidence of DIF. AC Item 55 and EC Item 30 were more difficult for Hispanic children than for European American children, whereas the opposite was true for EC Item 31. These findings did not find strong evidence of cultural bias for the PLS-4 against English-speaking Hispanic children from low-income families.
American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. ( 1999). Standards for educational and psychological testing. Washington, DC: American Educational Research Association .
2.
Anderson, R. ( 2002). Practical assessment strategies with Hispanic students . In A. E. Brice (Ed.), The Hispanic child (pp. 143-184). Boston: Allyn & Bacon.
3.
Barbarin, O., & Soler, R. ( 1993). Behavioral, emotional and academic adjustment in a national probability sample of African American children: Effects of age, gender and family structure. Journal of Black Psychology, 19, 423-466.
4.
Camilli, G., & Shepard, L. ( 1994). Methods for identifying biased test items. Thousand Oaks, CA: Sage.
5.
Clauser, B.E., & Mazor, K.M. ( 1998). Using statistical procedures to identify differentially functioning test items. Educational Measurement: Issues and Practice, 17(1), 31-44.
6.
Fish, M., & Pinkerman, B. ( 2003). Language skills in low-SES rural Appalachian children: Normative development and individual differences, infancy to preschool. Applied Developmental Psychology, 23, 539-560.
7.
Fujiki, M., Brinton, B., Isaacson, T., & Summers, C. ( 2001). Social behaviors of children with language impairment on the play-ground: A pilot study. Language, Speech, and Hearing Services in School, 32, 101-113.
8.
Gutiérrez-Clellen, V.F. , & Peña , E. (2001). Dynamic assessment of diverse children: A tutorial. Language, Speech, and Hearing Services in Schools, 32, 212-224.
9.
Jackson-Maldonado, D. ( 2004). Verbal morphology and vocabulary in monolinguals and emergent bilinguals. In B. A. Goldstein (Ed.), Bilingual language development and disorders in Spanish-English speakers (pp. 131-162). Baltimore: Paul H. Brookes.
10.
Kline, P. ( 1993). The handbook of psychological testing. London: Routledge.
11.
Kuder, G.F., & Richardson, M.W. (1937). The theory of the estimation of test reliability. Psychometrika, 2, 151-160.
12.
McCauley, R.J. ( 2001). Assessment of language disorders in children. Mahwah, NJ: Lawrence Erlbaum.
13.
McDonnell, L. ( 1995). Opportunity to learn as a research concept and a policy instrument. Educational Evaluation and Policy Analysis, 17(3), 305-322.
14.
McNamara, T., & Roever, C. ( 2006). Language testing: The social dimension. Oxford, UK: Blackwell.
15.
Messick, S. ( 1989). Validity. In R. L. Linn (Ed.), Educational measurement (3rd ed., pp. 13-103). New York: American Council on Education.
16.
Muma, J. ( 1978). Language handbook: Concepts, assessment, intervention . Englewood Cliffs, NJ: Prentice Hall.
17.
NICHD Early Child Care Research Network. ( 2005). Pathways to reading: The role of oral language in the transition to reading. Developmental Psychology, 41(2), 428-442.
18.
Nunnally, J., & Bernstein, I. ( 1994). Psychometric theory (3rd ed.). New York: McGraw-Hill.
19.
Peña, E., Quinn, R., & Iglesias, A. ( 1992). The application of dynamic assessment methods to language assessment: A non-biased procedure. Journal of Special Education , 26, 269-280.
20.
Prizant, B.M. ( 1999). Early intervention: Young children with communication and emotional/behavioral problems. In D. Rogers-Adkinson & P. Griffith (Eds.), Communication disorders and children with psychiatric and behavioral disorders (pp. 295-342). San Diego, CA: Singular.
21.
Qi, C.H., Kaiser, A.P., & Milan, S. ( 2006). Children’s behavior during structured and unstructured class activities in Head Start. Journal of Early Intervention , 28(2), 17-30.
22.
Qi, C.H., Kaiser, A.P., Milan, S., & Hancock, T. ( 2006). Language performance of low-income African American and European American preschool children on the PPVT-III. Language, Speech, and Hearing Services in Schools, 37, 5-16.
23.
Qi, C.H., Kaiser, A.P., Milan, S., Yzquierdo, Z., & Hancock, T. ( 2003). The performance of low-income African American children on the Preschool Language Scales-3. Journal of Speech, Language, and Hearing Research, 43, 576-590.
24.
Rogler, L.H. ( 1993). Culture in psychiatric diagnosis: An issue of scientific accuracy. Psychiatry-Interpersonal and Biological Processes , 56, 324-327.
25.
Senechal, M., & LeFevre, J. ( 2002). Parental involvement in the development of children’s reading skills: A five-year longitudinal study. Child Development , 73, 445-460.
26.
Stanton-Chapman, T.L., Chapman, D.A., Kaiser, A.P., & Hancock, T.B. ( 2004). Cumulative risk and low-income children’s language development. Topics in Early Childhood Special Education, 24(4), 227-237.
27.
Storch, S.A., & Whitehurst, G.J. (2002). Oral language and code-related precursors to reading: Evidence from a longitudinal model. Developmental Psychology, 38, 934-947.
Takala, S., & Kaftandjieva, F. (2000). Test fairness: A DIF analysis of an L2 vocabulary test. Language Testing, 17, 323-340.
30.
Tomblin, J.B., Zhang, X., Buckwalter, P., & Catts, H. ( 2000). The association of reading disability, behavioral disorders, and language impairment among second-grade children. Journal of Child Psychology and Psychiatry, 41, 473-482.
31.
Uiterwijk, H., & Vallen, T. ( 2005). Linguistic sources of item bias for second generation immigrants in Dutch tests. Language Testing, 22, 211-234.
32.
Walker, D., Greenwood, C.R., Hart, B., & Carta, J.J. ( 1994). Improving the prediction of early school academic outcomes using socioeconomic status and early language production. Child Development, 65, 606-621.
33.
Washington, J.A. ( 1996). Issues in assessing language skills in African American children. In A. G. Kamhi, K. E. Pollock, & J. L. Harris (Eds.), Communication development and disorders in African American children: Research, assessment, and intervention (pp. 35-54). Baltimore : Paul H. Brookes.
34.
Washington, J., & Craig, H. ( 1994). Dialectal forms during discourse of urban, African-American preschoolers living in poverty. Journal of Speech and Hearing Research, 37, 816-823.
35.
Washington, J., & Craig, H. ( 1999). Performances of at-risk, African American preschoolers on the Peabody Picture Vocabulary Test-III. Language, Speech, and Hearing Services in Schools, 30, 75-82.
36.
Zimmerman, I.L., & Castilleja, N.F. (2005). The role of a language scale for infant and preschool assessment. Mental Retardation and Developmental Disabilities Research Reviews, 11, 238-246.
37.
Zimmerman, I.L., Steiner, V.G., & Pond, R.E. ( 1992). Preschool Language Scale (3rd ed.). San Antonio, TX: The Psychological Corporation.
38.
Zimmerman, I.L., Steiner, V.G., & Pond, R.E. ( 2002). Preschool Language Scale (4th ed.). San Antonio, TX: The Psychological Corporation.
