This study reports an independent investigation of the psychometric properties of Desired Results Developmental Profile (DRDP), a teacher-rated measure of school readiness for preschool-aged children. In a sample of 2,031 low-income, 3- to 5-year-old children attending Head Start, we tested three measurement models: a higher order one-factor model, a seven-factor model, and a five-factor model. To explore the appropriateness of the DRDP for use with diverse populations of young children, we used multiple group and differential item functioning (DIF) analyses to determine whether the DRDP works differently for dual language learners (DLL) and non-DLLs. The proposed five-factor structure fits the data best, with greater face and statistical validity. Using this conceptually driven factor structure, the multiple group analyses were robust for DLL and non-DLL preschool students. More than half of the items on the DRDP displayed little DIF. Items measuring emergent language and literacy exhibited DIF favoring non-DLL children.
AbediJ. (2002). Standardized achievement tests and English language learners: Psychometrics issues. Educational Assessment, 8, 231-257.
2.
AbediJ.GándaraP. (2006). Performance of English language learners as a subgroup in large-scale assessment: Interaction of research and policy. Educational Measurement: Issues and Practice, 25(4), 36-46.
3.
AckermanD. J.ColeyR. J. (2012). State pre-K assessment policies: Issues and status. policy information report. Educational Testing Service. Retrieved from https://files.eric.ed.gov/fulltext/ED529449.pdf
4.
ArgulewiczE. N.AbelR. R. (1984). Internal evidence of bias in the PPVT-R for Anglo-American and Mexican-American children. Journal of School Psychology, 22, 299-303.
5.
BaraldiA. N.EndersC. K. (2010). An introduction to modern missing data analyses. Journal of School Psychology, 48, 5-37.
BaroodyA. E.DiamondK. E. (2013). Measures of preschool children’s interest and engagement in literacy activities: Examining gender differences and construct dimensions. Early Childhood Research Quarterly, 28, 291-301.
8.
BestJ. R.MillerP. H. (2010). A developmental perspective on executive function. Child Development, 81, 1641-1660.
9.
BrownS. R. (1993). A primer on Q methodology. Operant Subjectivity, 16, 91-138.
10.
BrownT. A. (2006). Confirmatory factor analysis for applied research. New York, NY: Guilford Press.
California Department of Education, Early Education and Support Division. (2010). Desired results regulations management bulletin 04-08. Retrieved from https://www.cde.ca.gov/sp/cd/ci/mb040804mb.asp
13.
CameronC. E.BrockL. G.MurrahW. R.BellL.WorzallaS.GrissmerD. W.MorrisonF. J. (2012a). Fine motor skills and executive function both contribute to kindergarten achievement. Child Development, 83, 1229-1244.
14.
CameronC. E.ChenW. B.BlodgettJ.CottoneE. A.MashburnA. J.BrockL. L.GrissmerD. (2012b). Preliminary validation of the motor skills rating scale. Journal of Psychoeducational Assessment, 30, 555-566.
15.
CheungG. W.RensvoldR. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9, 233-255.
16.
Congressional Research Service. (2016). Preschool development grants (FY2014-FY2016) and race to the top—early learning challenge grants (FY2011-FY2013). Retrieved from https://www.everycrsreport.com/reports/R44008.html
17.
Connors-TadrosL. (2014). Information and resources on developing state policy on Kindergarten Entry Assessment (KEA): CEELO FastFacts. Washington, DC: Center on Enhancing Early Learning Outcomes.
18.
CumminsJ. (1991). Interdependence of first- and second-language proficiency in bilingual children. In BialystokE. (Ed.), Language processing in bilingual children (pp. 70-99). Cambridge, UK: Cambridge University Press.
19.
DixonL. Q.ZhaoJ.QuirozB. G.ShinJ. Y. (2012). Home and community factors influencing bilingual children’s ethnic language vocabulary development. International Journal of Bilingualism, 16, 541-565.
20.
DuncanG. J.MagnusonK. (2013). Investing in preschool programs. The Journal of Economic Perspectives, 27, 109-132.
21.
DuncanG. J.MurnaneR. J. (2011). Whither opportunity? Rising inequality, schools, and children’s life chances. New York, NY: Russell Sage Foundation.
22.
EngelhardG.Jr. (2002). Monitoring raters in performance assessments. In TindalG.HaladynaT. M. (Eds.), Large-scale assessment programs for all students (pp. 261-288). Mahwah, NJ: Lawrence Erlbaum.
23.
FernandezM. C.PearsonB. Z.UmbelV. M.OilerD. K.Molinet-MolinaM. (1992). Bilingual receptive vocabulary in Hispanic preschool children. Hispanic Journal of Behavioral Sciences, 14, 268-276.
24.
FloydF. J.WidamanK. F. (1995). Factor analysis in the development and refinement of clinical assessment instruments. Psychological Assessment, 7, 286-299.
GelinM. N.ZumboB. D. (2003). Differential item functioning results may change depending on how an item is scored: An illustration with the center for epidemiologic studies depression scale. Educational and Psychological Measurement, 63, 65-74.
27.
GillandersC.FrancoX.SeidelK.CastroD. C.MéndezL. I. (2017). Young dual language learners’ emergent writing development. Early Child Development and Care, 187, 371-382.
28.
GioiaG. A.IsquithP. K. (2004). Ecological assessment of executive function in traumatic brain injury. Developmental Neuropsychology, 25, 135-158.
29.
GormleyW. T. (2008). The Effects of Oklahoma’s pre-K program on Hispanic children. Social Science Quarterly, 89, 916-936.
30.
GorsuchR. L. (2003). Factor analysis. In SchinkaJ. A.VelicerW. F. (Eds.), Handbook of psychology: Research methods in psychology (Vol. 2, pp. 143-164). New York, NY: John Wiley.
31.
GrissmerD.GrimmK. J.AiyerS. M.MurrahW. M.SteeleJ. S. (2010). Fine motor skills and early comprehension of the world: Two new school readiness indicators. Developmental Psychology, 46, 1008-1017.
32.
HarrisY. R.SchroederV. M. (2013). Language deficits or differences: What we know about African American vernacular English in the 21st century. International Education Studies, 6, 194-204.
33.
HeromanC.BurtsD. C.BerkeK.BickartT. S. (2010). Teaching strategies GOLD® objectives for development & learning: Birth through kindergarten. Washington, DC: Teaching Strategies.
34.
High/Scope Educational Research Foundation. (1992). High/Scope Child Observation Record (COR) for ages 2½-6. Ypsilanti, MI: High/Scope Press.
35.
HoffE. (2013). Interpreting the early language trajectories of children from low-SES and language minority homes: Implications for closing achievement gaps. Developmental Psychology, 49, 4-14.
36.
HuL. T.BentlerP. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1-55.
37.
ImmekusJ. C.McGeeD. (2016). The measurement invariance of the student opinion scale across English and non-English language learner students within the context of low-and high-stakes assessments. Frontiers in Psychology, 7, Article 1352.
JodoinM. G.GierlM. J. (2001.). Evaluating type I error and power rates using an effect size measure with the logistic regression procedure for DIF detection. Applied Measurement in Education, 14, 329-349.
40.
KaganS. L.GarciaE. (2007). Taking stock: Assessing and improving early childhood learning and program quality. Washington, DC: Pew Charitable Trusts.
41.
KarelitzT. M.ParrishD. M.YamadaH.WilsonM. (2010). Articulating assessments across childhood: The cross-age validity of the desired results developmental profile–revised. Educational Assessment, 15, 1-26.
42.
KlineR. B. (2005). Principles and practice of structural equation modeling (2nd ed.). New York, NY: Guilford Press.
43.
KlingbergT. (2010). Training and plasticity of working memory. Trends in Cognitive Sciences, 14, 317-324.
44.
LalorA.BrownT.MurdoloY. (2016). Relationship between children’s performance-based motor skills and child, parent, and teacher perceptions of children’s motor abilities using self/informant-report questionnaires. Australian Occupational Therapy Journal, 63, 105-116.
45.
Lee WebbM. Y.CohenA. S.SchwanenflugelP. J. (2008). Latent class analysis of differential item functioning on the Peabody picture vocabulary test–III. Educational and Psychological Measurement, 68, 335-351.
46.
LoniganC. J.AllanN. P.LernerM. D. (2011). Assessment of preschool early literacy skills: Linking children’s educational needs with empirically supported instructional activities. Psychology in the Schools, 48, 488-501.
47.
LópezL. M. (2012). Assessing the phonological skills of bilingual children from preschool through kindergarten: Developmental progression and cross-language transfer. Journal of Research in Childhood Education, 26, 371-391.
48.
LópezL. M.GreenfieldD. B. (2004). The cross-language transfer of phonological skills of Hispanic head start children. Bilingual Research Journal, 28, 1-18.
49.
MagnusonK.LahaieC.WaldfogelJ. (2006). Preschool and school readiness of children of immigrants. Social Science Quarterly, 87, 1241-1262.
50.
Mancilla-MartinezJ.LesauxN. K. (2011). The gap between Spanish speakers word reading and word knowledge: A longitudinal study. Child Development, 82, 1544-1560.
51.
MatherN.McGrewN.WoodcockR. W. (2001). Woodcock-Johnson tests of achievement (3rd ed.). Itasca, IL: Riverside Publishing.
52.
MeiselsS. J.JablonJ.MarsdenD. B.DichtelmillerM. L.DorfmanA. B. (1994). The work sampling system: An overview (3rd ed.). Ann Arbor, MI: Rebus Planning Associates.
53.
Miller-BainsK. L.RussoJ. M.WillifordA. P.DeCosterJ.CottoneE. A. (2017). Examining the validity of a multidimensional performance-based assessment at kindergarten entry. AERA Open, 3, 1-16.
MohlerG. M.YunK. A.CarterA.KasakD. (2009). The effect of curriculum, coaching, and professional development on prekindergarten children’s literacy achievement. Journal of Early Childhood Teacher Education, 30, 49-68.
56.
National Center for Education Statistics. (2011). The condition of education 2011: Section 1 participation in education. Retrieved from http://nces.ed.gov/pubs2011/2011033_2.pdf
OldfatherP.WigfieldA. (1996). Children’s motivation for literacy learning. In BakerL.AfflerbachP.ReinkingD. (Eds.), Developing engaged readers in the school and home communities (pp. 89-113). Hillsdale, NJ: Lawrence Erlbaum.
59.
PaezM. M.TaborsP. O.LopezL. M. (2007). Dual language and literacy development of Spanish-speaking preschool children. Journal of Applied Developmental Psychology, 28, 85-102.
60.
PhillipsD. A.LipseyM. W.DodgeK. A.HaskinsR.BassokD.BurchinalM. R.WeilandC. (2017). Puzzling It Out: The current state of scientific knowledge on pre-kindergarten effects. In PhillipsD. A.DodgeK. A. (Eds.), The current state of scientific knowledge on pre-kindergarten effects (pp. 19-30). Washington, D.C.: Brookings Institution and Duke University.
61.
QuirkM.MaywormA.EdyburnK.FurlongM. J. (2016). Dimensionality and measurement invariance of a school readiness screener by ethnicity and home language. Psychology in the Schools, 53, 772-784.
62.
QuirkM.Nylund-GibsonK.FurlongM. (2012). Exploring patterns of Latino/a children’s school readiness at kindergarten entry and their relations with Grade 2 achievement. Early Childhood Research Quarterly, 28, 437-449.
63.
QuirogaT.Lemos-BrittonZ.MostafapourE.AbbottR. D.BerningerV. W. (2002). Phonological awareness and beginning reading in Spanish-speaking ESL first graders: Research into practice. Journal of School Psychology, 40, 85-111.
64.
ReardonS. F.GalindoC. (2009). The Hispanic-white achievement gap in math and reading in the elementary grades. American Educational Research Journal, 46, 853-891.
65.
ReeseL.ArauzR. M.BazánA. R. (2012). Mexican parents’ and teachers’ literacy perspectives and practices: Construction of cultural capital. International Journal of Qualitative Studies in Education, 25, 983-1003.
66.
ReeseL.GallimoreR. (2000). Immigrant Latinos’ cultural model of literacy development: An evolving perspective on home-school discontinuities. American Journal of Education, 108, 103-134.
67.
ReeseL.GoldenbergC. (2008). Community literacy resources and home literacy practices among immigrant Latino families. Marriage & Family Review, 43, 109-139.
68.
RussoJ. M.WillifordA. P.MarkowitzA. M.VitielloV. E.BassokD. (2019). Examining the validity of a widely-used school readiness assessment: Implications for teachers and early childhood programs. Early Childhood Research Quarterly, 48, 14-25.
69.
SchickA. R.MelziG. (2016). Print-related practices in low-income Latino homes and preschoolers’ school-readiness outcomes. Journal of Early Childhood Literacy, 16, 171-198.
70.
SénéchalM.OuelletteG.RodneyD. (2006). The misunderstood giant: On the predictive role of early vocabulary to future reading. In DickinsonD. K.NeumanS. B. (Eds.), Handbook of early literacy research (Vol. 2, pp. 173-182). New York, NY: Guilford Press.
71.
ShadishW. R.CookT. D.CampbellD. T. (2001). Experimental and quasi-experimental designs for generalized causal inference. Boston, MA: Houghton Mifflin.
72.
SnowC.Van HemelS. (2008). Early childhood assessment: Why what and how? Report of the committee on developmental outcomes and assessments for young children. Washington, DC: National Academies Press.
73.
SoderbergJ.StullS.CummingsK.NolenE.McCutchenD.JosephG. (2013). Inter-rater reliability and concurrent validity study of the Washington Kindergarten Inventory of Developing Skills (WaKIDS) (Unpublished report prepared for the State of Washington Office of Superintendent of Public Instruction). Retrieved from http://www.k12.wa.us/WaKIDS/pubdocs/WaKIDS_Report072613.pdf
74.
StataCorp. (2015). Stata statistical software: Release 14. College Station, TX: Author.
75.
SutterC.OntaiL. L.NishinaA.CongerK. J.ShiltsM. K.TownsendM. S. (2017). Utilizing the desired results developmental profile as a measure of school readiness: Evaluating factor structure and predictors of school readiness. Early Child Development and Care, 187, 1433-1445.
76.
VandenbergR. J.LanceC. E. (2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3, 4-70.
77.
WakabayashiT.ClaxtonJ.SmithE. V. (2019). Validation of a revised observation-based assessment tool for children birth through Kindergarten: The COR advantage. Journal of Psychoeducational Assessment, 37, 69-90.
78.
WatermanC.McDermottP. A.FantuzzoJ. W.GadsdenV. L. (2012). The matter of assessor variance in early childhood education—or whose score is it anyway?Early Childhood Research Quarterly, 27, 46-54.
79.
WigfieldA.EcclesJ. S.SchiefeleU.RoeserR. W.Davis-KeanP. (2006). Development of achievement motivation. In DamonW.LernerR. M.EisenbergN. (Eds.), Handbook of child psychology, Vol. 3. Social, emotional, and personality development (6th ed., pp. 933-1002). New York, NY: John Wiley.
80.
YoshikawaH.WeilandC.Brooks-GunnJ.BurchinalM. R.EspinosaL. M.GormleyW., et al. (2013). Investing in our future: The evidence base on preschool education. New York, NY: Foundation for Child Development, Society for Research in Child Development.
81.
ZumboB. D. (1999). A handbook on the theory and methods of Differential Item Functioning (DIF): Logistic regression modeling as a unitary framework for binary and Likert-type (ordinal) item scores. Ottawa, Ontario, Canada: Directorate of Human Resources Research and Evaluation, Department of National Defense.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
