This study investigated the psychometric properties of the Preschool Language, Literacy, and Behavior Screener (PLLB-S). We examined and tested the factor structure of the PLLB-S using exploratory and confirmatory factor analyses. We further conducted internal consistency, concurrent validity, and predictive validity analyses and evaluated teacher satisfaction using PLLB-S. Our factor analyses resulted in 22 items distributed among three subscales with high internal consistency: Oral language, emergent literacy, and behavior skills. The PLLB-S and its subscales correlated moderately to strongly with standardized measures. The emergent literacy of the PLLB-S was the only subscale that significantly predicted children’s later vocabulary knowledge. Preschool teachers reported high satisfaction with the content and purpose of the questionnaire. We concluded that this tool with sound psychometric properties can potentially help increase the feasibility and efficiency of implementing standardized assessments in MTSS frameworks in preschool classrooms.
American Educational Research Association, American Psychological Association, and National Council on Measurement in Education. (2014). Standards for educational and psychological testing (Rev. ed.). American Educational Research Association.
2.
BagnatoS. J.GoinsD. D.Pretti-FrontczakK.NeisworthJ. T. (2014). Authentic assessment as “best practice” for early childhood intervention: National consumer social validity research. Topics in Early Childhood Special Education, 34(2), 116–127. https://doi.org/10.1177/0271121414523652
3.
BeckI. L.McKeownM. G.KucanL. (2013). Bringing words to life: Robust vocabulary instruction. Guilford Press.
4.
BegenyJ. C.BuchananH. (2010). Teachers' judgments of students’ early literacy skills measured by the Early Literacy Skills Assessment: Comparisons of teachers with and without assessment administration experience. Psychology in the Schools, 47(8), 859–868. https://doi.org/10.1002/pits.20509
BradfieldT.McConnellS. R.Wackerle-HollmanA. (2013). Confident decision-Making: Validation of an early childhood response to intervention decision-making framework Conference for research Innovation in early intervention.
CartaJ. J.Miller-YoungR. (2019). Multi-tiered systems of support for young children: Driving change in early education. Paul H Brookes Publishing Company.
9.
ChowJ. C.EkholmE.ColemanH. (2018). Does oral language underpin the development of later behavior problems? A longitudinal meta-analysis. School Psychology Quarterly, 33(3), 337–349. https://doi.org/10.1037/spq0000255
10.
ClementsD. H.SaramaJ.GermerothC. (2016). Learning executive function and early mathematics: Directions of causal relations. Early Childhood Research Quarterly, 36, 79–90. https://doi.org/10.1016/j.ecresq.2015.12.009
ElliottS. N.DaviesM. D.FreyJ. R.GreshamF.CooperG. (2018). Development and initial validation of a social emotional learning assessment for universal screening. Journal of Applied Developmental Psychology, 55, 39–51. https://doi.org/10.1016/j.appdev.2017.06.002
13.
EpsteinA. S.SchweinhartL. J.DeBruin-PareckiA.RobinK. B. (2004). Preschool assessment: A guide to developing a balanced approach (preschool Policy Matters, Issue 7). https://nieer.org/wp-content/uploads/2012/03/7.pdf
14.
GoldsteinG.HersenM. (2000). Handbook of psychological assessment. Elsevier.
15.
GoldsteinH.McKennaM.BarkerR. M.BrownT. H. (2019). Research–practice partnership: Application to implementation of multitiered system of supports in early childhood education. Perspectives of the ASHA Special Interest Groups, 4(1), 38–50. https://doi.org/10.1044/2018_PERS-ST-2018-0005
16.
GreenwoodC. R.BradfieldT.KaminskiR.LinasM.CartaJ. J.NylanderD. (2011). The response to intervention (RTI) approach in early childhood. Focus on Exceptional Children, 43(9), 1–22. https://doi.org/10.17161/foec.v43i9.6912
17.
HamiltonL.HalversonR.JacksonS. S.MandinachE.SupovitzJ.WaymanJ. (2009). IES Practice Guide: Using student achievement data to support instructional decision making (NCEE2009-4067). National Center for Education Evaluation and Regional Assistance. Retrieved fromhttp://ies.ed.gov/ncee/wwc/pdf/practice_guides/dddm_pg_092909.pdf
18.
HairJ. F.BlackW. C.BabinB. J.AndersonR. E.TathamR. L. (2014). Pearson new international edition. In Multivariate Data Analysis (7th ed.). Pearson Education Limited.
19.
HuL. T.BentlerP. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. https://doi.org/10.1080/10705519909540118
20.
JenkinsJ. R.HudsonR. F.JohnsonE. S. (2007). Screening for at-risk readers in a response to intervention framework. School Psychology Review, 36(4), 582–600. https://doi.org/10.1080/02796015.2007.12087919
JusticeL. M.EzellH. K. (2001). Word and print awareness in 4-year-old children. Child Language Teaching and Therapy, 17(3), 207–225. https://doi.org/10.1177/026565900101700303
23.
KelleyE. S.BarkerR. M.Peters-SandersL.MadsenK.SevenY.SotoX.OlsenW.HullK.GoldsteinH. (2020). Feasible implementation strategies for improving vocabulary knowledge of high-risk preschoolers: Results from a cluster-randomized trial. Journal of Speech, Language, and Hearing Research, 63(12), 4000–4017. https://doi.org/10.1044/2020_JSLHR-20-00316
24.
KelleyE. S.GoldsteinH.SpencerT. D.ShermanA. (2015). Effects of automated Tier 2 storybook intervention on vocabulary and comprehension learning in preschool children with limited oral language skills [Article]. Early Childhood Research Quarterly, 31, 47–61. https://doi.org/10.1016/j.ecresq.2014.12.004
LoniganC. J.WagnerR. K.TorgesenJ. K.RashotteC. A. (2007). TOPEL: Test of preschool early literacy. Pro-Ed.
27.
LoniganC. J.SchatschneiderC.WestbergL. (2008). Identification of children's skills and abilities linked to later outcomes in reading, writing, and spelling. Developing early literacy: Report of the national early literacy panel, Issue.
28.
MadsenK. M.Peters-SandersL.KelleyE. S.BarkerR. M.SevenY.OlsenW.SotoX.GoldsteinH. (2022). Optimizing academic vocabulary instruction with preschoolers: Revised books with classwide and home practice. University of South Florida.
29.
MashburnA. J.HenryG. T. (2004). Assessing school readiness: Validity and bias in preschool and kindergarten teachers’ ratings. Educational Measurement: Issues and Practice, 23(4), 16–30. https://doi.org/10.1111/j.1745-3992.2004.tb00165.x
MeiselsS. J. (2007). Accountability in early childhood: No easy answers. In PiantaR. C.CoxM. J.SnowK. L. (Eds.), School readiness and the transition to kindergarten in the era of accountability (pp. 31–47). Paul H Brookes Publishing.
NunnallyJ. C.BernsteinI. H. (1994). Psychometric theory (3rd ed.). McGraw Hill Education.
34.
PaleczekL.SeifertS.Gasteiger‐KlicperaB. (2017). Influences on teachers’ judgement accuracy of reading abilities on second and third grade students: A multilevel analysis. Psychology in the Schools, 54(3), 228–245. https://doi.org/10.1002/pits.21993
35.
QuinnJ. M.WagnerR. K.PetscherY.LopezD. (2015). Developmental relations between vocabulary knowledge and reading comprehension: A latent change score modeling study. Child Development, 86(1), 159–175. https://doi.org/10.1111/cdev.12292
36.
RigdonE. E. (1996). CFI versus RMSEA: A comparison of two fit indexes for structural equation modeling. Structural Equation Modeling: A Multidisciplinary Journal, 3(4), 369–379. https://doi.org/10.1080/10705519609540052
37.
SpiraE. G.BrackenS. S.FischelJ. E. (2005). Predicting improvement after first-grade reading difficulties: The effects of oral language, emergent literacy, and behavior skills. Developmental Psychology, 41(1), 225. https://doi.org/10.1037/0012-1649.41.1.225
38.
UraS. K.d’AbreuA. (2022). Racial bias, social–emotional competence, and teachers’ evaluation of student behavior. Children & Schools, 44(1), 17–26. https://doi.org/10.1093/cs/cdab028
39.
Wackerle-HollmanA.SpencerT. D.Artman-MeekerK.KelleyE. S.DuránL.FosterM. E. (2021). Multi-tiered system of supports in early childhood: Identifying gaps, considerations for application, and solutions. Early Childhood Research Quarterly, 56, 201–212. https://doi.org/10.1016/j.ecresq.2021.03.010
40.
Wackerle-HollmanA. K.SchmittB. A.BradfieldT. A.RodriguezM. C.McConnellS. R. (2015). Redefining individual growth and development indicators: Phonological awareness. Journal of Learning Disabilities, 48(5), 495–510. https://doi.org/10.1177/0022219413510181
41.
WakabayashiT.ClaxtonJ.SmithE. V.Jr. (2019). Validation of a revised observation-based assessment tool for children birth through kindergarten: The COR advantage. Journal of Psychoeducational Assessment, 37(1), 69–90. https://doi.org/10.1177/0734282917732491
42.
WashingtonJ. A.CraigH. K. (1999). Performances of at-risk, African American preschoolers on the peabody picture vocabulary test-III. Language, Speech, and Hearing Services in Schools, 30(1), 75–82. https://doi.org/10.1044/0161-1461.3001.75
43.
WiigE. H.SecordW. A.SemelE. (2004). Clinical evaluation of language Fundamentals preschool - 2 (2nd ed.). Harcourt Assessment.
44.
ZuckerT. A.JacbosE.CabellS. Q. (2021). Exploring barriers to early childhood teachers’ implementation of a supplemental academic language curriculum. Early Education and Development, 32(8), 1194–1219. https://doi.org/10.1080/10409289.2020.1839288
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
