We examined the classification accuracy of Curriculum-Based Measurement in writing (CBM-W) Picture Word prompts scored for words written (WW), words spelled correctly (WSC), and correct word sequences (CWS). First graders (n = 133) were administered CBM-W prompts and the Test of Written Language–Third Edition (TOWL-3; Hammill & Larsen, 1996). Prompts scored for WSC showed acceptable levels of sensitivity (.947) and specificity (.587) with the TOWL-3 Contextual Language. Positive predictive values were low (approximately .20 to .30), and negative predictive values were high (mostly above .95). Overall classification accuracy, represented by the area under curve (AUC), ranged from .727 to .831. Further research regarding ways to improve classification accuracy of CBM-W and preliminary implications for practice are discussed.
BerningerV. W.AmtmannD. (2003). Preventing written expression disabilities through early and continuing assessment and intervention for handwriting and/or spelling problems: Research into practice. In SwansonH.HarrisK.GrahamS. (Eds.), Handbook of learning disabilities (pp. 323–344). New York, NY: The Guilford Press.
2.
BerningerV. W.NielsenK. H.AbbottR. D.WijsmanE.RaskindW. (2008). Writing problems in developmental dyslexia: Under-recognized and under-treated. Journal of School Psychology, 46, 1–21. doi:10.1016/j.jsp.2006.11.008
3.
BerningerV. W.SwansonH. L. (1994). Modifying Hayes and Flower’s model of skilled writing to explain beginning and developing writing. In ButterfieldE. C.CarlsonJ. (Eds.), Children’s writing: Toward a process theory of the development of skilled writing (pp. 57–81). London, England: JAI Press.
4.
BerningerV. W.WinnW. (2006). Implications of advancements in brain research and technology for writing development, writing instruction, and educational evolution. In MacArthurC.GrahamS.FitzgeraldJ. (Eds.), Handbook of writing research (pp. 96–114). New York, NY: The Guilford Press.
5.
CattsH. W.PetscherY.SchatschneiderC.BridgesM. S.MendozaK. (2009). Floor effects associated with universal screening and their impact on the early identification of reading disabilities. Journal of Learning Disabilities, 42, 163–176. doi:10.1177/0022219408326219
6.
CokerD. L.RitcheyK. D. (2010). Curriculum-based measurement of writing in kindergarten and first grade: An investigation of production and qualitative scores. Exceptional Children, 76, 175–193. doi:10.1177/001440291007600203
7.
CokerD. L.RitcheyK. D. (2014). Universal screening for writing risk in kindergarten. Assessment for Effective Intervention, 39, 245-256. doi: 10.1177/1534508413502389
8.
ComptonD. L.FuchsD.FuchsL. S.BryantJ. D. (2006). Selecting at-risk readers in first grade for early intervention: A two-year longitudinal study of decision rules and procedures. Journal of Educational Psychology, 98, 394–409. doi:10.1037/0022-0663.98.2.394
9.
CooperD.PikulskiJ. (2005). Here we go!Boston, MA: Houghton Mifflin.
10.
DenoS. L. (1985). Curriculum-based measurement: The emerging alternative. Exceptional Children, 52, 219–232.
11.
DenoS. L. (2003). Developments in curriculum-based measurement. Journal of Special Education, 37, 184–192. doi:10.1177/00224669030370030801
12.
DenoS. L.MirkinP.MarstonD. (1980). Relationships among simple measures of written expression and performance on standardized achievement tests (Vol. IRLD-RR-22). Minneapolis: Institute for Research on Learning Disabilities, University of Minnesota.
13.
FuchsL. S. (2004). The past, present, and future of curriculum-based measurement research. School Psychology Review, 33, 188–192.
14.
FuchsL. S.DenoS. L. (1991). Paradigmatic distinctions between instructionally relevant measurement models. Exceptional Children, 57, 488–501.
15.
FuchsL. S.FuchsD. (2007). A model for implementing responsiveness to intervention. Teaching Exceptional Children, 39, 14–20. doi:10.1177/004005990703900503
16.
GansleK. A.VanDerHeydenA. M.NoellG. H.ResetarJ. L.WilliamsK. L. (2006). The technical adequacy of curriculum-based and rating-based measures of written expression for elementary school students. School Psychology Review, 35, 435–450.
GrahamS.HarrisK. R. (2000). The role of self-regulation and transcription skills in writing and writing development. Educational Psychologist, 35, 3–12. doi:10.1207/S15326985EP3501_2
19.
HammillD. D.HreskoW. P. (1994). Comprehensive scales of student abilities. Austin, TX: PRO-ED.
20.
HammillD. D.LarsenS. C. (1996). Test of Written Language–Third edition. Austin, TX: PRO-ED.
21.
HayesJ. R.FlowerL. S. (1980). Identifying the organization of writing processes. In GreggL.SteinbergE. R. (Eds.), Cognitive processes in writing (pp. 3-30). Hillsdale, NJ: Lawrence Erlbaum.
22.
HreskoW. P.HerronS. R.PeakP. K. (1996). Test of Early Written Language (2nd ed.). Austin, TX: PRO-ED.
23.
JenkinsJ. R.HudsonR. F.JohnsonE. S. (2007). Screening for at-risk readers in a response to intervention framework. School Psychology Review, 36, 582–600.
24.
JewellJ.MaleckiC. K. (2005). The utility of CBM written language indices: An investigation of production-dependent, production-independent, and accurate-production scores. School Psychology Review, 34, 27–44.
25.
JohnsonE. S.JenkinsJ. R.PetscherY. (2010). Improving the accuracy of a direct route screening process. Assessment for Effective Intervention, 35, 131–140. doi:10.1177/1534508409348375
26.
LembkeE.DenoS. L.HallK. (2003). Identifying an indicator of growth in early writing proficiency for elementary school students. Assessment for Effective Intervention, 28, 23–35. doi:10.1177/073724770302800304
27.
MathesP. G.DentonC. A.FletcherJ. M.AnthonyJ. L.FrancisD. J.SchatschneiderC. (2005). The effects of theoretically different instruction and student characteristics on the skills of struggling readers. Reading Research Quarterly, 40, 148–182. doi:10.1598/RRQ.40.2.2
28.
McCutchenD. (2006). Cognitive factors in the development of children’s writing. In MacArthurC. A.GrahamS.FitzgeraldJ. (Eds.), Handbook of writing research (pp. 115–130). New York, NY: The Guilford Press.
29.
McMasterK. L.DuX.PétursdóttirA. (2009). Technical features of curriculum-based measures for beginning writers. Journal of Learning Disabilities, 42, 41-60. doi: 10.1177/0022219408326212
30.
McMasterK. L.DuX.YeoS.DenoS. L.ParkerD.EllisT. (2011). Curriculum-based measures of beginning writing: Technical features of the slope. Exceptional Children, 77, 185-206. doi: 10.1177/001440291107700203
31.
McMasterK. L.KunkelA.ShinJ.JungP.LembkeE. (2017). Early writing interventions: A best-evidence synthesis. Journal of Learning Disabilities. Advance online publication. doi: 10.1177/0022219417708169
National Governors Association Center for Best Practices, Council of Chief State School Officers. (2010). Common Core State Standards: English Language arts standards, Grade 1. Washington, DC: Author.
34.
ParkerR.TindalG.HasbrouckJ. (1991). Countable indices of writing quality: Their suitability for screening-eligibility decisions. Exceptionality, 2, 1–17. doi:10.1080/09362839109524763
35.
RitcheyK. D. (2006). Learning to write: Progress-monitoring tools for beginning and at-risk writers. Teaching Exceptional Children, 39, 22–26. doi:10.1177/004005990603900204
36.
RitcheyK. D.CokerD. L. (2013). An investigation of the validity and utility of two curriculum-based measurement writing tasks. Reading & Writing Quarterly, 29, 89–119. doi:10.1080/10573569.2013.741957
37.
RitcheyK. D.CokerD. L. (2014). Identifying writing difficulties in first grade: An investigation of writing and reading measures. Learning Disabilities Research & Practice, 29, 54–65. doi:10.1111/ldrp.12030
38.
ScanlonD. M.VellutinoF. R.SmallS. G.FanuelleD. P.SweeneyJ. M. (2005). Severe reading difficulties—Can they be prevented? A comparison of prevention and intervention approaches. Exceptionality, 13, 209–227. doi:10.1207/s15327035ex1304_3
39.
SimmonsD. C.CoyneM. D.KwokO.McDonaghS.HarnB. A.Kame’enuiE. J. (2008). Indexing response to intervention: A longitudinal study of reading risk from kindergarten through third Grade. Journal of Learning Disabilities, 41, 158–173. doi:10.1177/0022219407313587
40.
SwetsJ. A.DawesR. M.MonahanJ. (2000). Psychological science can improve diagnostic decisions. Psychological Science in the Public Interest, 1, 1–26. doi:10.1111/1529-1006.001
41.
VanDerHeydenA. M. (2011). Technical adequacy of response to intervention decisions. Exceptional Children, 77, 335–350. doi:10.1177/001440291107700305
42.
VideenJ.DenoS. L.MarstonD. (1982). Correct word sequences: A valid indicator of proficiency in written expression (Vol. IRLD-RR-84). Minneapolis: Institute for Research on Learning Disabilities, University of Minnesota.
43.
WoodcockR. W.McGrewF. A.SchrankF. A.MatherN. (2007). Woodcock Johnson III Tests of Achievement Normative Update. Rolling Meadows, IL: Riverside. (Original work published 2001).
44.
ZweigM. H.CampbellG. (1993). Receiver-operating characteristic (ROC) plots: A fundamental evaluation tool in clinical medicine. Clinical Chemistry, 39, 561–577.
