Implementing a Response to Intervention (RTI) system could improve overall student achievement and the way in which students with disabilities are identified. In order to evaluate the effectiveness of an RTI system (i.e., “Is our RTI system accomplishing its stated goals?”), a set of data-based indicators are needed. This paper will describe a set of five measure-able indicators from three domains of evaluation that schools can use to obtain frequent feedback on the impact of their RTI system on reading instruction and achievement. The evaluation methodology provides multiple, sensitive metrics that can be used soon after RTI implementation begins, and does not require that schools wait for more long-term, singular outcome measures such as performance on high-stakes tests to determine if the RTI system is functioning as intended. The data used for each indicator and the way in which the data can impact decisions is described. Issues related to RTI evaluation and areas of further research are discussed.
Al Otaiba, S., & Torgesen, J. ( 2007). Effects from intensive standardized kindergarten and first-grade interventions for the prevention of reading difficulties. In S. E. Jimerson, M. K. Burns, & A. M. VanDerHeyden (Eds.), Handbook of response to intervention (pp. 212-222). New York: Springer.
2.
Ardoin, S.P., Witt, J.C., Connell, J.E., & Koenig, J.L. ( 2005). Application of a three-tiered response to intervention model for instructional planning, decision making, and the identification of children in need of services. Journal of Psychoeducational Assessment, 23, 362-380.
3.
Baker, S.K., Smolkowski, K., Katz, R., Fien, H., Seeley, J.R., Kame’Enui, D.J., et al. (2008). Reading fluency as a predictor of reading proficiency in low-performing, high-poverty schools. School Psychology Review, 38(1), 18-37.
4.
Batsche, G., Elliot, J., Graden, J.L., Grimes, J., Kovaleski, J.F., & Prasse, D. ( 2005). Response to intervention: Policy considerations and implementation . Alexandria, VA: National Association of State Directors of Special Education
5.
Bollman, K.A., Silberglitt, B., & Gibbons, K.A. ( 2007). The St. Croix River Educational District model: Incorporating systems-level organization and a multi-tiered problem-solving process for intervention delivery. In S. R. Jimerson, M. K. Burns, & A. M. VanDerHeyden (Eds.), Handbook of response to intervention: The science and practice of assessment and intervention (pp. 319-330). New York: Springer.
6.
Boyer, L., Cook, N., Palenchar, L., & Smith, S. ( 2007, December). State presentation: West Virginia. Paper presented at the 2007 RTI Summit, Arlington, VA.
7.
Burns, M.K., & Senesac, B.V. ( 2005). Comparison of dual discrepancy criteria to assess response to intervention. Journal of School Psychology, 43, 393-406.
8.
Callender, W.A. ( 2007). The Idaho results-based model: Implementing response to intervention statewide. In S. R. Jimerson , M. K. Burns, & A. M. VanDerHeyden (Eds.), Handbook of response to intervention: The science and practice of assessment and intervention (pp. 331-342). New York: Springer.
9.
Catts, H.W., Hogan, T.P., & Adlof, S.M. ( 2005). Developmental changes in reading and reading disabilities . In H. Catts & A. G. Kamhi (Eds.), The connections between language and reading disabilities (pp. 41-54). Hillsdale, NJ : Lawrence Erlbaum.
10.
Christ, T.J. ( 2006). Short-term estimates of growth using curriculum-based measurement of oral reading fluency: Estimating standard error of the slope to construct confidence intervals. School Psychology Review , 35, 128-133.
11.
Clemens, N.H., & Shapiro, E.S. ( 2008, August). Improving diagnostic accuracy in reading within RTI models. Poster session presented at the annual convention of the American Psychological Association, Boston.
12.
Cox, D., & Allen, M. ( 2007, December). State presentation: Virginia. Paper presented at the 2007 RTI Summit, Arlington, VA.
13.
Deno, S.L., Mirkin, P.K., & Chiang, B. ( 1982). Identifying valid measures of reading. Exceptional Children, 5, 36-45.
14.
Ervin, R.A., Schaughency, E., Goodman, S.D., McGlinchey, M.T., & Matthews, A. ( 2006). Merging research and practice agendas to address reading and behavior school-wide. School Psychology Review, 35, 198-223.
15.
Fischer, D. ( 1983). The going gets tough when we descend from the ivory tower . Analysis and Intervention in Developmental Disabilities , 3(2-3), 249-255.
16.
Fixson, D.L., Naoom, S.F., Blasé, K.A., Friedman, R.M., & Wallace, F. ( 2005). Implementation research: A synthesis of the literature (FMHI Publication No. 231). Tampa: University of South Florida, Louis de la Parte Florida Mental Health Institute, The National Implementation Research Network.
17.
Fletcher, J.M., Coulter, W.A., Reschly, D.J., & Vaughn, S. ( 2004). Alternative approaches to the definition and identification of learning disabilities: Some questions and answers. Annals of Dyslexia, 54, 304-331.
18.
Fuchs, D., Fuchs, L.S., McMaster, K.N., & Al Otaiba, S. ( 2003). Identifying children at risk for reading failure: Curriculum-based measurement and the dual-discrepancy approach. In H. L. Swanson, K. R. Harris, & S. Graham (Eds.), Handbook of learning disabilities (pp. 431-449). New York: Guilford.
19.
Fuchs, D., Mock, D., Morgan, P.L., & Young, C.L. ( 2003). Responsiveness-to-intervention: Definition, evidence, and implications for the learning disabilities construct. Learning Disabilities: Research and Practice, 18, 157-171.
20.
Fuchs, L.S., Fuchs, D., Hosp, M., & Jenkins, J.R. ( 2001). Oral reading fluency as an indicator of reading competence: A theoretical, empirical, and historical analysis. Scientific Studies of Reading, 5, 239-256.
21.
Fuchs, L.S., Fuchs, D., & Maxwell, L. ( 1988). The validity of informal reading comprehension measures . Remedial and Special Education, 9, 20-28.
22.
Fuchs, L.S., Fuchs, D., & Prentice, K. ( 2004). Responsiveness to mathematical problem-solving instruction: Comparing students at risk of mathematics disability with and without risk of reading disability. Journal of Learning Disabilities, 37, 293-306.
23.
Gettinger, M., & Stoiber, K. ( 2008). Applying a response-to-intervention model for early literacy development in low-income children. Topics in Early Childhood Special Education, 27, 198-213.
Good, R.H., Simmons, D.C., & Kame’enui, E.J. (2001). The importance and decision-making utility of a continuum of fluency-based indicators of foundational reading skills for third-grade high-stakes outcomes. Scientific Studies of Reading, 5, 257-288.
26.
Gough, P.B., & Tunmer, W.E. ( 1986). Decoding, reading, and reading disability. Remedial & Special Education, 7, 6-10.
27.
Hartman, W.T., & Fay, T.A. ( 1996). Cost-effectiveness of instructional support teams in Pennsylvania (Policy Paper No. 9 of the Center for Special Education Finance) . Palo Alto, CA: American Institutes for Research.
28.
Hasbrouck, J.E., & Tindal, G. ( 1992). Curriculum-based oral reading fluency norms for students in Grades 2 through 5. Teaching Exceptional Children, 24(3), 41-44.
29.
Hasbrouck, J.E., & Tindal, G. ( 2005). Oral reading fluency: 90 years of measurement (Technical Report No. 33). Eugene, OR: Behavioral Research and Training.
30.
Hintze, J.M., & Silberglitt, B. (2005). A longitudinal examination of the diagnostic accuracy and predictive validity of R-CBM and high-stakes testing. School Psychology Review, 34, 372-386.
31.
Keller-Margolis, M.A., Shapiro, E.S., & Hintze, J.M. ( 2008). Long term diagnostic accuracy of curriculum-based measures in reading and mathematics. School Psychology Review, 37, 374-390.
32.
Marston, D., Muyskens, P., Lau, M., & Canter, A. ( 2003). Problem-solving model for decision-making with high-incidence disabilities: The Minneapolis experience. Learning Disabilities Research and Practice, 18, 187-200.
33.
McGlinchy, M.T., & Hixson, M.D. ( 2004). Using curriculum-based measurement to predict performance on state assessments in reading. School Psychology Review , 33, 193-203.
34.
McMaster, K.L., Fuchs, D., Fuchs, L.S., & Compton, D.L. ( 2005). Responding to nonresponders: An experimental field trial of identification and intervention methods. Exceptional Children , 71, 445-463.
35.
McNamara, K., & Hollinger, C. ( 2003). Intervention-based assessment: Evaluation rates and eligibility findings. Exceptional Children, 69, 181-193.
36.
Pearson Education, Inc. (2008). AIMSweb. Retrieved June 21, 2008, from http://www.aimsweb.com
37.
Peterson, D.W., Prasse, D.P., Shinn, M.R., & Swerdlik, M.E. (2007). The Illinois flexible service delivery model: A problem-solving model initiative. In S. R. Jimerson, M. K. Burns, & A. M. VanDerHeyden (Eds.), Handbook of response to intervention: The science and practice of assessment and intervention (pp. 300-318). New York: Springer.
38.
Shapiro, E.S., Keller, M.A., Lutz, G., Santoro, L., & Hintze, J.M. ( 2006). Curriculum-based measures and performance on state assessment and standardized tests: Reading and math performance in Pennsylvania. Journal of Psychoeducational Assessment, 42, 19-35.
39.
Shapiro, E.S., Solari, E., & Petscher, J. ( 2008). Use of a measure of reading comprehension to enhance prediction on the state high stakes assessment. Learning and Individual Differences, 18, 316-328.
40.
Shinn, M.R., Good, R.H., Knutson, N., Tilly, W.D., & Collins, V.L. ( 1992). Curriculum-based measurement of oral reading fluency: A confirmatory analysis of its relation to reading. School Psychology Review, 21, 459-479.
41.
Silberglitt, B., Burns, M.K., Madyun, N.H., & Lali, K.E. ( 2006). Relationship of reading fluency assessment data with state accountability test scores: A longitudinal comparison of grade levels . Psychology in the Schools, 43, 527-535.
42.
Silberglitt, B., & Hintze, J.M. ( 2007). How much growth can we expect? A conditional analysis of R-CBM growth rates by level of performance. Exceptional Children, 74, 71-84.
43.
Speece, D.L., & Case, L. ( 2001). Classification in context: An alternative to identifying early reading disability. Journal of Educational Psychology , 93, 735-749.
44.
Stage, S.A., & Jacobsen, M.D. (2001). Predicting student success on a state-mandated performance-based assessment using oral reading fluency . School Psychology Review, 30, 407-419.
45.
Success for All Foundation. (2008). 4sight benchmark assessments. Baltimore: Author.
46.
Sugai, G., & Horner, R.H. ( 2002). Introduction to the special series on positive behavior support in schools. Journal of Emotional and Behavioral Disorders , 10, 130-135.
47.
VanDerHeyden, A.M., Witt, J.C., & Barnett, D.W. ( 2005). The emergence and possible futures of response to intervention . Journal of Psychoeducational Assessment, 23, 339-361.
48.
VanDerHeyden, A.M., Witt, J.C., & Gilbertson, D. (2007). A multi-year evaluation of the effects of a response to intervention (RTI) model on identification of children for special education. Journal of School Psychology , 45, 225-256.
49.
Vaughn, S., Linan-Thompson, S., & Hickman, P. ( 2003). Response to instruction as a means of identifying students with reading/learning disabilities. Exceptional Children, 69, 391-409.
50.
Vaughn, S., Wanzek, J., Linan-Thompson, S., & Murray, C.S. ( 2007). Monitoring response to supplemental services for students at risk for reading difficulties: High and low responders. In S. R. Jimerson, M. K. Burns, & A. M. VanDerHeyden (Eds.), Handbook of response to intervention: The science and practice of assessment and intervention (pp. 234a-243). New York, NY: Springer.
51.
Vaughn, S., Wanzek, J., Woodruff, A.L., & Linan-Thompson, S. (2007). Prevention and early identification of students with reading disabilities. In D. Haager, J. Klingner, & S. Vaughn (Eds.), Evidence-based reading practices for response to intervention (pp. 11-27). Baltimore : Paul H Brookes Publishing.
52.
Walker, H.M., Horner, R.H., Sugai, G., Bullis, M., Sprague, J.R., Bricker, D., et al. (1996). Integrated approaches to preventing antisocial behavior patterns among school-age children and youth. Journal of Emotional and Behavioral Disorders, 4, 194-209.
