Monitoring Instructional Responsiveness−Reading (MIR-R): Preliminary Validity and Reliability With Economically Diverse Learners

Abstract

To preliminarily validate the Monitoring Instructional Responsiveness−Reading (MIR-R) for use in low-income settings, data were collected from 147 students from first through fifth grades who were primarily from low-income families. Data from three MIR-R components (Total Words Read, Ideas Attempted, Ideas Correct) and three related dependent measures (i.e., Test of Silent Contextual Reading Fluency [TOSCRF], Test of Silent Word Reading Fluency [TOSWRF], and Gray Silent Reading Test [GSRT]) were obtained across two time points (i.e., Time 1 and Time 2) in the same setting to address test–retest reliability and concurrent validity. Results showed (a) stability of the three MIR-R components scores over time, (b) strong correlations (p < .05) between the MIR-R Total Words Read and Ideas Attempted and TOSWRF and TOSCRF, and (c) strong associations between MIR-R Ideas Correct and TOSCRF, TOSWRF, and GSRT in Time 1 and Time 2. Because these results showed strong associations between MIR-R and established measures of reading and because MIR-R can be administered in only 3 min, it may provide an efficient operationalization of student progress. Additional implications were discussed.

Keywords

validation student responsiveness word reading reading rate reading comprehension

Get full access to this article

View all access options for this article.

References

Averill

O. H.

Rinaldi

(2011). Multi-tier system of supports. District Administration, 47(8), 91-94.

Baker

E. L.

Barton

P. E.

Darling-Hammond

Haertel

Ladd

H. F.

Linn

R. L.

. . . Shepard

L. A.

(2010). Problems with the use of student test scores to evaluate teachers (Economic Policy Institute Briefing Paper #278). Washington, DC: Economic Policy Institute. Retrieved from http://www.epi.org/files/page/-/pdf/bp278.pdf

Bell

S. M.

Hilton-Prillhart

McCallum

R. S.

Hopkins

(2011). Monitoring Instructional Responsiveness: Reading (MIR: M). Unpublished test, Department of Educational Psychology and Counseling and Department of Theory and Practice in Teacher Education, University of Tennessee, Knoxville.

Bell

S. M.

McCallum

R. S.

(2015). Handbook of reading assessment (2nd ed.). Boston, MA: Allyn & Bacon.

Bell

S. M.

McCallum

R. S.

Kirk

E. R.

Fuller

E. J.

McCane-Bowling

(2007). Investigation of the psychometric attributes of the Test of Silent Contextual Reading Fluency. Assessment for Effective Intervention, 33, 39-46.

Boggs

Szabo

(2009). Teachers’ talk: Teachers’ beliefs about factors affecting their classroom. In Falk-Ross

Szabo

Sampson

M. B.

Foote

(Eds.), Literacy issues during changing times: A call to action (Vol. 30, pp. 138-150). Commerce, TX: College Reading Association Yearbook.

Bracht

G. H.

Glass

G. V.

(1968). The external validity of experiments. American Educational Research Journal, 5, 437-474.

Brown

Sherbenou

R. J.

Johnsen

S. K.

(2010). Test of Nonverbal Intelligence, Fourth Edition. San Antonio, TX: Pearson Education.

Chall

(1983). Stages of reading development. New York, NY: McGraw-Hill.

10.

Christ

T. J.

Silberglitt

(2007). Estimates of the standard error of measurement for curriculum-based measurement of oral reading fluency. School Psychology Review, 36, 130-146.

11.

Cohen

(1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum.

12.

Cook

Odom

(2013). Evidence-based practices and implementation in special education. Exceptional Children, 79, 135-144.

13.

Cook

T. D.

Campbell

D. T.

(1979). Quasi-experimentation: Design and analysis issues for field settings. Chicago, IL: Rand McNally.

14.

Coyne

M. D.

Capozzoli-Oldham

Cuticelli

Ware

S. M.

(2015). Using assessment data to make a difference in vocabulary outcomes. Perspectives on Language and Literacy, 41, 52-56,58.

15.

Crocker

L. M.

Algina

(1987). Introduction to classical and modern test theory. New York, NY: Holt, Rinehart and Winston.

16.

Dennis

D. V.

(2017). Learning from the past: What ESSA has the chance to get right. The Reading Teacher, 70, 395-400.

17.

Eagle

Dowd-Eagle

Snyder

Gibbons

(2015). Implementing a Multi-Tiered System of Support (MTSS): Collaboration between school psychologists and administrators to promote systems-level change. Journal of Educational and Psychological Consultation, 25, 160-177.

18.

Every Student Succeeds Act of 2015, Pub. L. No. 114-95 § 114 Stat. 1177 (2015).

19.

Fuchs

L. S.

Fuchs

Maxwell

(1988). The validity of informal reading comprehension measures. Remedial and Special Education, 9, 20-28.

20.

Gall

J. P.

Gall

M. D.

Borg

W. R.

(2007). Applying educational research: A practical guide. Boston, MA: Pearson Education.

21.

George

Mallery

(2003). SPSS for Windows step by step: A simple guide and reference. 11.0 update (4th ed.). Boston, MA: Allyn & Bacon.

22.

Gliem

(2003, April). Calculating, interpreting, and reporting Cronbach’s Alpha Reliability Coefficient for Likert-type scales. Midwest Research-to-Practice Conference in Adult, Continuing, and Community Education. Retrieved from http://hdl.handle.net/1805/344

23.

Hammill

D. D.

Pearson

Wiederholt

J. L.

(2009). Comprehensive Test of Nonverbal Intelligence, Second Edition. Austin, TX: Pro-Ed.

24.

Hammill

D. D.

Wiederhot

J. L.

Allen

E. A.

(2014). Test of silent contextual reading fluency (2nd ed.). Austin, TX: Pro-Ed.

25.

Hanushek

E. A.

Rivkin

S. G.

(2010). Generalizations about using value-added measures of teacher quality. The American Economic Review, 100, 267-271.

26.

Hilton-Prillhart

A. N.

(2011). Validation of the Monitoring Academic Progress: Reading (MAP:R): Development and investigation of a group-administered comprehension-based tool for RTI (Unpublished doctoral dissertation). University of Tennessee. Retrieved from http://trace.tennessee.edu/utk_graddiss/1082

27.

Hosp

M. K.

Fuchs

L. S.

(2005). Using CBM as an indicator of decoding, word reading, and comprehension: Do the relations change with grade? School Psychology Review, 34, 9-26.

28.

Individuals with Disabilities Education Improvement Act (IDEA). (2004). 20 U.S.C. § 1400 et seq.

29.

Jenkins

J. R.

Fuchs

L. S.

van den Broek

Espin

Deno

(2003). Sources of individual differences in reading comprehension and reading fluency. Journal of Educational Psychology, 95, 719-729.

30.

Jimerson

S. R.

Burns

M. K.

VanDerHeyden

(Eds.). (2007). Handbook of response to intervention: The science and practice of assessment and intervention. New York, NY: Springer.

31.

Juel

(1988). Learning to read and write: A longitudinal study of 54 children from first through fourth grades. Journal of Educational Psychology, 80, 437-447.

32.

Kendeou

van den Broek

White

M. J.

Lynch

J. S.

(2009). Predicting reading comprehension in early elementary school: The independent contributions of oral language and decoding skills. Journal of Educational Psychology, 101, 765-778.

33.

Klauda

S. L.

Guthrie

J. T.

(2008). Relationships of three components of reading fluency to reading comprehension. Journal of Educational Psychology, 100, 310-321.

34.

Kuhn

M. R.

Stahl

S. A.

(2003). Fluency: A review of developmental and remedial practices (Technical Report No. 2-008). Ann Arbor: Center for the Improvement of Early Reading Achievement, University of Michigan.

35.

Lowe

Rabbitt

(1998). Test\re-test reliability of the CANTAB and ISPOCD neuropsychological batteries: Theoretical and practical issues. Neuropsychologia, 36, 915-923. doi:10.1016/s0028-3932(98)00036-0

36.

Mather

Hammill

D. D.

Allen

E. A.

Roberts

(2014). Test of silent reading fluency (2nd ed.). Austin, TX: Pro-Ed.

37.

McCallum

R. S.

Bell

S. M.

Coles

J. T.

Miller

K. C.

Hopkins

M. B.

Hilton-Prillhart

(2013). A model for screening twice-exceptional students (gifted with learning disabilities) within a response to intervention paradigm. Gifted Child Quarterly, 57, 209-222.

38.

Mertens

D. M.

(2014). Research and evaluation in education and psychology: Integrating diversity with quantitative, qualitative, and mixed methods (4th ed.). Thousand Oaks, CA: Sage.

39.

Miller

J. N.

(1993). Outliers in experimental data and their treatment. Analyst, 118, 455-461.

40.

Miller

K. C.

Bell

S. M.

McCallum

R. S.

(2015). Using reading rate and comprehension CBM to predict high-stakes achievement. Journal of Psychoeducational Assessment, 33, 707-718.

41.

Murphy

K. R.

Davidshofer

C. O.

(2005). Psychological testing: Principles and applications (6th ed.). Upper Saddle River, NJ: Pearson.

42.

Newcomer

(1999). Standardized Reading Inventory, Second Edition. Austin, TX: Pro-Ed.

43.

No Child Left Behind Act of 2001, P.L. 107-110, 20 U.S.C. § 6319 (2002).

44.

Oakhill

J. V.

Cain

Bryant

P. E.

(2003). The dissociation of single-word reading and text comprehension: Evidence from component skills. Language and Cognitive Processes, 18, 443-468.

45.

Ouellette

G. P.

(2006). What’s meaning got to do with it: The role of vocabulary in word reading and reading comprehension. Journal of Educational Psychology, 98, 554-566.

46.

Pikulski

J. J.

Chard

D. J.

(2005). Fluency: Bridge between decoding and reading comprehension. The Reading Teacher, 58, 510-519.

47.

Roid

G. H.

(2003). Stanford-Binet Intelligence Scales, Fifth Edition. Rolling Meadows, IL: Riverside.

48.

Salvia

Ysseldyke

J. E.

(2004). Assessment in special and inclusive education. New York, NY: Houghton Mifflin.

49.

Speece

D. L.

Ritchey

K. D.

Cooper

D. H.

Roth

F. P.

Schatschneider

(2003). Growth in early reading skills from kindergarten to third grade. Contemporary Educational Psychology, 29, 312-332.

50.

Torgesen

Nettles

Howard

Winterbottom

(2003). Brief report of a study to investigate the relationship between several brief measures of reading fluency and performance on the Florida Comprehensive Assessment Test–Reading in 4th, 6th, 8th, and 10th grades (FCRR Report No.6). Tallahassee: Florida Center for Reading Research at Florida State University. Retrieved from http://www.fcrr.org/TechnicalReports/Progress_monitoring_report.pdf

51.

Traylor

T. B.

Price

K. W.

Meisinger

E. B.

(2011). A review of the test of silent contextual reading fluency. Canadian Journal of School Psychology, 26, 75-79.

52.

Verhoeven

Van Leeuwe

(2008). Prediction of the development of reading comprehension: A longitudinal study. Applied Cognitive Psychology, 22, 407-423.

53.

Wiederholt

J. L.

Blalock

(2000). Gray Silent Reading Tests. Austin, TX: Pro-Ed.

54.

Woodcock

R. W.

McGrew

K. S.

Mather

(2001). Woodcock-Johnson III Tests of Achievement. Itasca, IL: Riverside Publishing.

55.

Young

Bowers

P. G.

(1995). Individual difference and text difficulty determinants of reading fluency and expressiveness. Journal of Experimental Child Psychology, 60, 428-454.