Validation is an important step in the developmental process of any reading test. Yet traditional approaches to reliability and validity assessment are not relevant for criterion-referenced reading tests. A more relevant approach defines reliability in terms of the consistency of decision-making across repeated test administrations and validity in terms of the accuracy of decision-making between an administration of a reading test and an administration of a criterion measure. A technique for measuring this type of reliability and validity is described in this paper along with an example of how it was used with a criterion-referenced reading battery.
References
1.
CarrollJ.B.A model of school learning. Teachers College Record1963, 69, 723–733.
2.
CarrollJ.B.Problems of measurement related to the concept of learning for mastery. Educational Horizons1970, 48, 71–80.
3.
CohenJ.A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 1960, 20, 37–46.
4.
FlanaganJ.C.Functional education for the seventies. Phi Delta Kappan1967, 49, 27–32.
5.
FlanaganJ.C.Program for learning in accordance with needs. Psychology in the Schools1969, 6, 133–136.
6.
Fountain valley teacher support system. Huntington Beach, California: Richard L. Zweig Associates, Inc., 1971.
7.
GlaserR.Adapting the elementary school curriculum to individual performance. In Proceedings of the 1967 Invitational Conference on Testing Problems. Princeton, N.J.: Educational Testing Service, 1968.
8.
GlaserR.NitkoA.J.Measurement in learning and instruction. In ThorndikeR.L. (Ed.), Educational Measurement. Washington: American Council on Education, 1971, p. 625–670.
9.
HambletonR.K.A review of testing and decision-making procedures for selected individualized instructional programs. Review of Educational Research1974, 44, 371–400.
10.
HambletonR.K.GorthW.P.Criterion-referenced testing: Issues and applications. Paper presented at the annual meeting of the Northeastern Educational Research Association, Liberty, New York, 1970.
11.
HambletonR.K.NovickM.R.Toward an integration of theory and method for criterion-referenced tests. Journal of Educational Measurement1973, 10, 159–170.
12.
LichtmanM.The development and validation of R/EAL, an instrument to assess functional literacy. Journal of Reading Behavior1974, 6, 167–181.
13.
OlsonM.A.Evaluation of test items for the Dallas Independent School District's Survey of Reading Skills. (Research Report No. 73–199) Dallas: Dallas Independent School District. 1973.
Read on. New York. Random House School Division, 1971.
16.
SwaminathanH.HambletonR.K.AlginaJ.Reliability of criterion-references tests: A decision-theoretic formulation. Journal of Educational Measurement1974, 11, 263–268.
