An Optimal,Unbiased Classification Rule for Mastery Testing Based on Longitudinal Data

Abstract

An optimal, unbiased classification rule is proposed based on a longitudinal model for the measurement of change in ability. The proposed methodology can be used as an additional tool for the year-to-year evaluation of student progress as well as consideration of the master testing problem. In general, it predicts future level of knowledge by using information about level of knowledge at entrance, its rate of growth, and the amount of within-individual variation. An illustration shows how the individual-oriented threshold value above which a student can be considered a master depends on the intra-test score variation and hence differs from student to student. Furthermore, it appears that information about growth of knowledge in the first year substantially improved the prediction of relative position of ability in the future.

Get full access to this article

View all access options for this article.

References

Albers, W. , Does, R.J.M.M. , Imbos, Tj. , & Janssen, M.P.E. (1989). A stochastic growth model applied to repeated tests of academic knowledge. Psychometrika, 54(3), 451-466.

Berk, R. A. (1986). Minimum competency testing: Status and potential. In B. S. Plake & J. C. Witt (Eds.), The future of testing (Vol. 2). Hillsdale, NJ: Lawrence Erlbaum.

Bimbaum, A. (1968). Some latent trait models and their use in inferring an examinee's ability. In F. M. Lord & M. R. Novick (Eds.), Statistical theories of mental test scores. Reading, MA: Addison-Wesley.

Hambleton, R. K. , & Rogers, H. J. (1991). Advances in criterion-referenced measurement. In R. K. Hambleton & J. N. Zaal (Eds.), Advances in educational and psychological testing. Boston: Kluwer.

Imbos, Tj. (1989). Het gebruik van einddoeltoetsen bij aanvang van de studie [The use of end objective related achievement tests in freshman years]. Doctoral dissertation, University of Limburg, Maastricht, The Netherlands.

Jaeger, R. M. (1989). Certification of student competence. In R. L. Linn (Ed.), Educational measurement (3rd ed.). New York: Macmillan.

Lehmann, E. L. (1986). Testing statistical hypotheses (2nd ed.). New York: Wiley.

Lord, E M. (1980). Applications of item response theory to practical testing problems. Hillsdale, NJ: Lawrence Erlbaum.

Lord, F M. , & Novick, M. R. (1968). Statistical theories of mental test scores. Reading, MA: Addison-Wesley.

10.

Schmidt, H. G. (1983). Problem-based learning: Rationale and description. Medical Education, 17, 11-16.

11.

Tan, E. S. , Imbos, Tj. , & Does, R.J.M.M. (1994). A distribution free approach for comparing growth of knowledge. Journal of Educational Measurement, 31(1), 51-67.

12.

van der Linden, W. J. (1980). Decision models for the use with criterion-referenced tests. Applied Psychological Measurement, 4(4), 469-492.