The problem of determining optimal test lengths with fixed total testing time has proven to be a difficult one for criterion-referenced test developers. A solution is offered in this paper in which test lengths are determined by considering the importance, reliability, and validity of scores measuring objectives in a criterion-referenced test with a constraint set on the total desired test length.
Get full access to this article
View all access options for this article.
References
1.
Cronbach, L. J. and Gleser, G. C. (1965). Psychological tests and personnel decisions. Urbana: University of Illinois.
2.
Department of the Army (1986). Skill qualification test and common task test development policy and procedures. (TRADOC Reg. 351-2). Fort Monroe, VA: U. S. Army Training and Doctrine Command.
3.
Hambleton, R. K. (1974). Testing and decision-making procedures for selected individualized instructional programs. Review of Educational Research, 44, 371-400.
4.
Hambleton, R. K. (1984). Determining test lengths. In R. Berk (Ed.), Guidelines for preparing criterion-referenced tests. Baltimore, MD: The Johns Hopkins Press.
5.
Jackson, P. H. , and Novick, M. R. (1970). Maximizing the validity of a unit-weight composite as a function of relative component length with a fixed total testing time. Psychometrika, 35, 333-347.
6.
Lord, F. M. and Novick, M. R. (1968). Statistical theories of mental test scores. Reading, Massachusetts: Addison-Wesley.
7.
Woodbury, M. A. and Novick, M. R. (1968) Maximizing the validity of a test battery as a function of relative test lengths for a fixed total testing time. Journal of Mathematical Psychology, 5, 242-259.
