This study compares various item option scoring methods with respect to coefficient alpha and a concurrent validity coefficient. The scoring methods under consideration were: (1) formula scoring, (2) a priori scoring, (3) empirical scoring with an internal criterion, and (4) two modifications of formula scoring. The study indicates a clear superiority of the empirically determined scoring system with respect to both coefficient alpha and the concurrent validity.
Get full access to this article
View all access options for this article.
References
1.
F.B.Davis, and G.Fifer,The effect on test reliability and validity of scoring aptitude and achievement tests with weights for every choice. EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 1959, 19, 159-170.
2.
G.J.Echternacht,A note on the variances of empirically derived option scoring weights. Research Bulletin73— 5. Princeton, N. J.: Educatiional Testing Service, 1973.
3.
D.Elizur,Adapting to innovation. Jerusalem, Israel: Jerusalem Academic Press, 1970.
4.
N.L.Gage,Logical vs. empirical scoring keys: The case of the MTAI. Journal of Educational Psychology , 1957, 48, 213-216.
5.
L.A.Guttman,A faceted definition of intelligence . In R. Eiferman (Ed.), Studies in psychology, scripta hierosolymitana , Vol. 14. Jerusalem, Israel: The Hebrew University, 1965.
6.
G.F.Hendrickson,The effect of differential option weighting on multiple-choice objective tests. Journal of Educational Measurement, 1971, 8, 291-296.
7.
R.R.Reilly, and R.Jackson,Effects of empirical option weighting on reliability and validity of the GRE. Research bulletin72-38Princeton, N. J.: Educational Testing Service, 1972.
8.
J.M.Stalnaker,Weighting questions in the essay-type examination. Journal of Educational Psychology , 1938, 29, 481-490.
9.
E.K.Strong, Jr.Vocational interests for men and women. Stanford, Calif. : Stanford University Press, 1943 .
10.
F.Swineford,Test analysis, Graduate Record Examinations Aptitude Test. Statistical Report SR-68-36. Princeton, N. J.: Educational Testing Service, 1968.
11.
R.A.Weitzman,Ideal multiple-choice items . Journal of the American Statistical Association, 1970, 65, 71-89.
12.
S.S.Wilks,Weighting systems for linear functions of correlated variables when there is no dependent variable. Psychometrika, 1938, 3, 23-40.
13.
A.H.Yee, and T.A.Kriewall,New logical scoring key for the Minnesota Teacher Attitilde Inventory. Journal of Educational Measurement, 1969, 6, 11-14.
14.
A.Zinger,A note on multiple-choice items . Journal of the American Statistical Association, 1972, 67, 340-341.
