A response strategy is a rule an examinee may use to increase his expected score on a test beyond the score the examinee would expect to receive based on his knowledge of the material tested. For a confidence-testing procedure proposed by Diamond, it is shown that a response strategy exists. Next, it is mathematically proved that all weights in the scoring procedure for Diamond's confidence testing method permit a response strategy. Due to the response strategy, it is concluded that this confidence-testing procedure is not an improvement over the usual way of administering and scoring multiple-choice tests.
Get full access to this article
View all access options for this article.
References
1.
ArcherN. S. A.A comparison of the conventional and two modified procedures for responding to multiple-choice items with respect to test reliability, validity, and item characteristics. Unpublished doctoral dissertation, Syracuse Univer., 1962.
2.
de FinetttB.Methods for discriminating levels of partial knowledge concerning a test item. British Journal of Mathematical and Statistical Psychology, 1965, 18, 87–123.
3.
DiamondJ.A preliminary study of the reliability and validity of a scoring procedure based upon confidence and partial information. Journal of Educational Measurement, 1975, 12, 129–133.
4.
EbelR.Review of “Valid Confidence Testing Demonstration Kit.”Journal of Educational Measurement, 1968, 5, 353–354.
5.
HopkinsK. D.HakstlanA. R.HopkinsB. R.Validity and reliability consequences of confidence weighting. Educational and Psychological Measurement, 1973, 33, 135–141.
6.
JacobsS. S.Correlates of unwarranted confidence in response to objective test items. Journal of Educational Measurement, 1971, 8, 15–19.
7.
LordF.Formula scoring and number-right scoring. Journal of Educational Measurement, 1975, 12, 7–11.
8.
ShufordE. H.AlbertA.MassengillH. E.Admissible probability measurement procedures. Psychometrika, 1966, 31, 125–145.
