Knowing when one has understood is an important metacognitive skill in reading and in making use of what one has read. It is defined here as the ability to detect failures of comprehension processing. This is measured operationally, using a signal detection model, as the extent to which a respondent's judgments of confidence discriminate between accurate and inaccurate responses on cloze tests. The reliability of the measure is investigated and, as an illustration, it is applied to reading in native and second languages. It is concluded that this new augmented form of cloze testing may be a useful tool in reading research.
References
1.
Hosseini-ArdehaliJ.1981. Detectability of Correctness: A Signal Detection Measure of Knowing that One Knows, Tucson, AZ: The University of Arizona. Unpublished: doctoral dissertation
2.
BamberD.The area above the ordinal dominance graph and the area below the receiver operating characteristic graph. Journal of Mathematical Psychology, 1975, 12, 387–415.
3.
BrownA.Metacognitive development and reading, in SpiroR. J.BruceB.BrewerW. F. (Eds.). Theoretical Issues in Reading Comprehension.Hillsdale, NJ: Earlbaum Associates, 1981, 453–481.
4.
CarrollJ. B.CartonA. S.WildeC. P.An Investigation of Cloze Items in the Measurement of Achievement in Foreign Languages.Cambridge, MA: Laboratory for Research in Instruction, Graduate School of Education, Harvard University, 1959.
5.
FlavellJ. H.Cognitive monitoring, in DicksonW. P. (Ed.). Children's Oral Communication Skills.New York: Academic Press, 1981.
6.
FroeseV.Cloze readability versus the Dale-Chall formula. Proceedings of the International Reading Association, Atlantic City, New Jersey, April, 1971.
7.
JonosmaE.The Cloze Procedure: A Survey of Research. Bloomington, IN: Indiana University, no date.
8.
MckennaM. C.RobinsonR. D.An Introduction to the Cloze Procedure.Newark, DE: International Reading Association, 1980.
9.
McnicolD.A Primer of Signal Detection Theory. London: George Allen and Unwin, 1972.
10.
PastureR. E.ScheirerC. J.Signal detection theory: considerations for general application. Psychological Bulletin, 1974, 81, 945–958.
11.
PollackI.HsiehR.Sampling variability of the area under the ROC curve and d'e. Psychological Bulletin, 1969, 71, 161–438.
12.
TaylorW. L.Cloze procedure: a new tool for measuring readability. Journalism Quarterly, 1953, 30, 415–438.