Think-Aloud Protocol Analysis: An Investigation of Reading Comprehension Strategies in Fourth-and Fifth-Grade Students

Abstract

School assessments too often ignore the process of individuals' cognitions. As part of a systematic effort to develop an assessment procedure focused on the tactics used to facilitate reading comprehension, this research investigated Lytle's (1985) approach to think-aloud protocol analysis. Data are presented for fourth- and fifth-graders that show the degree to which they used reasoning, elaboration, signaling understanding, analysis, judging, and monitoring doubts while they were reading three fictional passages. The percentage of each move used by individual subjects was stable across the three stories that were administered. Significant correlations were obtained between comprehension of the passage used to obtain the think-aloud protocols and two of the six categories of moves: Reasoning and Signaling Understanding. These students used Elaboration, Signaling Understanding, and Reasoning most frequently; they used Monitoring Doubts less frequently; and they rarely used Analysis and Judging. Unique contributions of this research include the extension of previous work with this method to elementary school students, demonstration of stability in the use of moves across the three stories, and detection of correlations between this system and comprehension of the passage used to obtain the think-aloud protocol. Suggestions are made for future research that concerns the validity of think-aloud protocol analysis as a diagnostic technique and an approach to facilitate comprehension skills.

Get full access to this article

View all access options for this article.

References

Afflerbach, P. , & Johnston, P. (1984). On the use of verbal reports in reading research. Journal of Reading Behavior, 16, 307-322.

Bach, R. (1970). Jonathan Livingston Seagull: A story. New York: Macmillan

Bereiter, C. & Bird, M. (1985). Use of thinking aloud in identification and teaching of reading comprehension strategies. Cognition and Instruction, 2, 131-156.

Brown, A. L. (1980). Metacognitive development and reading. In R. J. Spiro , B. Bruce , & W. F. Brewer (Eds.), Theoretical issues in reading comprehension (pp. 453-481). Hillsdale, NJ: Erlbaum.

Brown, A. L. , Palincsar, A. S. , & Armburster, B. B. (1984). In H. Mandl , N. L. Stein , & T. Trabasso (Eds.), Learning and comprehension of text (pp. 255-286). Hillsdale, NJ: Erlbaum.

Brueckner, L. J. (1930). Diagnostic and remedial teaching in arithmetic. Philadelphia: Winston.

Christopherson, S. L. , Shultz, C. , & Waern, Y. (1981). The effect of two contextual conditions on recall of a reading passage and on thought processes in reading. Journal of Reading, 24, 573-578.

Clemens, S. L. (1876/1967). The Adventures of Tom Sawyer (pp. 63-64). New York: Lancer Books.

Ericsson, S. A. , & Simon, H. A. (1980). Verbal reports on data. Psychological Review, 87, 215-251.

10.

Flavell, J. (1976). Metacognitive aspects of problem solving. In L. B. Resnick (Ed.), The nature of intelligence (pp. 231-253). Hillsdale, NJ: Erlbaum.

11.

Fry, E. (1977). Fry's readability graph: Clarification, validity, and extension to Level 17. Journal of Reading, 21, 242-252.

12.

Fuchs, L. S. , Fuchs, D. , & Maxwell, L. (1988). The validity of informal reading comprehension measures. Remedial and Special Education, 9, 20-28.

13.

Kruteskii, V. A. (1976). The psychology of mathematical abilities in school children. Chicago: University of Chicago Press. (Translated from 1968 publication).

14.

Lankford, F. G. (1974). What can a teacher learn about a pupil's thinking through oral interviews? Arithmetic Teacher, 21, 26-32.

15.

Lidz, C. (1987). Dynamic assessment: Foundations and fundamentals. New York: Guilford Press.

16.

Lytle, S. (1982). Exploring comprehension style: A study of twelfth-grade readers' transactions with text. Unpublished doctoral dissertation, University of Pennsylvania.

17.

Lytle, S. (1985). Comprehension styles of twelfth grade readers: What verbal protocols can (and can't) tell us. Paper presented at the annual meeting of the American Educational Research Association, Chicago.

18.

Meyers, J. (1985, August). Diagnosis diagnosed: Twenty years after. Address presented at the annual convention of the American Psychological Association, Los Angeles.

19.

Meyers, J. (1987). Training dynamic assessors. In C. Lidz (Ed.), Dynamic assessment: Foundations and fundamentals (pp. 403-425). New York: Guilford Press.

20.

Meyers, J. (1988). Diagnosis diagnosed: Twenty years after. Professional School Psychology, 3, 123-134.

21.

Meyers, J. , & Kundert, D. (1988). Implementing process assessment. In J. Graden , J. Zins , & M. Curtis (Eds.), Alternative approaches to the delivery of school psychological services (pp. 173-197). Washington: National Association of School Psychologists.

22.

Meyers, J. & Lytle, S. (1986). Assessing the process of learning. Exceptional Children, 53, 138-144.

23.

Meyers, J. , Pfeffer, J. , & Erlbaum, V. (1985). Process assessment: A model for broadening assessment. Journal of Special Education, 19, 74-89.

24.

Nisbett, R. E. , & Wilson, T. D. (1977). Telling more than we can know: Verbal reports on mental processes. Psychological Review, 84, 231-259.

25.

North, S. (1963). Rascal: A memoir of a better era. New York: Dutton.

26.

Olshavsky, J. (1976/77). Reading as problem solving: An investigation of strategies. Reading Research Quarterly, 12, 654-674.

27.

Pieper, E. (1983). A technique for discovering LD adolescents' strategies for solving multiplication facts. Pointer, 27, 40-41.

28.

Shinn, M. R. (1989). Curriculum-based measurement: Assessing special children. New York: Guilford Press.

29.

Smith, C. R. (1980). Assessment alternatives: Non-standardized procedures. School Psychology Review, 9, 46-57.

30.

Wolfensberger, W. (1965). Diagnosis diagnosed. Journal of Mental Subnormality, 11, 62-70.