A comparison of recall and summary protocols as measures of second language reading comprehension

Abstract

The purpose of this study was to examine the effect of test method on the reading performance of two levels of early-stage L2 readers of French. L2 reading research examining test methods has focused primarily on discrete- point modes of response. This study compared two global response modes, the summary and the recall protocol. Half of the 80 subjects were asked to read a passage and to write a summary of the passage and the other half were asked to read the passage and to recall it. The written protocols were analysed for total number of idea units as well as the number of main ideas, supporting ideas and details. The total number of idea units was submitted to a two-way analysis of variance. The three levels of idea units were submitted to separate two-way analyses of variance. Results indicate a significant qualitative difference in the performance on the two tasks. The summaries contained significantly more main ideas than the recall protocols. Fur thermore, the summaries contained a higher percentage of main ideas than details whereas the recall protocols contained a higher percentage of details than main ideas. The results have research and pedagogical implications.

Get full access to this article

View all access options for this article.

References

Barnett, M.A. 1986: Syntactic and lexical/semantic skill in foreign language reading: importance and interaction. Modern Language Journal 70, 343-49.

Bernhardt, E.B. 1983a: Syntactic and lexical/semantic skill in foreign language reading comprehension: the immediate recall protocol. Die Unterrichtspraxis 16, 27-33.

— 1983b: Three approaches to reading comprehension in intermediate German. Modern Language Journal 67, 111-15.

— 1991: Reading development in a second language. Norwood, NJ: Ablex.

Carrell, P.L. 1983: Three components of background knowledge in reading comprehension . Language Learning 33, 183-207.

— 1984a: The effects of rhetorical organization on ESL readers . TESOL Quarterly 19, 441-69.

— 1984b: Evidence of a formal schema in second language comprehension . Language Learning 34, 87-112.

— 1985: Facilitating ESL reading by teaching text structure. TESOL Quarterly 19, 727-52.

— 1987: Content and formal schemata in ESL reading. TESOL Quarterly 21, 461-81.

10.

Cohen, A. 1993: The role of instructions in testing summarizing ability . In Douglas, D. and Chapelle, C. , editors, A new decade of language testing: collaboration and cooperation, Alexandria, VA : TESOL, 132-59.

11.

van Dijk, T.A. and Kintsch, W. 1978: Cognitive psychology and discourse: recalling and summarizing stories. In Dressler, W.U. , editor, Current trends in linguistics, New York: de Gruyter, 61-68.

12.

Flick, W.C. and Anderson, J.I. 1980: Rhetorical difficulty in scientific English: a study in reading comprehension. TESOL Quarterly 14, 345-51.

13.

Kozminsky, E. and Graetz, N. 1986: First vs. second language comprehension: some evidence from text summarizing. Journal of Research in Reading 9, 3-21.

14.

Lee, J.F. 1986a: On the use of the recall task to measure L2 reading comprehension . Studies in Second Language Acquisition 8, 201-12.

15.

— 1986b: Background knowledge and L2 reading. Modern Language Journal 70, 350-54.

16.

— 1987: Comprehending the Spanish subjunctive: an information processing perspective. Modern Language Journal 71, 50-57.

17.

— 1990: Constructive processes evidenced by early stage non-native readers of Spanish in comprehending an expository test. Hispanic Linguistics 4, 129-48.

18.

Lee, J.F. and Ballman, T.L. 1987: Learners' ability to recall and rate important ideas of an expository text. In VanPatten, B. , Dvorack, T.R. and Lee, J.F. , editors, Foreign language learning: a research perspective , Rowley, MA: Newbury House, 108-17.

19.

Lee, J.F. and Riley, G.L. 1990: The effect of prereading, rhetorically-oriented frameworks on the recall of two structurally different expository texts. Studies in Second Language Acquisition 11, 25-41.

20.

Meyer, B.J.F. 1975: Identification of the structure of prose and its implications for the study of reading and memory. Journal of Reading Behavior 7, 7-47.

21.

— 1979: Organizational patterns in prose and their use in reading . In Kamil, M. and Moe, A.J. , editors, Reading research: Studies and applications , Norwood, NJ: Ablex, 109-17.

22.

Meyer, B.J.F. , Brandt, D.M. and Bluth, G. 1980: Use of top-level structure in a text: key for reading comprehension of ninth-grade students. Reading Research Quarterly 16, 72-103.

23.

Meyer, B.J.F. and Freedle, R.O. 1984: Effects of discourse type on recall. American Educational Research Journal 64, 121-43.

24.

Mohammed, M.A. and Swales, J.M. 1984: Factors affecting the successful reading of technical instructions. Reading in a Foreign Language 2, 206-17.

25.

Muyskens, J. , Omaggio, A. and Chalmers, C. 1986: Rendez-vous: an invitation to French New York: Random House.

26.

Raymond, P.M. 1993: The effects of structure strategy training on the recall of expository prose for university students reading French as a second language . Modern Language Journal 77, 445-58.

27.

Savignon, S. 1983: Communicative competence: theory and classroom practice . Reading, MA: Addison-Wesley.

28.

Shohamy, E. 1984: Does the testing method make a difference? The case of reading comprehension. Language Testing 1, 147-70.

29.

Wolf, D. 1993: A comparison of assessment tasks used to measure FL reading comprehension. Modern Language Journal 77, 473-89.