Over the past decade, listening comprehension tests have been converting to computer-based tests that include visual input. However, little research is available to suggest how test takers engage with different types of visuals on such tests. The present study compared a series of still images to video in academic computer-based tests to determine how test takers engage with these two test modes. The study, which employed observations, retrospective reports and interviews, used data from university-level non-native speakers of English. The findings suggest that test takers engage differently with these two modes of delivery. Specifically, while test takers engaged minimally and similarly with the still images, there was wide variation in the ways and degree to which they engaged with the video stimulus. Implications of the study are that computer-based tests of listening comprehension could include still images with only minimally altering the construct that is measured by audio-only listening tests, but the utilization of video in such computer-based tests may require a rethinking of the listening construct.
Get full access to this article
View all access options for this article.
References
1.
Bachman L.F. and Palmer, A.S.1996: Language testing in practice. Oxford : Oxford University Press.
2.
Blau, E.1991: More on comprehensible input: The effect of pauses and hesitation markers on listening comprehension, ERIC DOC. NO. ED340 234.
3.
Buck, G.1991: The testing of listening comprehension: An introspective study. Language Testing8: 67—91.
4.
——— 2001: Assessing listening. Cambridge: Cambridge University Press.
5.
Chaudron, C. and Richards, J.1986: The effects of discourse markers on the comprehension of lectures. Applied Linguistics7: 113—27.
6.
Choi, I-C., Kim, K. and Boo, J.2003: Comparability of a paper-based language test and a computer-based language test. Language Testing20: 295—320.
7.
Chung, U.K.1994: The effect of audio, a single picture, multiple pictures, or video on second language listening comprehension. Unpublished doctoral dissertation, University of Illinois at Urbana-Champaign .
8.
Coniam, D.2000: The use of audio or video comprehension as an assessment instrument in the certification of English language teachers: A case study . System29: 1—14.
9.
Dodd, B. and Campbell, R.1987: Hearing by eye: The psychology of lip-reading. London: Lawrence Erlbaum.
10.
Dunkel, P. and Davis, A.1994: The effects of rhetorical signaling cues on the recall of English lecture information by speakers of English as a second or native language. In Flowerdew, J., editor, Academic Listening: Research Perspectives, Cambridge: Cambridge University Press, 55—74.
11.
Eisenstein, M. and Berkowitz, D.1981: The effect of phonological variation on adult learner comprehension. Studies in Second Language Acquisition4: 75—80.
12.
Ericsson, K. and Simon, H.1993: Protocol analysis. Cambridge, MA: MIT Press.
13.
Ets n.d.: Retrieved 18 October 2006, from http://www.ets.org.
14.
Flowerdew, J.1994: Research of relevance to second language lecture comprehension — an overview. In Flowerdew, J., editor, Academic listening: research perspectives, Cambridge: Cambridge University Press, 7—29.
15.
Freedle, R. and Kostin, I.1999: Does the text matter in a multiple-choice test of comprehension? The case for the construct validity of TOEFL's minitalks. Language Testing16: 2—32.
16.
Ginther, A.2002: Context and content visuals and performance on listening comprehension stimuli. Language Testing19: 133—67.
17.
Green, A.1998: Studies in language testing 5: Verbal protocol analysis in language testing research (ed. M. Milanovic). Cambridge : Cambridge University Press.
18.
Griffiths, R.1992: Speech rate and listening comprehension: Further evidence of the relationship. TESOL Quarterly26: 385—91.
19.
Gruba, P.1989: A comparison study of audio and video presentation modes in tests of ESL listening comprehension. Unpublished MA thesis, University of California, Los Angeles.
20.
——— 1999: The role of digital video media in second language listening comprehension. Unpublished doctoral dissertation, University of Melbourne.
21.
Hadar, U.1989: Speech production: Role of head movements. Language and Communication9: 245—57.
22.
Hansen, C. and Jensen, C.1994: Evaluating lecture comprehension. In Flowerdew, J., editor, Academic listening: Research perspectives, Cambridge: Cambridge University Press, 241—68.
23.
Henricksen, L.1984: Sandhi variation: A filter of input for learners of ESL . Language Learning34: 103—26.
24.
Kasten, K.1995: The effect of mode of presentation in the testing of listening comprehension. Unpublished MA thesis, Hong Kong Polytechnic University.
25.
Kellerman, S.1992: I see what you mean: The role of kinesic behaviour in listening and implications for foreign and second language learning. Applied Linguistics13: 239—58.
26.
Kennedy, G.1978: The testing of listening comprehension. RELC monograph series. Singapore: Singapore University Press.
27.
Kintsch, W.1998: Comprehension. Cambridge: Cambridge University Press.
28.
Lado, R.1961: Language testing: The construction and use of foreign language tests. London: Longman .
29.
Lynch, T.1998: Theoretical perspectives on listening. Annual Review of Applied Linguistics18: 3—19.
30.
McGurk, H. and MacDonald. J.1976: Hearing lips and seeing voices. Nature264: 746—48.
31.
McNeill, D.1985: So you think gestures are non-verbal?Psychological Review92: 350—71.
32.
Riseborough, M.1981: Physiographic gestures as decoding facilitators: Three experiments exploring a neglected facet of communication. Journal of Non-Verbal Behavior5: 172—83.
33.
Scheflen, A.1964: The significance of posture in communication systems. Psychiatry27: 316—31.
34.
Stanley, J.1978: Teaching listening comprehension: An interim report on a project to use uncontrolled language data as a source material for training foreign students in listening comprehension. TESOL Quarterly12: 285—95.
35.
Sweller, J.1988: Cognitive load during problem solving: Effects on learning . Cognitive Science12: 257—85.
36.
Vandergrift, L.2003: Orchestrating strategy use: Toward a model of the skilled second language listener. Language Learning53: 463—96.
37.
Voss, B.1979: Hesitation phenomena as sources of perceptual errors for non-native speakers. Language and Speech22: 129—44.
38.
Wu, Y.1998: What do tests of listening comprehension test? A retrospection study of EFL test-takers performing a multiple-choice task. Language Testing15: 21—44.
