Sage Journals: Discover world-class research

Abstract

Two studies investigated technical aspects of a computer-mediated test, the Computerized Oral proficiency Instrument (COPI), particularly in contrast to a similar tape-mediated test, the Simulated Oral proficiency Interview (SOPI). The first study investigated how examinees used self-assessment to choose an appropriate starting level on the COPI. The second study looked at examinees’ planning and response time on the COPI, and the factors that affected their use of time. Fifty-five university students took the COPI and SOPI in one of three languages: Arabic, Chinese, or Spanish. Results show that the majority of examinees (92%) were able to use the self-assessment instrument to select test tasks at appropriate difficulty levels. However, the COPI starting level (which was based on examinees’ self-assessment) might have been problematic for a small proportion (8%) of the examinees who appeared to choose tasks that were too difficult for them. As for planning and response time on the COPI, different amounts of time were used across four main levels of proficiency. Examinees with the highest proficiency levels tended to use less planning time but gave longer responses.

Get full access to this article

View all access options for this article.

References

Adair-Hauck, B. and Pierce, M. 1998: Investigating the Simulated Oral proficiency Interview (SOPI) as an assessment for second language oral proficiency . Pennsylvania Language Forum, 6-25 .

Bachman, L. and Palmer, A. 1996: Language testing in practice. Oxford: Oxford University Press .

Clark, J. L. D. 1988: Validation of a tape-mediated ACTFL/ILR-scale based test of Chinese speaking proficiency . Language Testing 5, 197-205 .

Crookes, G. 1989: Planning in interlanguage variation . Studies in Second Language Acquisition 11, 367-383 .

Chalhoub-Deville, M. 2001: Task-based assessments: characteristics and validity evidence. In Bygate, M. , Skehan, P. and Swain, M. , editors, Researching pedagogic tasks. London: Longman .

Ellis, R. 1987: Interlanguage variability in narrative discourse: style shifting in the use of the past tense . Studies in Second Language Acquisition 9, 12-20 .

Foster, P. and Skehan, P. 1996: The influence of planning on performance in task-based learning . Studies in Second Language Acquisition 18, 299-324 .

Kenyon, D. M. 1996: Self-assessment and speaking tasks: research and application . Workshop, November 1996. Annual Meeting of the American Council on the Teaching of Foreign Languages, Philadelphia, PA.

Kenyon, D. M. 1998: An investigation of the validity of task demands on performance-based tests of oral proficiency. In Kunnan, A. J. , editor, Validation in language assessment. Mahwah, NJ: Lawrence Erlbaum Associates .

10.

Kenyon, D. M. and Malabonga, V. M. 2001: Comparing examinees’ attitudes toward a computerized oral proficiency assessment . Language Learning and Technology 5, 60-83 . Available at http://llt.msu.edu/vol5num2/kenyon/default.html (August 2004).

11.

Kuo, J. and Jiang, X. 1997: Assessing the assessments: the OPI and the SOPI . Foreign Language Annals 30, 503-512 .

12.

Mehnert, U. 1998: The effects of different lengths of time for planning on second language performance . Studies in Second Language Acquisition 20, 83-108 .

13.

Oldfield, K. A. and Macalpine, M. K. 1995: Peer and self assessment at tertiary level: an experiential report . Assessment and Evaluation in Higher Education 20, 125-132 .

14.

Ortega, L. 1999: Planning and focus on form in L2 oral performance . Studies in Second Language Acquisition 21, 109-148 .

15.

Robinson, P. 2001: Task complexity, cognitive resources, and syllabus design: a triadic framework for examining task influences on SLA. In Robinson, P. , editor, Cognition and second language instruction. Cambridge: Cambridge University Press .

16.

Ross, S. 1998: Self-assessment in second language testing: a meta-analysis and analysis of experiential factors . Language Testing 15, 1-20 .

17.

Schumann, J. H. 1997. The neurobiology of affect in language. Malden, MA: Blackwell .

18.

Skehan, P. 1998: A cognitive approach to language learning. Oxford: Oxford University Press .

19.

Skehan, P. 2001: Task and language performance assessment. In Bygate, M. , Skehan, P. and Swain, M. , editors, Researching pedagogic tasks. London: Longman .

20.

Skehan, P. and Foster, P. 2001: Cognition and tasks. In Robinson, P. , editor, Cognition and second language instruction. Cambridge: Cambridge University Press .

21.

Stansfield, C. W. 1990: An evaluation of simulated oral proficiency interviews as measures of oral proficiency. In Alatis, J. E. , editor, Georgetown University Roundtable on Languages and Linguistics 1990. Washington, DC: Georgetown University Press , 228-234.

22.

Stansfield, C. W. 1996: SOPI test development handbook. Washington, DC: Center for Applied Linguistics .

23.

Stansfield, C. W. , and Kenyon, D. M. 1991: Development of the Texas Oral proficiency Test (TOPT). Final Report. Washington, DC: Center for Applied Linguistics . ERIC Document Reproduction Service No. ED 332-522.

24.

Stansfield, C. W. , and Kenyon, D. M. 1996: Simulated oral proficiency interviews: an update. ERIC Digest No. EDO-FL-96-06.

25.

Stansfield, C. W. , Kenyon, D. M. , Paiva, R. , Doyle, F. , Ulsh, I. and Cowles, M. A. 1990: The development and validation of the Portuguese speaking test . Hispania 72, 641-651 .

26.

Stefani, L. A. J. 1994: Peer, self and tutor assessment: relative reliabilities . Studies in Higher Education 19, 69-75 .

27.

Sullivan, K. and Hall, C. 1997: Introducing students to self-assessment . Assessment and Evaluation in Higher Education 22, 289-305 .

28.

Swender, E. , editor 1999: ACTFL oral proficiency interview tester training manual. Yonkers, NY: American Council on the Teaching of Foreign Languages .

29.

TestDaF-Institut 2002: The TestDaF: a new measure of German language proficiency. Brochure. Hagen, Germany: Test-DaF-Institut .

30.

TestDaF (n.d.): Der TestDaF. Available at http://www.testdaf.de (August 2004).

31.

Test of English as a Foreign Language (TOEFL) 2004: About the Test of Spoken English. Available at http://www.toefl.org/tse/tseindx.html (August 2004).

32.

Wigglesworth, G. 1997: An investigation of planning time and proficiency level on oral test discourse . Language Testing 14, 85-106 .

33.

Wigglesworth, G. 2001: influences on performance in task-based oral assessments. In Bygate, M. , Skehan, P. and Swain, M. , editors, Researching pedagogic tasks. London: Pearson Education Limited .

34.

Williams, E. 1992: Student attitudes towards approaches to learning and assessment . Assessment and Evaluation in Higher Education 17, 45-58 .

Self-assessment,preparation and response time on a computerized oral proficiency test

Abstract

Get full access to this article

References