Linguistic competences of learners of Dutch as a second language at the B1 and B2 levels of speaking proficiency of the Common European Framework of Reference for Languages (CEFR) 1

Abstract

This study examines the associations between the speaking proficiency of 181 adult learners of Dutch as a second language and their linguistic competences. Performance in eight speaking tasks was rated on a scale of communicative adequacy. After extrapolation of these ratings to the Overall Oral Production scale of the Common European Framework of Reference for Languages (CEFR) (Council of Europe, 2001), 80 and 30 participants (on average per speaking task) were found to be, respectively, at the B1 and B2 levels of this scale. The following linguistic competences were tapped with non-communicative tasks: productive vocabulary knowledge, productive knowledge of grammar, speed of lexical retrieval, speed of articulation, speed of sentence building, and pronunciation skills. Discriminant analyses showed that all linguistic competences, except speed of articulation, discriminated participants at the two levels of oral production. Subsequent comparisons showed that the distance between B1ers and B2ers was smaller in knowledge of high-frequency words than in knowledge of medium- and low-frequency words. Extrapolation from scores on the vocabulary test yielded estimations of productive vocabularies of, on average, 4000 and 7000 words for B1ers and B2ers, respectively. The grammar test assessed grammatical knowledge in 10 domains. B2ers were found to outperform B1ers on all parts of the test. Thus, the differences in lexical and grammatical knowledge of B1ers and B2ers appear to be a matter of degree, rather than a matter of category or domain. The paper ends with a research agenda for a linguistic underpinning of the CEFR.

Keywords

CEFR grammar levels of proficiency linguistic competence vocabulary

Get full access to this article

View all access options for this article.

References

Alderson

J. C.

(2005). Diagnosing foreign language proficiency. London: Continuum.

Alderson

J. C.

(2007). The CEFR and the need for more research. The Modern Language Journal, 91, 659–663.

Alderson

J. C.

Clapham

Wall

(1995). Language test construction and evaluation. Cambridge: Cambridge University Press.

Alderson

J. C.

Figueras

Kuijpers

Nold

Takala

Tardieu

(2006). Analysing Tests of Reading and Listening in relation to the CEFR: The experience of the Dutch CEFR Construct Project. Language Assessment Quarterly, 3, 3–30.

Bachman

L. F.

Palmer

A. S.

(1982). Convergent and discriminant validation of oral language proficiency tests. TESOL Quarterly, 16, 449–465.

Bartning

Martin

Vedder

(Eds.). (2010). Communicative proficiency and linguistic development: Intersections between SLA and language testing research. Eurosla Monograph Series, 1. Retrieved from http://eurosla.org/monographs/EM01/EM01home.html.

Boers

Olijkhoek

Van der Voort

Heijne

Hidma

(2004). Code 1. Basisleergang Nederlands voor anderstaligen. Utrecht/Zutphen, Netherlands: ThiemeMeulenhoff.

Boersma

Weenink

(2005). PRAAT. Retrieved from http://www.praat.org.

Bossers

(2010). Woordenschat (Vocabulary). In Bossers

Kuiken

Vermeer

(Eds.), Handboek Nederlands als tweede taal in het volwassenenonderwijs. (Handbook Dutch as a second language in adult education) (pp. 166–207). Bussum, Netherlands: Coutinho.

10.

Cohen

(1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum.

11.

Coste

Courtillon

Ferenczi

Martins-Baltar

Papo

(1987). Un niveau seuil. Paris: Didier.

12.

Council of Europe (2001). Common European Framework of Reference for Languages: Learning, teaching, assessment. Cambridge: Cambridge University Press.

13.

Council of Europe (2003). Relating Language Examinations to the Common European Framework of Reference for Languages: Learning, teaching, assessment. Pilot version. Strasbourg: Council of Europe.

14.

Council of Europe (2009). Relating Language Examinations to the Common European Framework of Reference for Languages: Learning, teaching, assessment. Final version. Strasbourg: Council of Europe.

15.

Dávid

(2007). Investigating the performance of alternative types of grammar items. Language Testing, 24, 65–97.

16.

Davidson

Fulcher

(2007). The Common European Framework of Reference (CEFR) and the design of language tests: A matter of effect. Language Teaching, 40, 231–241.

17.

De Jong

N. H.

Steinel

M. P.

Florijn

Schoonen

Hulstijn

J. H.

(forthcoming, 2011).The effect of task complexity on native and non-native speakers’ functional adequacy, aspects of fluency, and lexical diversity. In Housen

Kuiken

Vedder

(Eds.), Dimensions of L2 performance and proficiency investigating complexity, accuracy and fluency in SLA. Amsterdam, Netherlands: Benjamins.

18.

De Jong

N. H.

Steinel

M. P.

Florijn

Schoonen

Hulstijn

J. H.

(forthcoming, 2012). Facets of speaking proficiency. Studies in Second Language Acquisition.

19.

Decoo

(2011). Systemization in foreign language teaching: monitoring content progression. New York, NY: Routledge.

20.

Engelen

R. J. H.

Eggen

T. J. H. M.

(1993). Equivaleren. In Eggen

T. J. H. M.

Sanders

P. F.

(Eds.), Psychometrie in de praktijk (pp. 309–348). Arnhem: Cito Instituut voor Toetsontwikkeling.

21.

Fouly

K. A.

Bachman

L. F.

Cziko

G. A.

(1990). The divisibility of language competence: A confirmatory approach. Language Learning, 40, 1–21.

22.

Figueras

North

Takala

Verhelst

Van Avermaet

(2005). Relating Examinations to the Common European Framework: A Manual. Language Testing, 22, 261–279.

23.

Harley

Cummins

Swain

Allen

(1990). The nature of language proficiency. In Harley

Allen

Cummins

Swain

(Eds.), The development of second language proficiency (pp. 7–25). Cambridge: Cambridge University Press.

24.

Hulstijn

J. H.

(2007). The shaky ground beneath the CEFR: Quantitative and qualitative dimensions of language proficiency. The Modern Language Journal, 91, 663–667.

25.

Hulstijn

J. H.

(2011). Language proficiency in native and nonnative speakers: An agenda for research and suggestions for second-language assessment. Language Assessment Quarterly, 8(3), 229–249.

26.

Hulstijn

J. H.

Alderson

J. C.

Schoonen

(2010). Developmental stages in second-language acquisition and levels of second-language proficiency: Are there links between them? In Bartning

Martin

Vedder

(Eds.), Communicative proficiency and linguistic development: Intersections between SLA and language testing research (pp. 11–20). Eurosla Monographs Series, 1. Retrieved from http://eurosla.org/monographs/EM01/EM01home.html.

27.

Jones

Saville

(2009). European language policy: Assessment, learning, and the CEFR. Annual Review of Applied Linguistics, 29, 51–63.

28.

Laufer

Nation

(1999). A vocabulary-size test of controlled productive ability. Language Testing, 16, 33–51.

29.

Milton

(2009). Measuring second language vocabulary acquisition. Bristol, UK: Multilingual Matters.

30.

Milton

(2010). The development of vocabulary breadth across the CEFR levels. In Bartning

Martin

Vedder

(Eds.), Communicative proficiency and linguistic development: Intersections between SLA and language testing research (pp. 211–232). Eurosla Monographs Series, 1. Retrieved from http://eurosla.org/monographs/EM01/EM01home.html.

31.

Milton

Alexiou

(2009). Vocabulary size and the Common European Framework of Reference for Languages. In Richards

Daller

H. M.

Malvern

D. D.

Meara

Milton

Treffers-Daller

(Eds.), Vocabulary studies in first and second language acquisition (pp. 194–211). Basingstoke, UK: Palgrave.

32.

Nation

I. S. P.

(2001). Learning vocabulary in another language. Cambridge, UK: Cambridge University Press.

33.

Nederlandse

Taalunie

(2006). Gemeenschappelijk Europees referentiekader voor moderne vreemde talen: Leren, onderwijs, beoordelen. [No place.] Nederlandse Taalunie, Council of Europe.

34.

Nederlandse Taalunie (2004). Corpus of spoken Dutch. Retrieved from http://lands.let.ru.nl/cgn/ehome.htm.

35.

Read

(2000). Assessing vocabulary. Cambridge, UK: Cambridge University Press.

36.

Shiotsu

Weir

(2007). The relative significance of syntactic knowledge and vocabulary breadth in the prediction of reading comprehension test performance. Language Testing, 24, 99–128.

37.

Stæhr

L. S.

(2008). Vocabulary size and the skills of listening, reading and writing. Language Learning Journal, 36(2), 139–152.

38.

Tannenbaum

R. J.

Wylie

E. C.

(2005). Mapping English language proficiency test scores onto the Common European Framework. Research Report 80. Princeton, NJ: Educational Testing Services.

39.

Van Ek

J. A.

Trim

J. L. M.

(1991). Threshold 1990. Strasbourg: Council of Europe.

40.

Weir

C. J.

(2005). Language testing and validation: An evidence-based approach. Basingstoke, UK: Palgrave Macmillan.