In second language (L2) vocabulary studies there is continuing interest in tests of depth of vocabulary knowledge, measuring various aspects of word knowledge other than just the form–meaning link that is the focus of breadth (or size) tests. This study aimed to explore new formats that could be used as diagnostic tools for assessing depth of academic vocabulary knowledge. The participants were 222 first-year students taking a programme of English for academic purposes (EAP) at a university in Vietnam. The depth measure was a newly developed test of a sample of words from Gardner and Davies’ Academic Vocabulary List, including sub-tests on receptive knowledge of synonyms, collocations and word parts. The participants also took the Updated Vocabulary Levels Test as a breadth measure, as well as a translation test. Results showed that most of the students had a relatively limited knowledge of general English vocabulary. There was a moderate correlation between the breadth and depth tests. The students had the best knowledge of synonyms, followed by word parts and then collocations. The collocation and word parts sub-tests included a Not Sure option to discourage blind guessing, and analyses of responses to this option offered useful insights into the students’ test-taking behaviour.
AkbarianI. (2010). The relationship between size and depth for ESP/EAP learners. System, 38, 391–401.
2.
AldersonJ.C. (2005). Diagnosing foreign language proficiency. Continuum.
3.
AndersonR.C.FreebodyP. (1981). Vocabulary knowledge. In GuthrieJ.T. (Ed.), Comprehension and teaching: Research reviews (pp. 77–177). International Reading Association.
4.
BeglarD. (2010). A Rasch-based validation of the Vocabulary Size Test. Language Testing, 27, 101–118.
5.
BrownJ.D.HudsonT. (2002). Criterion-referenced language testing. Cambridge University Press.
6.
ChapelleC.A. (2012). Conceptions of validity. In FulcherG.DavidsonF. (Eds.), The Routledge handbook of language testing (pp. 21–33). Routledge.
7.
ChuiA.S.Y. (2006). A study of the English vocabulary knowledge of university students in Hong Kong. Asian Journal of English Language Teaching, 16, 1–23.
8.
CoxheadA. (2018). Vocabulary and English for Specific Purposes research: Quantitative and qualitative perspectives. Routledge.
9.
DangT.N.Y. (2018). The nature of vocabulary in academic speech of hard and soft sciences. English for Specific Purposes, 51, 69–83.
10.
DangT.N.Y. (2020). High-frequency words in academic spoken English: Corpora and learners. ELT Journal, 74, 146–155.
11.
DangT.N.Y.WebbS. (2020). Vocabulary instruction and the good language teachers. In GriffithsC.TajeddinZ.BrownA. (Eds.), Lessons from good language teachers (pp. 203–218). Cambridge University Press.
12.
ElgortI. (2013). Effects of L1 definitions and cognate status of test items on the Vocabulary Size Test. Language Testing, 30, 253–272.
13.
EyckmansJ. (2009). Towards an assessment of learners’ receptive and productive syntagmatic knowledge. In BarfieldA.GyllstadH. (Eds.), Researching collocations in another language: Multiple interpretations (pp. 153–170). Palgrave Macmillan.
14.
GardnerD.DaviesM. (2014). A new Academic Vocabulary List. Applied Linguistics, 35, 305–327.
15.
González-FernándezB.SchmittN. (2019). Word knowledge: Exploring the relationships and order of acquisition of vocabulary knowledge components. Applied Linguistics, 41, 481–505.
16.
GyllstadH. (2009). Designing and evaluating tests of receptive collocation knowledge: COLLEX and COLLMATCH. In BarfieldA.GyllstadH. (Eds.), Researching collocations in another language: Multiple interpretations (pp. 139–152). Palgrave Macmillan.
17.
HylandK.ShawP. (2016). Introduction. In HylandK.ShawP. (Eds.), The Routledge handbook of English for Academic Purposes (pp. 1–13). Routledge.
18.
HylandK.TseP. (2007). Is there an ‘academic vocabulary’?TESOL Quarterly, 41, 235–253.
19.
IshiiT.SchmittN. (2009). Developing an integrated diagnostic test of vocabulary size and depth. RELC Journal, 40, 5–22.
20.
LauferB.WaldmanT. (2011). Verb–noun collocations in second language writing: A corpus analysis of learners’ English. Language Learning, 61, 647–672.
21.
McLeanS. (2021). The coverage comprehension model, its importance to pedagogy and research, and threats to the validity with which it is operationalized. Reading in a Foreign Language, 33, 126–140.
22.
McLeanS.StewartJ.BattyA.O. (2020). Predicting L2 reading proficiency with modalities of vocabulary knowledge: A bootstrapping approach. Language Testing, 37, 389–411.
23.
McLeanS.StoeckelT. (2021). Lexical mastery thresholds and lexical units: A reply to Laufer. Reading in a Foreign Language, 33, 247–259.
24.
MearaP. (1997). Towards a new approach in modelling vocabulary learning. In SchmittN.McCarthyM. (Eds.), Vocabulary: Description, acquisition and pedagogy (pp. 109–121). Cambridge University Press.
25.
MearaP. (2009). Connected words: Word associations and second language vocabulary acquisition. John Benjamins.
26.
MiltonJ. (2009). Measuring second language vocabulary acquisition. Multilingual Matters.
27.
MiltonJ. (2013). Measuring the contribution of vocabulary knowledge to proficiency in the four skills. In BardelC.LindquistC.LauferB. (Eds.), L2 vocabulary acquisition, knowledge and use (pp. 57–78). EUROSLA Monograph Series 2. European Second Language Association.
28.
NationI.S.P. (1983). Testing and teaching vocabulary. Guidelines, 5, 12–25.
29.
NationI.S.P. (2006). How large a vocabulary is needed for reading and listening?Canadian Modern Language Review, 63, 59–82.
NationI.S.P.CoxheadA. (2021). Measuring native-speaker vocabulary size. John Benjamins.
34.
NguyenL.T.C.NationP. (2011). A bilingual vocabulary size test of English for Vietnamese learners. RELC Journal, 42, 86–99.
35.
NguyenT.M.H.WebbS. (2017). Examining second language receptive knowledge of collocation and factors that affect learning. Language Teaching Research, 21, 298–320.
36.
PearsonP.D.HiebertE.H.KamilM. (2017). Vocabulary assessment: What we know and what we need to learn. Reading Research Quarterly, 42, 282–296.
37.
PecorariD.ShawP.MalmströmH. (2019). Developing a new academic vocabulary test. Journal of English for Academic Purposes, 39, 59–71.
38.
QianD.D. (1999). Assessing the roles of depth and breadth of vocabulary knowledge in reading comprehension. Canadian Modern Language Review, 56, 282–308.
39.
ReadJ. (1988). Measuring the vocabulary knowledge of second language learners. RELC Journal, 19, 12–25.
40.
ReadJ. (1993). The development of a new measure of L2 vocabulary knowledge. Language Testing, 10, 355–371.
41.
ReadJ. (1998). Validating a test to measure depth of vocabulary knowledge. In KunnanA. (Ed.), Validation in language assessment (pp. 41–60). Erlbaum.
42.
ReadJ. (2004). Plumbing the depths: How should the construct of vocabulary knowledge be defined? In BogaardsP.LauferB. (Eds.), Vocabulary in a second language: Selection, acquisition and testing (pp. 209–227). Benjamins.
43.
ReadJ. (2013). Reflecting on the validity of vocabulary assessments. Paper presented at the Vocab@Vic Conference, December2013, Victoria University of Wellington.
44.
SasaoY.WebbS. (2017). The Word Part Levels Test. Language Teaching Research, 21, 12–30.
45.
SchmittN. (1998). Tracking the incidental acquisition of second language vocabulary: A longitudinal study. Language Learning, 48, 281–317.
46.
SchmittN. (2014). Size and depth of vocabulary knowledge: What the research shows. Language Learning, 64, 913–951.
47.
SchmittN.SchmittD. (2014). A reassessment of frequency and vocabulary size in L2 vocabulary teaching. Language Teaching, 47, 484–503.
48.
SchmittN.ZimmermanC.B. (2002). Derivative word forms: What do learners know?TESOL Quarterly, 36, 145–171.
49.
SchmittN.SchmittD.ClaphamC. (2001). Developing and exploring the behaviour of two new versions of the Vocabulary Levels Test. Language Testing, 18, 55–88.
50.
SchmittN.NationP.KremmelB. (2020). Moving the field of vocabulary assessment forward: The need for more rigorous test development and validation. Language Teaching, 53, 109–120.
51.
StoeckelT.BennettP.McLeanS. (2016). Is ‘I don’t know’ a viable answer choice on the Vocabulary Size Test?TESOL Quarterly, 50, 965–975.
52.
StoeckelT.McLeanS.NationP. (2021). Limitations of size and levels tests of written receptive vocabulary knowledge. Studies in Second Language Acquisition, 43, 181–203.
53.
SunY.DangT.N.Y. (2020). Vocabulary in high-school EFL textbooks: Texts and learner knowledge. System, 93, 102279.
54.
VerhallenM.SchoonenR. (1993). Word definitions of monolingual and bilingual children. Applied Linguistics, 14, 344–365.
55.
WebbS. (2005). Receptive and productive vocabulary learning: The effects of reading and writing on word knowledge. Studies in Second Language Acquisition, 27, 33–52.
56.
WebbS. (2007). The effects of repetition on vocabulary knowledge. Applied Linguistics, 28, 46–65.
57.
WebbS.SasaoY.BallanceO. (2017). The updated Vocabulary Levels Test: Developing and validating two new forms of the VLT. ITL – International Journal of Applied Linguistics, 168, 34–70.
58.
WescheM.B.ParibakhtT.S. (1996). Assessing second language vocabulary knowledge: Depth vs. breadth. Canadian Modern Language Review, 53, 13–39.
59.
XingP.FulcherG. (2007). Reliability assessment for two versions of Vocabulary Levels Tests. System, 35, 182–191.
60.
ZhangD.KodaK. (2017). Assessing L2 vocabulary depth with word associates format tests: Issues, findings, and suggestions. Asian-Pacific Journal of Second and Foreign Language Education, 2, 1.
61.
ZhangD.YangX. (2016). Chinese L2 learners’ depth of vocabulary knowledge and its role in reading comprehension. Foreign Language Annals, 49, 699–715.
62.
ZhangS.ZhangX. (2020). The relationship between vocabulary knowledge and L2 reading/listening comprehension. Language Teaching Research, 26, 696–725.
63.
ZhaoP.JiX. (2016). Validation of the Mandarin version of the Vocabulary Size Test. RELC Journal, 49, 308–321.
