Vocabulary’s relationship to reading proficiency is frequently cited as a justification for the assessment of L2 written receptive vocabulary knowledge. However, to date, there has been relatively little research regarding which modalities of vocabulary knowledge have the strongest correlations to reading proficiency, and observed differences have often been statistically non-significant. The present research employs a bootstrapping approach to reach a clearer understanding of relationships between various modalities of vocabulary knowledge to reading proficiency. Test-takers (N = 103) answered 1000 vocabulary test items spanning the third 1000 most frequent English words in the New General Service List corpus (Browne, Culligan, & Phillips, 2013). Items were answered under four modalities: Yes/No checklists, form recall, meaning recall, and meaning recognition. These pools of test items were then sampled with replacement to create 1000 simulated tests ranging in length from five to 200 items and the results were correlated to the Test of English for International Communication (TOEIC®) Reading scores. For all examined test lengths, meaning-recall vocabulary tests had the highest average correlations to reading proficiency, followed by form-recall vocabulary tests. The results indicated that tests of vocabulary recall are stronger predictors of reading proficiency than tests of vocabulary recognition, despite the theoretically closer relationship of vocabulary recognition to reading.
BeglarD.HuntA. (1999). Revising and validating the 2000 word level and university word level vocabulary tests. Language Testing, 16(2), 131–162. https://doi.org/10.1191/026553299666419728
ChengJ.MatthewsJ. (2018). The relationship between three measures of L2 vocabulary knowledge and L2 listening and reading. Language Testing, 35(1), 3–25. https://doi.org/10.1177/0265532216676851
4.
CoxheadA.NationP.SimD. (2015). Measuring the vocabulary size of native speakers of English in New Zealand secondary schools. New Zealand Journal of Educational Studies, 50(1), 121–135. https://doi.org/10.1007/s40841–015–0002–3
GlassG. V.HopkinsK. D. (1996). Statistical methods in education and psychology. Psyccritiques, 41(12), 1224. https://doi.org/10.1037/003310
9.
GoodwinL. D.LeechN. L. (2006). Understanding correlation: Factors that affect the size ofr. The Journal of Experimental Education, 74(3), 249–266. https://doi.org/10.3200/JEXE.74.3.249–266
10.
GyllstadH.VilkaitėL.SchmittN. (2015). Assessing vocabulary size through multiple-choice formats: Issues with guessing and sampling rates. ITL-International Journal of Applied Linguistics, 166(2), 278–306. https://doi.org/10.1075/itl.166.2.04gyl
11.
HackingJ. F.TschirnerE. (2017). The contribution of vocabulary knowledge to reading proficiency: The case of college Russian. Foreign Language Annals, 50(3), 500–518. https://doi.org/10.1111/flan.12282
HilkeR.AizawaT.MaedaH. (2018). TOEIC L&R tesuto chokuzen no gijutsu [Methods for shortly before the TOEIC L&R test]. Alc Press.
14.
HuibregtseI.AdmiraalW.MearaP. (2002). Scores on a yes-no vocabulary test: Correction for guessing and response style. Language Testing, 19(3), 227–245. https://doi.org/10.1191/0265532202lt229oa
15.
HunstonS.FrancisG.ManningE. (1997). Grammar and vocabulary: Showing the connections. ELT Journal, 51(3), 208–216. https://doi.org/10.1093/elt/51.3.208
16.
JeonE. H.YamashitaJ. (2014). L2 Reading comprehension and its correlates: A meta-analysis. Language Learning, 64(1), 160–212. https://doi.org/10.1111/lang.12034
17.
KremmelB.SchmittN. (2016). Interpreting vocabulary test scores: What do various item formats tell us about learners’ ability to employ words?Language Assessment Quarterly, 13(4), 377–392. https://doi.org/10.1080/15434303.2016.1237516
18.
LaFlairG. T.EgbertJ.PlonskyL. (2015). A practical guide to bootstrapping descriptive statistics, correlations, t tests, and ANOVAs. In PlonskyL. (Ed.), Advancing quantitative methods in second language research (pp. 46–77). Routledge.
19.
LanceC. E.ButtsM. M.MichelsL. C. (2006). The sources of four commonly reported cutoff criteria: What did they really say?Organizational Research Methods, 9(2), 202–220. https://doi.org/10.1177/1094428105284919
20.
Larson-HallJ.HerringtonR. (2010). Improving data analysis in second language acquisition by utilizing modern developments in applied statistics. Applied Linguistics, 31(3), 368–390. http://dx.doi.org/10.1093/applin/amp038
21.
LauferB. (1992). How much lexis is necessary for reading comprehension? In ArnaudP. J. L.BéjointH. (Eds.), Vocabulary and applied linguistics (pp. 126–132). https://doi.org/10.1007/978–1–349–12396–4_12
22.
LauferB.Aviad-LevitzkyT. (2017). What type of vocabulary knowledge predicts reading comprehension: Word meaning recall or word meaning recognition?The Modern Language Journal, 101(4), 729–741. https://doi.org/10.1111/modl.12431
LauferB.ParibakhtT. S. (1998). The relationship between passive and active vocabularies: Effects of language learning context. Language Learning, 48(3), 365–391. https://doi.org/10.1111/0023–8333.00046
26.
LockhartR. S. (1998). Introduction to statistics and data analysis: For the behavioral sciences. W.H. Freeman.
27.
McLeanS. (2017). Evidence for the adoption of the flemma as an appropriate word counting unit. Applied Linguistics, 39(6), 823–845. https://doi.org/10.1093/applin/amw050
MearaP. (1990). Some notes on the Eurocentres Vocabulary Tests. In TommolaJ. (Ed.), Foreign language comprehension and production (pp. 103–113). Turku: AFinLA Yearbook.
31.
MearaP. (1992). EFL vocabulary tests. ERIC Clearinghouse.
MochidaK.HarringtonM. (2006). The Yes/No test as a measure of receptive vocabulary knowledge. Language Testing, 23(1), 73–98. https://doi.org/10.1191/0265532206lt321oa
35.
NagyW. E.HermanP. A.AndersonR. C. (1985). Learning words from context. Reading Research Quarterly, 20(2), 233. https://doi.org/10.2307/747758
36.
NationI. S. P. (1990). Teaching and learning vocabulary. Heinle & Heinle.
37.
NationI. S. P. (2006). How large a vocabulary is needed for reading and listening?Canadian Modern Language Review/La Revue Canadienne Des Langues Vivantes, 63(1), 59–82. https://doi.org/10.3138/cmlr.63.1.59
NorrisJ. M. (2015). Statistical significance testing in second language research: Basic problems and suggestions for reform. Language Learning, 65(S1), 97–126. https://doi.org/10.1111/lang.12114
43.
NunnallyJ. C. (1978). Psychometric theory (2nd ed.). McGraw-Hill.
44.
PlonskyL. (2013). Study quality in SLA: An assessment of designs, analyses, and reporting practices in quantitative L2 research. Studies in Second Language Acquisition, 35(4), 655–687. https://doi.org/10.1017/S0272263113000399
45.
PlonskyL.OswaldF. L. (2014). How big is “big”? Interpreting effect sizes in L2 research. Language Learning, 64(4), 878–912. https://doi.org/10.1111/lang.12079
46.
QianD. D. (2002). Investigating the relationship between vocabulary knowledge and academic reading performance: An assessment perspective. Language Learning, 52(3), 513–536. https://doi.org/10.1111/1467–9922.00193
47.
ReadJ. (2000). Assessing vocabulary. Cambridge University Press.
48.
SchmittN. (2010). Researching vocabulary: A vocabulary research manual. Palgrave Macmillan Basingstoke.
49.
SchmittN. (2014). Size and depth of vocabulary knowledge: What the research shows. Language Learning, 64(4), 913–951. https://doi.org/10.1111/lang.12077
SchmittN.SchmittD.ClaphamC. (2001). Developing and exploring the behaviour of two new versions of the Vocabulary Levels Test. Language Testing, 18(1), 55–88. https://doi.org/10.1177/026553220101800103
52.
StewartJ. (2014). Do multiple-choice options inflate estimates of vocabulary size on the VST?Language Assessment Quarterly, 11(3), 271–282. https://doi.org/10.1080/15434303.2014.922977
53.
StewartJ.BattyA. O.BoveeN. (2012). Comparing multidimensional and continuum models of vocabulary acquisition: An empirical examination of the Vocabulary Knowledge Scale. TESOL Quarterly, 46(4), 695–721. https://doi.org/10.1002/tesq.35
54.
TabachnickB. G.FidellL. S. (2007). Using multivariate statistics (5th ed.). Pearson.
WestM. (1953). A general service list of English words. Longman, Green.
57.
XueG.NationI. S. P. (1984). A university word list. Language Learning and Communication, 3(2), 215–229.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
