This study is a conceptual replication of Ellis’ ‘Measuring implicit and explicit knowledge of a second language: A psychometric study’, published in Studies in Second Language Acquisition (2005), aiming to establish the importance of including belief statements (hypothesized to increase processing demands) in the design of Elicited Imitation (EI) tests. In a between-groups comparison, 103 participants completed one of two versions of Erlam’s EI test (2006), one which required participants to make a ‘belief’ judgement, and one which did not. Both contained ungrammatical stimuli. Participants were scored for repetition of grammatical stimuli and correction of ungrammatical stimuli. An Exit questionnaire aimed to establish how aware they were of ungrammatical stimuli. Participants also completed a timed grammaticality judgement test (TGJT), an untimed grammaticality judgement test (UGJT), a metalinguistic knowledge test (MKT), and another Elicited Imitation (EI) test designed as a measure of global proficiency. Performance on each EI version was examined in relationship to performance on these measures. There was no variation between performance on either EI test version. The article underscores the need for ongoing research investigating design features of EI tests.
AkakuraM. (2012). Evaluating the effectiveness of explicit instruction on implicit and explicit knowledge. Language Teaching Research, 16, 9–37.
2.
BaddeleyA.D.LogieR.H. (1999). Working memory: The multiple-component model. In MiyakeA.ShahP. (Eds.), Models of working memory: Mechanisms of active maintenance and executive control (pp. 28–61). Cambridge University Press.
3.
BarrouilletP.BernardinS.PortratS.VergauweE.CamosV. (2007). Time and cognitive load in working memory.Journal of Experimental Psychology: Learning, Memory, and Cognition, 33, 570–585.
4.
Bley-VromanR.ChaudronC. (1994). Elicited imitation as a measure of second language competence. In TaroneE.GassS.CohenA. (Eds.), Research methodology in second- language acquisition (pp. 245–261). Lawrence Erlbaum.
5.
BowlesM.A. (2011). Measuring implicit and explicit language knowledge: What can heritage learners contribute?Studies in Second Language Acquisition, 33, 247–271.
6.
BurtM.KiparskyC. (1972). The Gooficon: A repair manual for English. Newbury House.
7.
ChrabaszczA.JiangN. (2014). The role of the native language in the use of the English non-generic definite article by L2 learners: A cross-linguistic study. Second Language Research, 30, 351–379.
8.
DeKeyserR.M. (2003). Implicit and explicit learning. In DoughtyC.J.LongM.H. (Eds.), The handbook of second language acquisition (pp. 313–348). Blackwell.
9.
DeKeyserR.M. (2007). Study abroad as foreign language practice. In DeKeyserR.M. (Ed.), Practicing in a second language: Perspectives from applied linguistics and cognitive psychology (pp. 208–226). Cambridge University Press.
10.
ElçetinG.AlptekinC. (2013). The explicit/implicit knowledge distinction and working memory: Implications for second language reading comprehension. Applied Psycholinguistics, 34, 727–753.
11.
ElderC.EllisR. (2009). Implicit and explicit knowledge of an L2 and language proficiency. In EllisR.LoewenS.ElderC., et al. (Eds.), Implicit and explicit knowledge in second language learning, testing and teaching (pp. 167–193). Multilingual Matters.
12.
EllisN. (2005). At the interface: Dynamic interactions of explicit and implicit language. Studies in Second Language Acquisition, 27, 305–352.
13.
EllisR. (2005). Measuring implicit and explicit knowledge of a second language: A psychometric study. Studies in Second Language Acquisition, 27, 141–172.
14.
EllisR. (2009a). Implicit and explicit learning, knowledge and instruction. In EllisR.LoewenS.ElderC., et al. (Eds.), Implicit and explicit knowledge in second language learning, testing and teaching (pp. 3–25). Multilingual Matters.
15.
EllisR. (2009b). Measuring implicit and explicit knowledge of a second language. In EllisR.LoewenS.ElderC. (Eds.), Implicit and explicit knowledge in second language learning, testing and teaching (pp. 31–64). Multilingual Matters.
16.
ErlamR. (2006). Elicited imitation as a measure of L2 implicit knowledge: An empirical validation study. Applied Linguistics, 27, 464–491.
17.
ErlamR. (2009). The Elicited oral imitation test as a measure of implicit knowledge. In EllisR.LoewenS.ElderC. (Eds.), Implicit and explicit knowledge in second language learning, testing and teaching (pp. 65–93). Multilingual Matters.
18.
ErlamR.EllisR. (2018). Task-based language teaching for beginner-level learners of L2 French: An exploratory study. Canadian Modern Language Review, 71, 1–26.
19.
ErlamR.LoewenS. (2010). Implicit and explicit recasts in L2 oral French interaction. The Canadian Modern Language Review, 66, 887–918.
20.
ForsterK.I.ForsterJ.C. (2003). DMDX: A windows display program with millisecond accuracy. Behavior Research Methods, Instruments, & Computers, 35, 116–124.
21.
GranenaG. (2016). Elicited imitation as a measure of implicit L2 knowledge: The role of working memory and short-term memory capacity. In GranenaG.JacksonD.YilmazY. (Eds.), Cognitive individual differences in second language processing and acquisition (pp. 185–204). John Benjamins.
22.
Hama LeowR. (2010). Learning without awareness revisited: Extending Williams (2005). Studies in Second Language Acquisition, 32, 465–491.
23.
HamayanE.SaegertJ.LaraudeeP. (1977). Elicited imitation in second language learners. Language and Speech, 20, 86–97.
24.
HulstijnJ.H. (2011). Language proficiency in native and nonnative speakers: An agenda for research and suggestions for second-language assessment. Language Assessment Quarterly, 8, 229–249.
25.
HulstijnJ.H. (2012). The construct of language proficiency in the study of bilingualism from a cognitive perspective. Bilingualism, Language and Cognition, 15, 422–433.
26.
KimJ.NamH. (2017). Measures of implicit knowledge revisited: Processing modes, time pressure and modality. Studies in Second Language Acquisition, 39, 431–457.
27.
LoewenS. (2009). Grammaticality judgment tests and the measurement of implicit and explicit L2 knowledge. In EllisR.LoewenS.ElderC. (Eds.), Implicit and explicit knowledge in second language learning, testing and teaching (pp. 94–112). Multilingual Matters.
28.
MarsdenE.Morgan-ShortK.ThompsonS.AbugaberD. (2018). Replication in second language research: Narrative and systematic reviews and recommendations for the field. Language Learning, 68, 321–391.
29.
McDadeH.SimpsonM.LambD. (1982). The use of elicited imitation as a measure of expressive grammar: A question of validity. Journal of Speech and Hearing Disorders, 47, 19–24.
30.
MiyakeA.FriedmanN.P. (1998). Individual differences in second language proficiency: Working memory as language aptitude. In HealyA.F.BourneL.E.Jr. (Eds.), Foreign language learning: Psycholinguistic studies on training and retention (pp. 339–364). Lawrence Erlbaum.
31.
MunnichE.FlynnS.MartohardjonoG. (1994). Elicited imitation and grammaticality judgment tasks: What they measure and how they relate to each other. In TaroneE.GassSCohenA. (Eds.), Research methodology in second-language acquisition (pp. 227–245). Lawrence Erlbaum.
32.
OkuraE.LonsdaleD. (2012). Working memory’s meagre involvement in sentence repetition tests. In MiyakeN.PeeblesD.CooperR.P. (Eds.), Proceedings of the 34th Annual Conference of the Cognitive Science Society (pp. 2132–2137). Cognitive Science Society.
33.
OrtegaL.IwashitaN.NorrisJ.M.RabieS. (2002, October3–6). An investigation of elicited imitation tasks in crosslinguistic SLA research. Unpublished paper presented at the Second Language Research Forum, Toronto, ON, Canada.
34.
PenaE.A.SlateE.H. (2014). gvlma: Global validation of linear models assumptions: R package version 1.0.0.2. Available at: https://CRAN.R-project.org/package=gvlma (accessed June 2021).
35.
RassaeiE.MoinzadehA.YouhanaeeM. (2012). The effect of corrective feedback on the acquisition of implicit and explicit L2 knowledge. The Journal of Language Teaching and Learning, 2, 59–75.
36.
SarandiH. (2015). Reexamining elicited imitation as a measure of implicit grammatical knowledge and beyond . . .?Language Testing, 32, 485–501.
37.
SarandiH. (2020). The structural sensitivity of elicited imitation as a measure of implicit grammatical knowledge. Eurasian Journal of Applied Linguistics, 6, 265–284.
38.
SpadaN.ShiuJ.TomitaY. (2015). Validating an elicited imitation task as a measure of implicit knowledge: Comparisons with other validation studies. Language Learning, 65, 723–751.
39.
SuzukiY. (2017). Validity of new measures of implicit knowledge: Distinguishing implicit knowledge from automatized explicit knowledge. Applied Psycholinguistics, 38, 1229–1261.
40.
SuzukiY. (2019). The neural foundations of explicit and implicit knowledge: An fMRI study. Unpublished paper presented at the meeting of the Neurocognitive Foundations of Foreign Language Learning, ESRC UK–Japan project, University College London, UK.
41.
SuzukiY.DeKeyserR. (2015). Comparing elicited imitation and word monitoring as measures of implicit knowledge. Language Learning, 65, 860–895.
42.
TabachnickB.G.FidellL.S. (2013). Using multivariate statistics. 6th edition.Pearson.
43.
Tracy-VenturaN.McManusK.NorrisJ.OrtegaL. (2014). ‘Repeat as much as you can’: Elicited imitation as a measure of global proficiency in L2 French. In LeclercqP.HiltonH.EdmondsA. (Eds.), Proficiency assessment issues in SLA research: Measures and practices (pp. 143–166). Multilingual Matters.
44.
UnsworthN.HeitzR.P.SchrockJ.C.EngleR.W. (2005). An automated version of the operation span task. Behavior Research Methods, 37, 498–505.
45.
VafaeeP.SuzukiY.KachinskeI. (2017). Validating grammaticality judgement tests: Evidence from two new psycholinguistic measures. Studies in Second Language Acquisition, 39, 59–95.
46.
VanPattenB. (1989). Can learners attend to form and content while processing input?Hispania, 72, 409–417.
47.
WilliamsJ. (2009). Implicit learning in second language acquisition. In RitchieW.BhatiaT. (Eds.), The new handbook of second language acquisition (pp. 319–353). Emerald Group Publishing.
48.
WuS.L.OrtegaL. (2013). Measuring global oral proficiency in SLA research: A new elicited imitation test of L2 Chinese. Foreign Language Annals, 46, 680–704.
49.
YanX.MaedaY.LvJ.GintherA. (2016). Elicited imitation as a measure of second language proficiency: A narrative review and meta-analysis. Language Testing, 33, 497–528.
50.
ZhangR. (2015). Measuring university-level L2 learners’ implicit and explicit linguistic knowledge, Studies in Second Language Acquisition, 37, 457–486.
51.
ZhaoY. (2015). The effects of explicit and implicit recasts on the acquisition of two grammatical structures and the mediating role of working memory. Unpublished doctoral dissertation, University of Auckland, Auckland, New Zealand.
52.
ZhouY. (2012). Willingness to communicate in learning Mandarin as a foreign and heritage language. Unpublished doctoral dissertation, University of Hawaii at Manoa, Honolulu, HI, USA.
