Developing internet-based Tests of Aptitude for Language Learning (TALL) : An open research endeavour

Abstract

Chinese

Tests of Aptitude for Language Learning (TALL) is an openly accessible internet-based battery to measure the multifaceted construct of foreign language aptitude, using language domain–specific instruments and L1-sensitive instructions and stimuli. This brief report introduces the components of this theory-informed battery and methodological considerations for developing it into an open research instrument. It also presents the preliminary results from the initial validation of TALL carried out on data collected from Chinese L1 participants (n = 165) from a university setting who took two rounds of tests (with counterbalanced test items) with a minimum 30-day interval. The results of data analyses at subtest, item, and battery levels suggest that, in general, TALL has satisfactory reliability and can be used to measure aptitude conceptualized in the theoretical frameworks on which it has been developed. This report also highlights the value of TALL as a convenient data collection tool openly accessible to any researcher for free, its potential for facilitating an open data pool for high-quality syntheses of aptitude-related research findings, and its implications for Open Research practices in testing language-related constructs.

Keywords

Aptitude battery internet-based test open data pool open instrument for data collection open research resource

Get full access to this article

View all access options for this article.

References

Bokander

Bylund

(2020). Probing the internal validity of the LLAMA language aptitude tests. Language Learning, 70(1), 11–47. https://doi.org/10.1111/lang.12368

Carroll

J. B.

(1981). Twenty-five years of research on foreign language aptitude. In Diller

K. C.

(Ed.), Individual differences and universals in language learning aptitude (pp. 83–118). Newbury House.

Gass

Winke

Isbell

D. R.

Ahn

(2019). How captions help people learn languages: A working-memory, eye-tracking study. Language Learning and Technology, 23(2), 84–104. https://doi.org/10125/44684

Isbell

D. R.

Kim

(2023). Developer involvement and COI disclosure in high-stakes English proficiency test validation research: A systematic review. Research Methods in Applied Linguistics, 2(3), 100060. https://doi.org/10.1016/j.rmal.2023.100060

Kane

(2006). Validation. In Brennan

(Ed.), Educational measurement (4th ed., pp. 17–64). American Council on Education and Praeger.

Marsden

Morgan-Short

(2023). (Why) are open research practices the future for the study of language learning? Language Learning, 73, 344–387. https://doi.org/10.1111/lang.12568

McNeish

(2018). Thanks coefficient alpha, we’ll take it from here. Psychological Methods, 23(3), 412–433. https://doi.org/10.1037/met0000144

Meara

P. M.

Rogers

V. E.

(2019). The LLAMA Tests v3. Lognostics. https://www.lognostics.co.uk/tools/LLAMA_3/index.htm

Newman

Bavik

Y. L.

Mount

Shao

(2021). Data collection via online platforms: Challenges and recommendations for future research. Applied Psychology, 70(3), 1380–1402. https://doi.org/10.1111/apps.12302

10.

Pan

(2023a). Developing and validating an internet-based battery of Tests of Aptitude for Language Learning (TALL) [Unpublished doctoral dissertation]. University of York.

11.

Pan

. (2023b). TALL (Tests of Aptitude for Language Learning). https://doi.org/10.17605/OSF.IO/CZQXT

12.

Pimsleur

(1966). Pimsleur Language Aptitude Battery (form S). Harcourt, Brace and World, Incorporated. https://lltf.net/aptitude-tests/language-aptitude-tests/pimsleur-language-aptitude-battery

13.

Purpura

J. E.

Brown

J. D.

Schoonen

(2015). Improving the validity of quantitative measures in Applied Linguistics research. Language Learning, 65(Suppl. 1), 37–75. https://doi.org/10.1111/lang.12112

14.

R Core Team. (2022). R: A language and environment for statistical computing. R Foundation for Statistical Computing. https://www.R-project.org/

15.

Skehan

(2016). Foreign language aptitude, acquisitional sequences, and psycholinguistic processes. In Granena

Jackson

Yilmaz

(Eds.), Cognitive individual differences in L2 processing and acquisition (pp. 15–38). John Benjamins. https://doi.org/10.1075/bpa.3

16.

Suzuki

(2021). Individual differences in memory predict changes in breakdown and repair fluency but not speed fluency: A short-term fluency training intervention study. Applied Psycholinguistics, 42(4), 969–995. https://doi.org/10.1017/S0142716421000187

17.

TALL (n.d.). Tests of Aptitude for Language Learning. https://www.tall-webtest.com

18.

Wen

(2016). Working memory and second language learning: Toward an integrated approach. Multilingual Matters. https://doi.org/10.21832/9781783095735

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.33 MB