Sage Journals: Discover world-class research

Abstract

Recent investigations into language assessment literacy (LAL) suggest that stakeholder groups might differ in interests, needs, and expectations in assessment practice, resulting in different LAL profiles. This qualitative study furthers this line of research by examining the effect of contextual and experiential factors on the LAL profiles and development of different stakeholder groups. Semi-structured interviews were conducted among 20 participants from three stakeholder groups in China, including language testers, EFL teachers, and graduate students. Results indicate that LAL profile differences existed at both group and individual levels. At the group level, language-testing researchers and students demonstrated greater familiarity with assessment concepts than did EFL teachers; however, EFL teachers were able to understand and link those concepts with assessment practices. At the individual level, each participant experienced a different LAL development process; yet, these processes share some common patterns. Based on these patterns, a common LAL development model for all stakeholders is proposed. Assessment training should consider the resources in stakeholders’ assessment contexts and their experiences in assessment development, use, and research and develop realistic expectations in LAL development for different stakeholders.

Keywords

Assessment training contextual and experiential factors language assessment in China language assessment literacy self-reflection

Get full access to this article

View all access options for this article.

References

Baker

B. A.

Riches

(2018). The development of EFL examinations in Haiti: Collaboration and language assessment literacy development. Language Testing, 35(4), 557–581. https://doi.org/10.1177/0265532217716732

Borg

(2003). Teacher cognition in language teaching: A review of research on what language teachers think, know, believe, and do. Language Teaching, 36(02), 81–109. https://doi.org/10.1017/S0261444803001903

Crandall

J. J.

(2000). Language teacher education. Annual Review of Applied Linguistics, 20, 34–55. https://doi.org/10.1017/S0267190500200032

Creswell

J. W.

Poth

C. N.

(2018). Qualitative inquiry & research design: Choosing among five approaches (4th ed.). SAGE Publications.

Crusan

Plakans

Gebril

(2016). Writing assessment literacy: Surveying second language teachers’ knowledge, beliefs, and practices. Assessing Writing, 28, 43–56. https://doi.org/10.1016/j.asw.2016.03.001

Davies

(2008). Textbook trends in teaching language testing. Language Testing, 25(3), 327–347. https://doi.org/10.1177/0265532208090156

Dimova, S., Yan, X., & Ginther, A. (2020). Local Language Testing: Design, Implementation, and Development. Routledge.

Eraut

(2004). Transfer of knowledge between education and workplace settings. In Rainbird

Fuller

Munro

(Eds.), Workplace learning in context (pp. 201–221). Routledge.

Fulcher

(2012). Assessment literacy for the language classroom. Language Assessment Quarterly, 9(2), 113–132. https://doi.org/10.1080/15434303.2011.642041

10.

Guskey

T. R.

(2002). Professional development and teacher change. Teachers and Teaching, 8(3), 381–391.https://doi.org/10.1080/135406002100000512

11.

Harding

Kremmel

(2016). Teacher assessment literacy and professional development. In Tsagari

Banerjee

(Eds.), Handbook of second language assessment (pp. 413–428). Mouton de Gruyter.

12.

Inbar-Lourie

(2008). Constructing a language assessment knowledge base: A focus on language assessment courses. Language Testing, 25(3), 385–402. https://doi.org/10.1177/0265532208090158

13.

Inbar-Lourie

(2013). Guest editorial to the special issue on language assessment literacy. Language Testing, 30(3), 301–307. https://doi.org/10.1177/0265532213480126

14.

Jeong

(2013). Defining assessment literacy: Is it different for language testers and non-language testers? Language Testing, 30(3), 345–362. https://doi.org/10.1177/0265532213480334

15.

Jin

(2010). The place of language testing and assessment in the professional preparation of foreign language teachers in China. Language Testing, 27(4), 555–584. https://doi.org/10.1177/0265532209351431

16.

Jin

Yan

(2017). Computer literacy and the construct validity of a high-stakes computer-based writing assessment. Language Assessment Quarterly, 14(2), 101–119. https://doi.org/10.1080/15434303.2016.1261293

17.

Johnson

K. E.

(2006). The sociocultural turn and its challenges for second language teacher education. TESOL Quarterly, 40(1), 235–257. https://doi.org/10.2307/40264518

18.

Levi

Inbar-Lourie

(2020). Assessment literacy or language assessment literacy: Learning from the teachers. Language Assessment Quarterly, 17(2), 168–182. https://doi.org/10.1080/15434303.2019.1692347

19.

McNamara

Roever

(2006). Language testing: The social dimension. Blackwell.

20.

Malone

(2013). The essentials of assessment literacy: Contrasts between testers and users. Language Testing, 30(3), 329–344. https://doi.org/10.1177/0265532213480129

21.

Miles

M. B.

Huberman

A. M.

Huberman

M. A.

Huberman

(1994). Qualitative data analysis: An expanded sourcebook. SAGE Publications.

22.

O’Loughlin

(2013). Developing the assessment literacy of university proficiency test users. Language Testing, 30(3), 363–380. https://doi.org/10.1177/0265532213480336

23.

Pill

Harding

(2013). Defining the language assessment literacy gap: Evidence from a parliamentary inquiry. Language Testing, 30(3), 381–402. https://doi.org/10.1177/0265532213480337

24.

, (2005). Stakeholders’ conflicting aims undermine the washback function of a high-stakes test. Language Testing, 22(2), 142–173. https://doi.org/10.1191/0265532205lt300oa

25.

QSR International (2012). Nvivo® (Version 10) [Computer Software]. http://www.qsrinternational.com/products_nvivo.aspx

26.

Scarino

(2013). Language assessment literacy as self-awareness: Understanding the role of interpretation in assessment and in teacher learning. Language Testing, 30(3), 309–327. https://doi.org/10.1177/0265532213480128

27.

Strauss

Corbin

(1998). Basics of qualitative research techniques. SAGE Publications.

28.

Taylor

(2009). Developing assessment literacy. Annual Review of Applied Linguistics, 29, 21–36. https://doi.org/10.1017/S0267190509090035

29.

Taylor

(2013). Communicating the theory, practice and principles of language testing to test stakeholders: Some reflections. Language Testing, 30(3), 403–412. https://doi.org/10.1177/0265532213480338s

30.

Vogt

Tsagari

(2014). Assessment literacy of foreign language teachers: Findings of a European study. Language Assessment Quarterly, 11(4), 374–402. http://doi.org/10.1080/15434303.2014.960046

31.

Yan, X., Zhang, C., & Fan, J. J. (2018). Assessment knowledge is important, but…: How contextual and experiential factors mediate assessment practice and training needs of language teachers. System, 74, 158–168. https://doi.org/10.1016/j.system.2018.03.003

32.

Jin

(2014). English language assessment in China: Policies, practices and impacts. Assessment in Education: Principles, Policy & Practice, 21(3), 245–250. https://doi.org/10.1080/0969594X.2014.937936

33.

Suen

H. K.

(2005). Historical and contemporary exam-driven education fever in China. KEDI Journal of Educational Policy, 2(1), 17-–33.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.10 MB

“Am I qualified to be a language tester?”: Understanding the development of language assessment literacy across three stakeholder groups

Abstract

Keywords

Get full access to this article

References

Supplementary Material