This meta-analysis explores the correlation between self-assessment (SA) and language performance. Sixty-seven studies with 97 independent samples involving more than 68,500 participants were included in our analysis. It was found that the overall correlation between SA and language performance was .466 (p < .01). Moderator analysis was performed to evaluate the moderating effects of a number of variables that are believed to play important roles in SA. Six moderators were found to have significant moderating effects, including SA criteria type, presence and form of SA criteria, SA instruments, training, total number of items in the SA instrument, and reliability of SA instruments. However, no significant moderating effect was identified for external measures, language skills, order of assessment, reliability of external measures, and number of Likert-scale levels. These findings offer a number of implications for improving the SA–performance correlation.
References marked with an asterisk indicate studies included in the meta-analysis
2.
AckermanP. L.BeierM. E.BowenK. R. (2002).
What we really know about our abilities and our knowledge. Personality and Individual Differences,
33(4), 587–605. https://doi.org/10.1016/S0191-8869(01)00174-X
3.
AirasianP. W. (1997). Classroom assessment (3rd ed.).
McGraw-Hill.
*AldersonJ. C. (2005). Diagnosing foreign language proficiency: The Interface between learning and assessment.
Continuum.
6.
*AldersonJ. C.HuhtaA. (2005).
The development of a suite of computer-based diagnostic tests based on the Common European Framework. Language Testing,
22(3), 301–320. https://doi.org/10.1191/0265532205lt310oa
7.
AlFallayI. (2004).
The role of some selected psychological and personality traits of the rater in the accuracy of self- and peer-assessment. System,
32(3), 407–425. https://doi.org/10.1016/j.system.2004.04.006
8.
*AlkhatatbehM. A. (2014).
Investigating the relationship between students’ self-assessment and ratings obtained from a formal DLPT5 reading skill [Unpublished doctoral dissertation]. Argosy University.
9.
Alonso-TapiaJ.PanaderoE. (2010).
Effects of self-assessment scripts on self-regulation and learning. Infancia Y Aprendizaje,
33(3), 385–397. https://doi.org/10.1174/021037010792215145
10.
*AndradeH. G.BoulayB. A. (2003).
Role of rubric-referenced self-assessment in learning to write. The Journal of Educational Research,
97(1), 21–30. https://doi.org/10.1080/00220670309596625
11.
AndradeH. L.DuY.MycekK. (2010).
Rubric-referenced self-assessment and middle school students’ writing. Assessment in Education Principles Policy & Practice,
17(2), 199–214. https://doi.org/10.1080/09695941003696172
12.
AndradeH.ValtchevaA. (2009).
Promoting learning and achievement through self-assessment.Theory into Practice,
48(1), 12–19. https://doi.org/10.1080/00405840802577544
13.
*AshtonK. (2014).
Using self-assessment to compare learners’ reading proficiency in a multilingual assessment framework. System,
42, 105–119. https://doi.org/10.1016/j.system.2013.11.006
14.
*BabaiiE.TaghaddomiS.PashmforooshR. (2016).
Speaking self-assessment: Mismatches between learners’ and teachers’ criteria. Language Testing,
33(3), 411–437. https://doi.org/10.1177/0265532215590847
15.
BachmanL. F. (1990). Fundamental considerations in language testing.
Oxford University Press.
*BachmanL. F.PalmerA. S. (1982).
The construct validation of some components of communicative proficiency. TESOL Quarterly,
16(4), 449–465. https://doi.org/10.2307/3586464
18.
BachmanL. F.PalmerA. S. (1989).
The construct validation of self-ratings of communicative language ability. Language Testing,
6(1), 14–29. https://doi.org/10.1177/026553228900600104
19.
BercherD. A. (2012).
Self-monitoring tools and student academic success: When perception matches reality. Journal of College Science Teaching,
41(5), 26–32.
20.
*BirjandiP.BolghariM. S. (2015).
The relationship between the accuracy of self- and peer-assessment of Iranian intermediate EFL learners and their learning styles.Theory and Practice in Language Studies,
5(5), 996–1006. http://dx.doi.org/10.17507/tpls.0505.15
21.
*BlancheP. (1990).
Using standardized achievement and oral proficiency tests for self-assessment purposes: The DLIFLC study. Language Testing,
7(2), 202–229. https://doi.org/10.1177/026553229000700205
BorensteinM.HedgesL. V.HigginsJ. P. T.RothsteinH. R. (2009). Introduction to meta-analysis.
Wiley.
24.
BoudD.FalchikovN. (1989).
Quantitative studies of student self-assessment in higher education: A critical analysis of findings.Higher Education,
18(5), 529–549. https://doi.org/10.1007/BF00138746
25.
BrantmeierC. (2006).
Advanced L2 learners and reading placement: Self-assessment, CBT, and subsequent performance. System,
34(1), 15–35. https://doi.org/10.1016/j.system.2005.08.004
*BrantmeierC.VanderplankR.StrubeM. (2012).
What about me?: Individual self-assessment by skill and level of language instruction. System,
40(1), 144–160. https://doi.org/10.1016/j.system.2012.01.003
28.
BroadfootP. (2007). An introduction to assessment.
Continuum International.
29.
BrownG. T. L.HarrisL. R. (2013). Student self-assessment. In McMillanJ. H. (Ed.), Handbook of research on classroom assessment (pp. 367–393).
SAGE Publications.
30.
*BrownN. A.DeweyD. P.CoxT. L. (2014).
Assessing the validity of can-do statements in retrospective (then-now) self-assessment. Foreign Language Annals,
47(2), 261–285. https://doi.org/10.1111/flan.12082
*ButlerY. G. (2018).
The role of context in young learners’ processes for responding to self-assessment items. The Modern Language Journal,
102(1), 242–261. https://doi.org/10.1111/modl.12459
33.
*ButlerY. G.LeeJ. (2006).
On-task versus off-task self-assessments among Korean elementary school students studying English. The Modern Language Journal,
90(4), 506–518. https://doi.org/10.1111/j.1540-4781.2006.00463.x
34.
*ButlerY. G.LeeJ. (2010).
The effects of self-assessment among young learners of English.Language Testing,
27(1), 5–31. https://doi.org/10.1177/0265532209346370
35.
*CalderM. (2013).
Self-assessment of lexical knowledge in second language vocabulary acquisition [Unpublished doctoral dissertation]. Swansea University.
36.
*CampbellK. S.MothersbaughD. L.BrammerC.TaylorT. (2001).
Peer versus self-assessment of oral business presentation performance. Business Communication Quarterly,
64(3), 23–40. https://doi.org/10.1177/108056990106400303
*CharetteM.MengR. (1994).
Explaining language proficiency: Objective versus self-assessed measures of literacy. Economics Letters,
44(3), 313–321. https://doi.org/10.1016/0165-1765(93)00365-U
39.
*ChenY. M. (2008).
Learning to self-assess oral performance in English: A longitudinal case study. Language Teaching Research,
12(2), 235–262. https://doi.org/10.1177/1362168807086293
40.
CohenJ. (1988). Statistical power analysis for the social sciences (2nd ed.).
Lawrence Erlbaum.
41.
*Cushing WeigleS. (2010).
Validation of automated scores of TOEFL iBT tasks against non-test indicators of writing ability. Language Testing,
27(3), 335–353. https://doi.org/10.1177/0265532210364406
42.
DannR. (2002). Promoting assessment as learning: Improving the learning process.
Routledge.
43.
*De GrezL.ValckeM.RoozenI. (2012).
How effective are self- and peer-assessment of oral presentation skills compared with teachers’ assessments?Active Learning in Higher Education,
13(2), 129–142. https://doi.org/10.1177/1469787412441284
44.
*DelgadoP.GuerreroG.GogginJ. P.EllisB. B. (1999).
Self-assessment of linguistic skills by bilingual Hispanics. Hispanic Journal of Behavioral Sciences,
21(1), 31–46. https://doi.org/10.1177/0739986399211003
45.
DeVellisR. F. (2003). Scale development: Theory and applications.
SAGE Publications.
46.
DickinsonL. (1987). Self-instruction in language learning.
Cambridge University Press.
47.
*DolosicH. N.BrantmeierC.StrubeM.HogrebeM. C. (2016).
Living language: Self-assessment, oral production, and domestic immersion. Foreign Language Annals,
49(2), 302–316. https://doi.org/10.1111/flan.12191
48.
DuvalS.TweedieR. (2000).
A nonparametric “trim and fill” method of accounting for publication bias in meta-analysis. Publications of the American Statistical Association,
95(449), 89–98. https://doi.org/10.1080/01621459.2000.10473905
49.
*EdeleA.SeuringJ.KristenC.StanatP. (2015).
Why bother with testing? The validity of immigrants’ self-assessed language proficiency. Social Science Research,
52, 99–123. https://doi.org/10.1016/j.ssresearch.2014.12.017
50.
*EnrightM. K.BridgemanB.EignorD.LeeY. W.PowersD. (2008). Prototyping measures of listening, reading, speaking, and writing. In ChapelleC. A.EnrightM. K.JamiesonJ. M. (Eds.), Building a validity argument for the Test of English as a Foreign Language (pp. 145–186).
Routledge.
51.
FalchikovN.BoudD. (1989).
Student self-assessment in higher education: A meta-analysis. Review of Educational Research,
59(4), 395–430. https://doi.org/10.3102/00346543059004395
52.
*FergusonN. (1978).
Notes and discussion: Self-assessment of listening comprehension. International Review of Applied Linguistics in Language Teaching,
16(2), 149–156. https://doi.org/10.1515/iral.1978.16.1-4.149
53.
*FinnieR.MengR. (2005).
Literacy and labour market outcomes: Self-assessment versus test score measures. Applied Economics,
37(17), 1935–1951. https://doi.org/10.1080/00036840500244519
54.
Foote, J. A. (2010). Second language learners perceptions of their own recorded speech. Prairie Metropolis Centre.
55.
FreemanM. I. (2000). A self-evaluation instrument for the measurement of student proficiency levels. In BlueG. M.MiltonJ.SavilleJ. (Eds.), Assessing English for academic purposes (pp. 219–236).
Peter Lang.
56.
FreundP. A.KastenN. (2012).
How smart do you think you are? A meta-analysis on the validity of self-estimates of cognitive ability. Psychological Bulletin,
138(2), 296–321. https://doi.org/10.1037/a0026556
57.
FroehlichC. P.MoserW. E. (1954).
Do counselees remember test scores?Journal of Counseling Psychology,
1(3), 149–152. https://doi.org/10.1037/h0061944
58.
FulcherG. (2003). Testing second language speaking.
Pearson.
59.
GarciaJ. A.FloydC. E. (1999).
Using single system design for student self-assessment: A method for enhancing practice and integrating curriculum. Journal of Social Work Education,
35(3), 451–461. https://doi.org/10.1080/10437797.1999.10778981
60.
*GoralD. P.BaileyA. L. (2019).
Student self-assessment of oral explanations: Use of language learning progressions. Language Testing,
36(3), 391–417. https://doi.org/10.1177/0265532219826330
61.
GuskeyT. (2016). How classroom assessments improve learning. In SchererM. (Ed.), On formative assessment: Readings from educational leadership (pp. 3–13).
ASCD.
62.
HanrahanS. J.IsaacsG. (2001).
Assessing self- and peer-assessment: The students’ views.Higher Educational Research and Development,
20(1), 53–70. https://doi.org/10.1080/07294360123776
63.
HansfordB. C.HattieJ. A. (1982).
The relationship between self and achievement/performance measures. Review of Educational Research,
52(1), 123–142. https://doi.org/10.3102/00346543052001123
64.
Ikeguchi, C. B. (1996). Self-assessment and ESL competence of Japanese returnees. ERIC Clearinghouse on Higher Education. http://eric.ed.gov/PDFS/ED399798.pdf
65.
*IwamotoN. (2015).
Effects of L2 affective factors on self-assessment of speaking [Unpublished doctoral dissertation]. Temple University.
*JangE. E.DunlopM.ParkG.van der BoomE. H. (2015).
How do young students with different profiles of reading skill mastery, perceived ability, and goal orientation respond to holistic diagnostic feedback?Language Testing,
32(3), 359–383. https://doi.org/10.1177/0265532215570924
68.
*Janssen-van DietenA. M. (1989).
The development of a test of Dutch as a second language: The validity of self-assessment by inexperienced subjects. Language Testing,
6(1), 30–46. https://doi.org/10.1177/026553228900600105
69.
*JohanssonS. (2013).
The relationship between students’ self-assessed reading skills and other measures of achievement.Large-Scale Assessments in Education,
1(1), 1–17. https://doi.org/10.1186/2196-0739-1-3
70.
*KaderavekJ. N.GillamR. B.UkrainetzT. A.JusticeL. M.EisenbergS. N. (2004).
School-age children’s self-assessment of oral narrative production. Communication Disorders Quarterly,
26(1), 37–48. https://doi.org/10.1177/15257401040260010401
71.
KrausertS. R. (2013).
Determining the usefulness of self-assessment of foreign language skills: Post-secondary ESL students placement contribution. Opto-Electronic Engineering,
4(2), 85–100.
72.
*KrugerJ.DunningD. (1999).
Unskilled and unaware of it: How difficulties in recognizing one’s own incompetence lead to inflated self-assessments. Journal of Personality and Social Psychology,
77(6), 1121–1134. http://doi.org/10.1037/0022-3514.77.6.1121
73.
*LanganA. M.ShukerD. M.CullenW. R.PenneyD.PreziosiR. F.WheaterC. P. . (2008).
Relationships between student characteristics and self-, peer and tutor evaluations of oral presentations.Assessment & Evaluation in Higher Education,
33(2), 179–190. https://doi.org/10.1080/02602930701292498
74.
*Lappin-FortinK.RyeB. J. (2014).
The use of pre-/posttest and self-assessment tools in a French pronunciation course. Foreign Language Annals,
47(2), 300–320. https://doi.org/10.1111/flan.12083
75.
*LeBlancR.PainchaudG. (1985).
Self-assessment as a second language placement instrument. TESOL Quarterly,
19(4), 673–687. https://doi.org/10.2307/3586670
76.
*LiM. (2018).
Know thyself self- vs. other assessment of second language pronunciation [Unpublished doctoral dissertation]. Boston University.
77.
*LiZ. (2015).
Using an English self-assessment tool to validate an English placement test. Papers in Language Testing and Assessment, IV, 59–96.
78.
LievensF.ReeveC. L.HeggestadE. D. (2007).
An examination of psychometric bias due to retesting on cognitive ability tests in selection settings. Journal of Applied Psychology,
92(6), 1672–1682. https://doi.org/10.1037/0021-9010.92.6.1672
*LinL. M.MooreD.ZabruckyK. M. (2001).
An assessment of students’ calibration of comprehension of comprehension and calibration of performance using multiple measures. Reading Psychology,
22(2), 111–128. https://doi.org/10.1080/02702710119125
LittleD.PerclovaR. (2001). European language portfolio guide for teachers and teacher trainers.
Council of Europe.
83.
*LiuH.BrantmeierC. (2019).
“I know English”: Self-assessment of foreign language reading and writing abilities among young Chinese learners of English.System,
80, 60–72. https://doi.org/10.1016/j.system.2018.10.013
84.
LuomaS.TarnanenM. (2003).
Creating a self-rating instrument for second language writing: from idea to implementation. Language Testing,
20(4), 440–465. https://doi.org/10.1191/0265532203lt267oa
85.
*MaW.WinkeP. (2019).
Self‐assessment: How reliable is it in assessing oral proficiency over time? Foreign Language Annals,
52(1), 66–86. https://doi.org/10.1111/flan.12379
86.
MabeP. A.WestS. G. (1982).
Validity of self-evaluation of ability: A review and meta-analysis. Journal of Applied Psychology,
67(3), 280–296. https://doi.org/10.1037/0021-9010.67.3.280
87.
*MalabongaV.KenyonD. M.CarpenterH. (2005).
Self-assessment, preparation and response time on a computerized oral proficiency test.Language Testing,
22(1), 59–92. https://doi.org/10.1191/0265532205lt297oa
88.
MarshH. W. (1990).
A multidimensional, hierarchical model of self-concept: Theoretical and empirical justification. Educational Psychology Review,
2(2), 77–172. https://doi.org/10.1007/BF01322177
89.
*MilleretM.StansfieldC. W.KenyonD. M. (1991).
The validity of the Portuguese speaking test for use in a summer study abroad program. Hispania, 778–787. https://doi.org/10.2307/344249
NgJ. R.EarlJ. K. (2008).
Accuracy in self-assessment: The role of ability, feedback, self-efficacy and goal orientation. Australian Journal of Career Development,
17(3), 39–50. https://doi.org/10.1177/103841620801700307
92.
OrsmondP.MerryS.ReilingK. (1997).
A study in self-assessment: Tutor and students’ perception of performance criteria.Assessment and Evaluation in Higher Education,
22(4), 357–369. https://doi.org/10.1080/0260293970220401
93.
OrsmondP.MerryS.ReilingK. (2000).
The use of student derived marking criteria in peer and self-assessment.Assessment and Evaluation in Higher Education,
25(1), 23–38. https://doi.org/10.1080/02602930050025006
PanaderoE.RomeroM. (2014).
To rubric or not to rubric? The effects of self-assessment on self-regulation, performance and self-efficacy. Assessment in Education: Principles, Policy & Practice,
21(2), 133–148. https://doi.org/10.1080/0969594X.2013.877872
*PeirceB. N.SwainM.HartD. (1993).
Self-assessment, French immersion, and locus of control. Applied Linguistics,
14(1), 25–42. https://doi.org/10.1093/applin/14.1.25
98.
*PowersD. E.PowersA. (2015).
The incremental contribution of TOEIC® listening, reading, speaking, and writing tests to predicting performance on real-life English language tasks. Language Testing,
32(2), 151–167. https://doi.org/10.1177/0265532214551855
99.
*PowersD. E.KimH. J.WengV. Z. (2008).
The redesigned TOEIC® (listening and reading) test: Relations to test test-taker perception of proficiency in English. ETS Research Report Series,
2008(2), i–120. https://doi.org/10.1002/j.2333-8504.2008.tb02142.x
100.
*PowersD. E.RoeverC.HuffK. L.TrapaniC. S. (2003).
Validating language™ courseware scores against faculty ratings and student self-assessments. ETS Research Report Series,
2003(1), i–25. https://doi.org/10.1002/j.2333-8504.2003.tb01903.x
101.
RossS. (1998).
Self-assessment in second language testing: A meta-analysis and analysis of experiential factors. Language Testing,
15(1), 1–20. https://doi.org/10.1177/026553229801500101
102.
RossS. (2006).
The reliability, validity, and utility of self-assessment. Practical Assessment, Research & Evaluation,
11(10), 1–13.
103.
RustC.PriceM.O’DonovanB. (2003).
Improving students’ learning by developing their understanding of assessment criteria and processes.Assessment & Evaluation in Higher Education,
28(2), 147–164. https://doi.org/10.1080/02602930301671
104.
*SaitoH.FujitaT. (2004).
Characteristics and user acceptance of peer rating in EFL writing classrooms. Language Teaching Research,
8(1), 31–54. https://doi.org/10.1191/1362168804lr133oa
*SinharayS.PowersD. E.FengY.SaldiviaL.GiuntaA.SimpsonA.WengV. (2009).
Appropriateness of the TOEIC® Bridge test for students in three countries of South America. Language Testing,
26(4), 589–619. https://doi.org/10.1177/0265532209340195
107.
Sitzmann, T., Ely, K., Brown, K. G., & Bauer, K. N. (2010). Self-assessment of knowledge: A cognitive learning or affective measure? Academy of Management Learning & Education, 9(2), 169–191. http://doi.org/10.5465/AMLE.2010.51428542
108.
*StansfieldC. W.GaoJ.RiversW. P. (2010).
A concurrent validity study of self-assessments and the federal: Interagency Language Roundtable oral proficiency interview. Russian Language Journal,
60, 299–315.
109.
*SummersM. M.CoxT. L.McMurryB. L.DeweyD. P. (2019).
Investigating the use of the ACTFL can-do statements in a self-assessment for student placement in an intensive English program. System,
80, 269–287. https://doi.org/10.1016/j.system.2018.12.012
110.
*SuzukiY. (2015).
Self-assessment of Japanese as a second language: The role of experiences in the naturalistic acquisition. Language Testing,
32(1), 63–81. https://doi.org/10.1177/0265532214541885
111.
*TigchelaarM. (2019). Exploring the relationship between self-assessments and OPIc ratings of oral proficiency in French. In WinkeP.GassS. (Eds.), Foreign language proficiency in higher education (pp. 153–173). Springer.
112.
*TrofimovichP.IsaacsT.KennedyS.SaitoK.CrowtherD. (2016).
Flawed self-assessment: Investigating self- and other-perception of second language speech. Bilingualism: Language and Cognition,
19(1), 122–140. https://doi.org/10.1017/S1366728914000832
113.
WigginsG. (1998). Educative assessment: Designing assessments to inform and improve student performance.
Jossey-Bass.
114.
*WilsonK. M. (1999).
Validity of global self-ratings of ESL speaking proficiency based on an FSI/ILR-reference scale. ETS Research Report Series,
1999(2), i–64. https://doi.org/10.1002/j.2333-8504.1999.tb01811.x
115.
*WolochukA. (2009).
Adult English learners’ self-assessment of second language proficiency: Contexts and conditions [Unpublished doctoral dissertation]. New York University.
116.
*ZhengH.HuangJ.ChenY. (2012).
Effects of self-assessment training on Chinese students’ performance on college English writing tests. Polyglossia,
23, 33–42.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
