This article outlines the development of a 16-item instrument for measuring language learner’s foreign language self-efficacy (SE) concerning their speaking and listening skills through repeated administrations to groups of Japanese tertiary students. Responses were analysed through the Rasch model, which allows researchers to investigate unidimensionality of each proposed component, as well as the functioning of individual items. Logit scores from Rasch were used for a regression analysis of listening SE with listening proficiency test data, and a correlation study with speaking SE and speaking proficiency scores of a subset of participants. The results suggest that the two proposed components in the instrument are unidimensional and are able to differentiate between different levels of SE among participants. Also, there are low to moderate correlations between learners’ aural/oral SE and their language proficiency.
AndrichD. (1978). Scaling attitude items constructed and scored in the Likert tradition. Educational and Psychological Measurement, 38, 665–680.
2.
AppleM.T.NeffP. (2012). Using Rasch measurement to validate the Big Five factor marker questionnaire for a Japanese university population. Journal of Applied Measurement, 13, 276–296.
3.
AppleM.HillG.FaloutJ. (2020). The relationship between future career self images and English achievement test scores of Japanese STEM students. IEEE Transactions on Professional Communication, 63, 372–385.
4.
AzizanN.H.MahmudZ.RambliA. (2020). Rasch rating scale item estimates using maximum likelihood approach: Effects of sample size on the accuracy and bias of the estimates. International Journal of Advanced Science and Technology, 29, 2526–2531.
5.
BanduraA. (1977). Self-efficacy: Toward a unifying theory of behavioral change. Psychological Review, 84, 191–215.
6.
BanduraA. (1997). Self-efficacy: The exercise of control. Freeman.
7.
BanduraA. (2006). Guide for constructing self-efficacy scales. In PajaresF.UrdanT.C. (Eds.), Self-efficacy beliefs of adolescents (pp. 307–337). Information Age Publishing.
8.
BondT.G.YanZ.HeeneM. (2021). Applying the Rasch model: Fundamental measurement in the human sciences. 4th edition.Routledge.
9.
BongM.SkaalvikE.M. (2003). Academic self-concept and self-efficacy: How different are they really?Educational Psychology Review, 15, 1–40.
10.
BurrowsL. (2013). The effects of extensive reading and reading strategies on reading self-efficacy [e-book]. Proquest Information & Learning.
11.
ChenG.GullyS.M.EdenD. (2001). Validation of a new general self-efficacy scale. Organizational Research Methods, 4, 62–83.
12.
DörnyeiZ. (2010). Questionnaires in second language research. 2nd edition.Routledge.
13.
DossC.Y.NairR. (2019). In search of order for teaching and learning English in the Malaysian classroom. In KweonS.-O.SpolskyB. (Eds.), The Asian EFL classroom: Issues, challenges, and future expectations (pp. 65–80). Routledge.
14.
Educational Testing Service. (2008). TOEIC test data and analysis 2007: Number of examinees and scores in FY2007. Institute for International Business Corporation, TOEIC Steering Committee.
15.
EmbertsonS.E.ReiseS.P. (2000). Item response theory for psychologists. Psychology Press.
16.
FieldA.P. (2009). Discovering statistics using SPSS. Sage.
17.
FunderD.C.OzerD.J. (2019). Evaluating effect size in psychological research: Sense and nonsense. Advances in Methods and Practices in Psychological Science, 2, 156–168.
18.
GorsuchG. (2009). Investigating second language learner self-efficacy and future expectancy of second language use for high-stakes program evaluation. Foreign Language Annals, 42, 505–540.
19.
GrahamS. (2007). Learner strategies and self-efficacy: Making the connection. Language Learning Journal, 35, 81–93.
20.
GrahamS.MacaroE. (2008). Strategy instruction in listening for lower-intermediate learners of French. Language Learning, 58, 747–783.
21.
GrahamS.WeinerB. (1996). Theories and principles of motivation. In BerlinerD.C.CalfeeR.C. (Eds.), Handbook of educational psychology (pp. 63–84). Simon & Schuster Macmillan.
22.
HarrisJ.LeemingP. (2022). The impact of teaching approach on growth in L2 proficiency and self-efficacy. A longitudinal classroom-based study of TBLT and PPP. Journal of Second Language Studies, 5, 114–143.
23.
HsiehP.KangH. (2010). Attribution and self-efficacy and their interrelationship in the Korean EFL context. Language Learning, 60, 606–627.
24.
KnochU.McNamaraT. (2015). Rasch analysis. In PlonskyL. (Ed.), Advancing quantitative methods in second language research (pp. 275–304). Routledge.
25.
KrosnickJ.A.FabrigarL.R. (1997). Designing rating scales for effective measurement in surveys. In LybergL.BiemerP.CollinsM. (Eds.), Survey measurement and process quality (pp. 141–164). Wiley-Interscience.
26.
LavrakasP.J. (2008). Encyclopedia of survey research methods. Sage.
27.
LiaoC.-W.QuY. (2010). Alternate forms test–retest reliability and test score changes for the TOEIC® speaking and writing tests. TOEIC Compendium TC-10-10. Educational Testing Service. Available at www.ets.org/Media/Research/pdf/TC-10-10.pdf (accessed April 2022).
LinacreJ.M. (2020). A user’s guide to WINSTEPS: Rasch-model computer program: 4.7.0. MESA.
30.
MacIntyreP.D.GregersenT. (2012). Affect: The role of language anxiety and other emotions in language learning. In MercerS.RyanS.WilliamsM. (Eds.), Language learning psychology: Research, theory and pedagogy (pp. 103–118). Palgrave.
31.
MagogweJ.M.OliverR. (2007). The relationship between language learning strategies, Proficiency, age and self-efficacy beliefs: A Study of language learners in Botswana. System, 35, 338–352.
MillsN. (2014). Self-efficacy in second language acquisition. In MercerS.WilliamsM. (Eds.), Multiple perspectives on the self in SLA (pp. 6–19). Multilingual Matters.
34.
MillsN.PajaresF.HerronC. (2006). A reevaluation of the role of anxiety: Self-efficacy, anxiety, and their relation to reading and listening proficiency. Foreign Language Annals, 39, 276–294.
35.
MillsN.PajaresF.HerronC. (2007). Self-efficacy of college intermediate French students: Relation to achievement and motivation. Language Learning, 57, 417–442.
36.
MoodieI.NamH. (2016). English language teaching research in South Korea: A review of recent studies (2009–2014). Language Teaching, 49, 63–98.
37.
MoriK.MoriH. (2013). Japanese are modest even when they are winner: Competence ratings of winner and losers in social comparison. Psychology, 4, 827–830.
38.
MurayamaK.PekrunR.LichtenfeldS.vom HofeR. (2013). Predicting long-term growth in adolescents’ mathematics achievement: The unique contributions of motivation and cognitive strategies. Child Development, 84, 1475–1490.
NielsonT. (2020). The specific academic learning self-efficacy and the specific academic exam self-efficacy scales: construct and criterion validity revisited using Rasch models. Cogent Education, 7, 1840009.
41.
OxfordR. (1989). Use of language learning strategies: a synthesis of studies with implications for strategy training. System, 17, 235–247.
42.
PajaresF.MillerM.D. (1994). Role of self-efficacy and self-concept beliefs in mathematical problem solving: A path analysis. Journal of Educational Psychology, 2, 193–203.
43.
PajaresF.SchunkD.H. (2001). Self-beliefs and school success: Self-efficacy, self-concept, and school achievement. In RidingR.J.RaynerS.G. (Eds.), Perception (pp. 239–266). Ablex.
44.
PancT.MihalceaA.PancI. (2012). Self-efficacy survey: A new assessment tool. Procedia – Social and Behaviorial Sciences, 33, 880–884.
45.
ParkerP.D.MarshH.W.CiarrochiJ.MarshallS.AbduljabbarA.S. (2014). Juxtaposing math self-efficacy and self-concept as predictors of long-term achievement outcomes. Educational Psychology, 34, 29–48.
46.
PintrichP.R.SmithD.A.F.GarciaT.McKeachieW.J. (1991). A manual for the use of the Motivated Strategies for Learning Questionnaire (MSLQ). University of Michigan, National Center for Research to Improve Postsecondary Teaching and Learning.
47.
PowersD.E.PowersA. (2015). The incremental contribution of TOEIC listening, reading, speaking, and writing tests to predicting performance on real-life English language tasks. Language Testing, 32, 151–167.
48.
QuY.Ricker-PedleyK.L. (2013). Monitoring individual rater performance for the TOEIC speaking and writing tests. In PowersD.E. (Ed.), The research foundation for the TOEIC tests: A compendium of studies: Volume 2 (pp. 9.1–9.9). Educational Testing Service.
49.
RaoN.MoelyB.E.SachsJ. (2000). Motivational beliefs, study strategies, and mathematics attainment in high- and low-achieving Chinese secondary school students. Contemporary Educational Psychology, 25, 287–316.
50.
RaoofiS.TanB.H.ChanS.H. (2012). Self-efficacy in second/foreign language learning contexts. English Language Teaching, 5, 60–73.
51.
RaîcheG. (2005). Critical eigenvalue sizes (variances) in standardized residual principal components analysis. Rasch Measurement Transactions, 19, 1012.
52.
RaschG. (1960). Probablistic models for some intelligence and attainment tests. Danmarks Paedagogiske Institut.
53.
SalzbergerT. (2010). Does the Rasch model convert an ordinal scale into an interval scale?Rasch Measurement Transactions, 24, 1273–1275.
54.
SchunkD.H.DiBenedettoM.K. (2016). Self-efficacy theory in education. In WentzelK.R.MieleD.B. (Eds.), Handbook of motivation at school (pp. 34–54). 2nd edition.Routledge.
55.
SermsongswadU.TantipongsanurukC. (2015). English language education in Thailand. In BigalkeT.W.SharbawiS., (Eds.), English for ASEAN integration: Policies and practices in the region (pp. 46–51). Universiti Brunei Darussalam.
56.
SimmsL.J.ZelaznyK.WilliamsT.F.BernsteinL. (2019). Does the number of response options matter? Psychometric perspectives using personality questionnaire data. Psychological Assessment, 31, 557–566.
57.
SmithR.M.MiaoC.Y. (1994). Assessing unidimensionality for Rasch measurement. In WilsonM. (Ed.), Objective measurement: Theory into practice: Volume 2 (pp. 316–327). Ablex.
58.
SmithR.M. (2000). Fit analysis in latent trait measurement models. Journal of Applied Measurement, 1, 199–218.
59.
StajkovicA.D.LuthansF. (1998). Self-efficacy and work-related performance: A meta-analysis. Psychological Bulletin, 124, 240–261.
60.
SteehC.G. (1981). Trends in nonresponse rates, 1952–1979. Public Opinion Quarterly, 59, 66–77.
61.
TabachnickB.G.FidellL.S. (2007). Using multivariate statistics. 5th edition.Allyn and Bacon.
62.
TemplinS.A. (1999). The relationship between self-efficacy and language learners’ grades. JALT Journal, 21, 112–124.
63.
TengL.S.SunP.P.XuL. (2018). Conceptualizing writing self-efficacy in English as a foreign language context: Scale validation through structural equation modeling. TESOL Quarterly, 52, 911–942.
64.
TilfarliogluF.T.CinkaraE. (2009). Self-efficacy in EFL: Differences among proficiency groups and relationship with success. Novitas-Royal, 3, 129–142.
65.
WangC. (2004). Self-regulated learning strategies and self-efficacy beliefs of children learning English as a second language. Doctoral dissertation, Ohio State University, Columbus, OH, USA. Available at: http://rave.ohiolink.edu/etdc/view?acc_num=osu1091546670 (accessed April 2022).
66.
WangC.KimD.BongM.AhnH.S. (2013). Examining measurement properties of an English self-efficacy scale for English language learners in Korea. International Journal of Educational Research, 59, 24–34.
67.
WangC.KimD.BaiR.HuJ. (2014). Psychometric properties of a self-efficacy scale for English language learners in China. System, 44, 24–33.
68.
WolfeE.W.Smith E.V. (2007). Instrument development tools and activities for measure validation using Rasch models: Part II – Validation activities. Journal of Applied Measurement, 8, 204–234.
69.
WongM.S. (2005). Language learning strategies and language self-efficacy: Investigating the relationship in Malaysia. Regional Language Centre Journal, 36, 245–269.
70.
WoodR.BanduraA. (1989). Impact of conceptions of ability on self-regulatory mechanisms and complex decision making. Journal of Personality and Social Psychology, 56, 407–415.
YashimaT.Zenuk-NishideL.ShimizuK. (2004). The influence of attitudes and affect on Willingness to Communicate and second language communication. Language Learning, 54, 119–152.
73.
Yavuz ErkanD.Y.SabanA.I. (2011). Writing performance relative to writing apprehension, self-Efficacy in writing, and attitudes towards writing: A correlational study in Turkish tertiary-level EFL. Asian EFL Journal, 5, 164–192.
74.
ZareM.Davoudi MobarakehS. (2011). The relationship between self-efficacy and use of reading strategies: The case of Iranian senior high school students. Studies in Literature and Language, 3, 98–105.
75.
ZhangS. (2006). Investigating the relative effects of persons, items, sections, and languages on TOEIC score dependability. Language Testing, 23, 351–369.
76.
ZimmermanB.J.BanduraA. (1994). Impact of self-regulatory influences on writing course attainment. American Educational Research Journal, 31, 845–862
