Exploring the optimal thresholds of silent pauses for measuring second language utterance fluency in monologic and dialogic speaking

Abstract

Second language (L2) utterance fluency is crucial for speaking proficiency assessment. The measurement of L2 utterance fluency relies heavily on silent pause identification. However, empirical studies establishing specific silent pause thresholds for L2 monologic speaking are scarce, and even fewer exist for L2 dialogic speaking. This study thus aims to explore the optimal silent pause threshold for measuring L2 utterance fluency in both speaking contexts. Following De Jong and Bosker, the study assumes that silent pause measures calculated at optimal thresholds can best predict L2 proficiency and perceived fluency. Multiple linear regression models were conducted using four silent pause measures (mid-Analysis of Speech Unit [ASU], silent pause rate, end-ASU silent pause rate, mid-ASU silent pause duration, end-ASU silent pause duration) at various thresholds (100–1000 ms) to predict participants’ L2 proficiency and perceived fluency scores. For the monologic task, silent pause measures calculated at a threshold of 200 ms best predicted both L2 proficiency and perceived fluency scores. For the dialogic task, silent pause measures calculated at a 200-ms threshold had the best predictive power for L2 proficiency score, whereas the optimal threshold for predicting the perceived fluency score was 350 ms.

Keywords

dialogic speaking monologic speaking silent pauses L2 speaking proficiency L2 utterance fluency

Get full access to this article

View all access options for this article.

References

Boersma

Weenink

(2020). Praat: Doing phonetics by computer (Version 6.1.36) [Computer software]. https://www.praat.org/

Bosker

H. R.

Pinget

A. F.

Quené

Sanders

De Jong

N. H.

(2013). What makes speech sound fluent? The contributions of pauses, speed and repairs. Language Testing, 30(2), 159–175. https://doi.org/10.1177/0265532212455394

Bowden

H. W.

(2016). Assessing second language oral proficiency for research: The Spanish elicited imitation task. Studies in Second Language Acquisition, 38(4), 647–675. https://doi.org/10.1017/S0272263115000443

Council of Europe. (2020). Common European framework of reference for languages: Learning, teaching, assessment—Companion volume. Council of Europe Publishing. https://www.coe.int/lang-cefr

De Jong

N. H.

Bosker

H. R

. (2013). Choosing a threshold for silent pauses to measure second language fluency. In Proceedings of the 6th Workshop on Disfluency in Spontaneous Speech (DiSS) (pp. 17–20). https://pure.mpg.de/rest/items/item_1900232_6/component/file_1900231/content

De Jong

N. H.

Mora

J. C

. (2019). Does having good articulatory skills lead to more fluent speech in first and second languages? Studies in Second Language Acquisition, 41(1), 227–239. https://doi.org/10.1017/S0272263117000389

Derwing

T. M.

Rossiter

M. J.

Munro

M. J.

Thomson

R. I.

(2004). Second language fluency: Judgments on different tasks. Language Learning, 54(4), 655–679. https://doi.org/10.1111/j.1467-9922.2004.00282.x

Deygers

(2020). Elicited imitation: A test for all learners? Examining the EI performance of learners with diverging educational backgrounds. Studies in Second Language Acquisition, 42(5), 933–957. https://doi.org/10.1017/S027226312000008X

Di Silvio

Diao

Donovan

. (2016). The development of L2 fluency during study abroad: A cross-language study. The Modern Language Journal, 100(3), 610–624. https://doi.org/10.1111/modl.12343

10.

Ducasse

A. M.

Brown

(2009). Assessing paired orals: Raters’ orientation to interaction. Language Testing, 26(3), 423–443. https://doi.org/10.1177/0265532209104669

11.

Duijm

Schoonen

Hulstijn

J. H.

(2018). Professional and non-professional raters’ responsiveness to fluency and accuracy in L2 speech: An experimental approach. Language Testing, 35(4), 501–527. https://doi.org/10.1177/0265532217712553

12.

Duran-Karaoz

Tavakoli

(2020). Predicting L2 fluency from L1 fluency behavior: The case of L1 Turkish and L2 English speakers. Studies in Second Language Acquisition, 42(4), 671–695. https://doi.org/10.1017/S0272263119000755

13.

Foster

Tonkyn

Wigglesworth

(2000). Measuring spoken language: A unit for all reasons. Applied Linguistics, 21, 354–375. https://doi.org/10.1093/applin/21.3.354

14.

Galaczi

E. D.

(2008). Peer-peer interaction in a speaking test: The case of the First Certificate in English examination. Language Assessment Quarterly, 5(2), 89–119. https://doi.org/10.1080/15434300801934702

15.

Gao

Sun

P. P.

(2023). To correct or not: The role of L1 fluency in understanding and measuring L2 fluency. TESOL Quarterly, 57(2), 643–655. https://doi.org/10.1002/tesq.3198

16.

Gao

(2024, December 16). Thresholds of silent pause in L2 monologic and dialogic speaking. Retrieved from osf.io/wbvzx

17.

Gao

Sun

P. P.

(2024). How does learners’ L2 utterance fluency relate to their L1? A meta-analysis. International Journal of Applied Linguistics, 34(1), 276–291. https://doi.org/10.1111/ijal.12493

18.

Ginther

Dimova

Yang

(2010). Conceptual and empirical relationships between temporal measures of fluency and oral English proficiency with implications for automated scoring. Language Testing, 27(3), 379–399. https://doi.org/10.1177/0265532210364407

19.

Hsieh

C. N.

(2019). Distinguishing features of young English language learners’ oral performance. Language Assessment Quarterly, 16(2), 180–195. https://doi.org/10.1080/15434303.2019.1605518

20.

Jin

(2022). The effects of topic familiarity on L2 oral production: An exploration into cognitive load. Foreign Language Education, 43(3), 67–74. https://doi.org/10.16362/j.cnki.cn61-1023/h.2022.03.004

21.

Han

(2021). Using unfilled pauses to measure (dis)fluency in English-Chinese consecutive interpreting: In search of an optimal pause threshold(s). Perspectives, 29(6), 917–933. https://doi.org/10.1080/0907676X.2020.1852293

22.

Handley

Z. L.

Wang

(2024). What do the measures of utterance fluency employed in automatic speech evaluation (ASE) tell us about oral proficiency? Language Assessment Quarterly, 21(1), 3–32. https://doi.org/10.1080/15434303.2023.2283839

23.

Huensch

Tracy-Ventura

(2017a). L2 utterance fluency development before, during, and after residence abroad: A multidimensional investigation. The Modern Language Journal, 101(2), 275–293. https://doi.org/10.1111/modl.12395

24.

Huensch

Tracy-Ventura

(2017b). Understanding second language fluency behavior: The effects of individual differences in first language fluency, cross-linguistic differences, and proficiency over time. Applied Psycholinguistics, 38(4), 755–785. https://doi.org/10.1017/S0142716416000424

25.

Isaacs

(2016). Assessing speaking. In Tsagari

Banerjee

(Eds.), Handbook of second language assessment (pp. 131–146). DeGruyter Mouton.

26.

Jensen

E. D.

Vinther

(2003). Exact repetition as input enhancement in second language acquisition. Language Learning, 53(3), 373–428. https://doi.org/10.1111/1467-9922.00230

27.

Kahng

(2014). Exploring utterance and cognitive fluency of L1 and L2 English speakers: Temporal measures and stimulated recall. Language Learning, 64(4), 809–854. https://doi.org/10.1111/lang.12084

28.

Kang

Yan

Kostromitina

Thomson

Isaacs

(2024). Fairness of using different English accents: The effect of shared L1s in listening tasks of the Duolingo English test. Language Testing, 41(2), 263–289. https://doi.org/10.1177/02655322231179134

29.

Khabbazbashi

(2017). Topic and background knowledge effects on performance in speaking assessment. Language Testing, 34(1), 23–48. https://doi.org/10.1177/0265532215595666

30.

Koo

T. K.

M. Y.

(2016). A guideline of selecting and reporting intraclass correlation coefficients for reliability research. Journal of Chiropractic Medicine, 15(2), 155–163. https://doi.org/10.1016/j.jcm.2016.02.012

31.

Kormos

(2006). Speech production and second language acquisition. Lawrence Erlbaum.

32.

Lambert

Kormos

Minn

(2017). Task repetition and second language speech processing. Studies in Second Language Acquisition, 39(1), 167–196. https://doi.org/10.1017/S0272263116000085

33.

Levelt

W. J. M.

(1989). Speaking: From intention to articulation. MIT Press.

34.

Chen

Sun

(2014). The effects of different lengths of pretask planning time on L2 learners’ oral test performance. TESOL Quarterly, 49(1), 38–66. https://doi/10.1002/tesq.159

35.

Matzinger

Ritt

Fitch

W. T.

(2020). Nonnative speaker pause patterns closely correspond to those of native speakers at different speech rates. PLOS ONE, 15(4), Article e0230710. https://doi.org/10.1371/journal.pone.0230710

36.

McCarthy

(2010). Spoken fluency revisited. English Profile Journal, 1, e4. https://doi.org/10.1017/s2041536210000012

37.

National College English Testing Committee. (2016). College English Test syllabus [Revised version]. Shanghai Jiao Tong University Press.

38.

Ortega

Iwashita

Norris

J. M.

Rabie

(2002, October). An investigation of elicited imitation tasks in crosslinguistic SLA research [Paper presentation]. The 20th Second Language Research Forum, Toronto, Ontario, Canada. https://www.iris-database.org/details/HAPZ2-KRwXl

39.

Peltonen

(2017). Temporal fluency and problem-solving in interaction: An exploratory study of fluency resources in L2 dialogue. System, 70, 1–13. https://doi.org/10.1016/j.system.2017.08.009

40.

Peltonen

(2018). Exploring connections between first and second language fluency: A mixed methods approach. The Modern Language Journal, 102(4), 676–692. https://doi.org/10.1111/modl.12516

41.

Peltonen

(2022). Connections between measured and assessed fluency in L2 peer interaction: A problem-solving perspective. International Review of Applied Linguistics in Language Teaching, 60(4), 983–1011. https://doi.org/10.1515/iral-2020-0030

42.

Préfontaine

(2013). Perceptions of French fluency in second language speech production. The Canadian Modern Language Review, 69(3), 324–348. https://doi.org/10.3138/cmlr.1748

43.

Préfontaine

Kormos

(2015). The relationship between task difficulty and second language fluency in French: A mixed methods approach. The Modern Language Journal, 99(1), 96–112. https://doi.org/10.1111/modl.12186

44.

Préfontaine

Kormos

(2016). A qualitative analysis of perceptions of fluency in second language French. International Review of Applied Linguistics in Language Teaching, 54(2), 151–169. https://doi.org/10.1515/iral-2016-9995

45.

Révész

Ekiert

Torgersen

E. N.

(2016). The effects of complexity, accuracy, and fluency on communicative adequacy in oral task performance. Applied Linguistics, 37(6), 828–848. https://doi.org/10.1093/applin/amu069

46.

Sacks

Schegloff

E. A.

Jefferson

(1974). A simplest systematics for the organization of turn taking for conversation. Language, 50(4), 696–735. https://doi.org/10.2307/412243

47.

Sato

(2014). Exploring the construct of interactional oral fluency: Second language acquisition and language testing approaches. System, 45(1), 79–91. https://doi.org/10.1016/j.system.2014.05.004

48.

Segalowitz

(2010). Cognitive bases of second language fluency. Routledge.

49.

Shea

Leonard

(2019). Evaluating measures of pausing for second language fluency research. Canadian Modern Language Review, 75(3), 216–235. https://doi.org/10.3138/cmlr.2018-0258

50.

Skehan

Foster

Shum

(2016). Ladders and snakes in second language fluency. International Review of Applied Linguistics in Language Teaching, 54(2), 97–111. https://doi.org/10.1515/iral-2016-9992

51.

Šturm

Volín

(2023). Occurrence and duration of pauses in relation to speech tempo and structural organization in two speech genres. Languages, 8, 23. https://doi.org/10.3390/languages8010023

52.

Suzuki

Kormos

(2020). Linguistic dimensions of comprehensibility and perceived fluency: An investigation of complexity, accuracy, and fluency in second language argumentative speech. Studies in Second Language Acquisition, 42(1), 143–167. https://doi.org/10.1017/S0272263119000421

53.

Suzuki

Kormos

(2023). The multidimensionality of second language oral fluency: Interfacing cognitive fluency and utterance fluency. Studies in Second Language Acquisition, 45(1), 38–64. https://doi.org/10.1017/S0272263121000899

54.

Suzuki

Kormos

Uchihara

(2021). The relationship between utterance and perceived fluency: A meta-analysis of correlational studies. The Modern Language Journal, 105(2), 435–463. https://doi.org/10.1111/modl.12706

55.

Suzuki

(2021). Optimizing fluency training for speaking skills transfer: Comparing the effects of blocked and interleaved task repetition. Language Learning, 71(2), 285–325. https://doi.org/10.1111/lang.12433

56.

Suzuki

Hanzawa

(2022). Massed task repetition is a double-edged sword for fluency development: An EFL classroom study. Studies in Second Language Acquisition, 44(2), 536–561. https://doi.org/10.1017/S0272263121000358

57.

Tavakoli

(2011). Pausing patterns: Differences between L2 learners and native speakers. ELT Journal, 65, 71–79. https://doi.org/10.1093/elt/ccq020

58.

Tavakoli

(2016). Fluency in monologic and dialogic task performance: Challenges in defining and measuring L2 fluency. International Review of Applied Linguistics in Language Teaching, 54(2), 133–150. https://doi.org/10.1515/iral-2016-9994

59.

Tavakoli

Kendon

Mazhurnaya

Ziomek

(2023). Assessment of fluency in the Test of English for Educational Purposes. Language Testing, 40(3), 607–629. https://doi.org/10.1177/02655322231151384

60.

Tavakoli

Nakatsuhara

Hunter

A. M.

(2020). Aspects of fluency across assessed levels of speaking proficiency. The Modern Language Journal, 104(1), 169–191. https://doi.org/10.1111/modl.12620

61.

Tavakoli

Skehan

(2005). Strategic planning, task structure, and performance testing. In Ellis

(Ed.), Planning and task performance (pp. 239–273). John Benjamins.

62.

Tavakoli

Wright

(2020). Second language speech fluency: From research to practice. Cambridge University Press.

63.

Thai

Boers

(2016). Repeating a monologue under increasing time pressure: Effects on fluency, complexity, and accuracy. TESOL Quarterly, 50(2), 369–393. https://doi.org/10.1002/tesq.232

64.

Trouvain

Werner

(2022). A phonetic view on annotating speech pauses and pause-internal phonetic particles. In Schwarze

Grawunder

(Eds.), Transkription und annotation gesprochener sprache und multimodaler interaktion: konzepte, probleme, lösungen (pp. 55–73). Gunter Narr Verlag.

65.

Van Os

De Jong

N. H.

Bosker

H. R.

(2020). Fluency in dialogue: Turn-Taking behavior shapes perceived fluency in native and nonnative speech. Language Learning, 70(4), 1183–1217. https://doi.org/10.1111/lang.12416

66.

Vercellotti

M. L.

(2017). The development of complexity, accuracy, and fluency in second language performance: A longitudinal study. Applied Linguistics, 38(1), 90–111. https://doi.org/10.1093/applin/amv002

67.

Werner

Jürgen

Bernd

(2022). Optionality and variability of speech pauses in read speech across languages and rates. In Proceedings of Speech Prosody 2022 (pp. 312–316). https://doi.org/10.21437/SpeechProsody.2022-64

68.

S. L.

Tio

Y. P.

Ortega

(2022). Elicited imitation as a measure of L2 proficiency. Studies in Second Language Acquisition, 44(1), 271–300. https://doi.org/10.1017/S0272263121000103

69.

Yan

Kim

H. R.

Kim

J. Y.

(2021). Dimensionality of speech fluency: Examining the relationships among complexity, accuracy, and fluency (CAF) features of speaking performances on the Aptis test. Language Testing, 38(4), 485–510. https://doi.org/10.1177/0265532220951508

70.

Yan

Maeda

Ginther

(2016). Elicited imitation as a measure of second language proficiency: A narrative review and meta-analysis. Language Testing, 33(4), 497–528. https://doi.org/10.1177/0265532215594643

71.

Zhang

(2022). Test review: College English Test–Spoken English Test (CET-SET). Studies in Language Assessment, 11(2), 164–180. https://arts.unimelb.edu.au/__data/assets/pdf_file/0008/4396265/SiLA_11.2_Test-review.pdf

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.10 MB

0.13 MB

0.11 MB