Daily conversation is usually face-to-face and characterized by rapid and fluent exchange of turns between interlocutors. With the need to communicate across long distances, advances in communication media, online audio communication, and online video communication have become convenient alternatives for an increasing number of people. However, the fluency of turn-taking may be influenced when people communicate using these different modes. In this study, we conducted a corpus analysis of face-to-face, online audio, and online video conversations collected from the internet. The fluency of turn-taking in face-to-face conversations differed from that of online audio and video conversations. Namely, the timing of turn-taking was shorter and with more overlaps in face-to-face conversations compared with online audio and video conversations. This can be explained by the limited ability of online communication modes to transmit non-verbal cues and network latency. In addition, our study could not completely exclude the effect of formality of conversation. The present findings have implications for the rules of turn-taking in human online conversations, in that the traditional rule of no-gap–no-overlap may not be fully applicable to online conversations.
BaayenR. H.DavidsonD. J.BatesD. M. (2008). Mixed-effects modelling with crossed random effects for subjects and items. Journal of Memory and Language, 59(4), 390–412. https://doi.org/10.1371/journal.pone.0099019
2.
BailensonJ. N. (2021). Nonverbal overload: A theoretical argument for the causes of Zoom fatigue. Technology, Mind, and Behaviour, 2(1), 1–6. https://doi.org/10.1037/tmb0000030
3.
BakerD. A.BurnsD. M.Reynolds-KuenyC. (2020). Just sit back and watch: Large disparities between video and face-to-face interview observers in applicant ratings. International Journal of Human–Computer Interaction, 36(4), 1–12. https://doi.org/10.1080/10447318.2020.1805874
4.
BaltesB. B.DicksonM. W.ShermanM. P.BauerC. C.LaGankeJ. S. (2002). Computer-mediated communication and group decision making: A meta-analysis. Organizational Behavior and Human Decision Processes, 87(1), 156–179. https://doi.org/10.1006/obhd.2001.2961
5.
BarthelM.SauppeS. (2019). Speech planning at turn transitions in dialog is associated with increased processing load. Cognitive Science, 43(7), Article e12768. https://doi.org/10.1111/cogs.12768
6.
BavelasJ. B.ChovilN. (2000). Visible acts of meaning: An integrated message model of language use in face-to-face dialogue. Journal of Language and Social Psychology, 19(2), 163–194. https://doi.org/10.1177/0261927x00019002001
7.
BinderJ. F.CebulaK.MetwallyS.VernonM.AtkinC.MitraS. (2019). Conversational engagement and mobile technology use. Computers in Human Behavior, 99, 66–75. https://doi.org/10.1016/j.chb.2019.05.016
8.
BögelsS. (2020). Neural correlates of turn-taking in the wild: Response planning starts early in free interviews. Cognition, 203(2020), Article 104347. https://doi.org/10.1016/j.cognition.2020.104347
9.
BögelsS.KendrickK. H.LevinsonS. C. (2015). Never say no . . . How the brain interprets the pregnant pause in conversation. PLoS ONE, 10(12), Article e0145474. https://doi.org/10.1371/journal.pone.0145474
10.
BögelsS.LevinsonS. C. (2017). The brain behind the response: Insights into turn-taking in conversation from neuroimaging. Research on Language and Social Interaction, 50, 71–89. https://doi.org/10.1080/08351813.2017.1262118
11.
BögelsS.TorreiraF. (2015). Listeners use intonational phrase boundaries to project turn ends in spoken interaction. Journal of Phonetics, 52(2015), 46–57. https://doi.org/org/10.1016/j.wocn.2015.04.004
12.
BögelsS.TorreiraF. (2021). Turn-end estimation in conversational turn-taking: The roles of context and prosody. Discourse Processes, 58(10), 903–924. https://doi.org/org/10.1080/0163853X.2021.1986664
13.
BolandJ. E.FonsecaP.MermelsteinI.WilliamsonM. (2022). Zoom disrupts the rhythm of conversation. Journal of Experimental Psychology: General, 151(6), 1272–1282. https://doi.org/10.1037/xge0001150
14.
CaoB.LinW.-Y. (2017). Revisiting the contact hypothesis: Effects of different modes of computer-mediated communication on intergroup relationships. International Journal of Intercultural Relations, 58, 23–30. https://doi.org/10.1016/j.ijintrel.2017.03.003
15.
CassellJ.NakanoY. I.BickmoreT. W.SidnerC. L.RichC. (2001, July6–11). Non-verbal cues for discourse structure. In Association for Computational Linguistic, 39th Annual Meeting and 10th Conference of the European Chapter, Proceedings of the Conference (pp. 114–123). https://doi.org/10.3115/1073012.1073028
16.
ChenC. L.ZhangB. (2000). Modern Chinese sentences. East China Normal University Press.
CloughS.DuffM. C. (2020). The role of gesture in communication and cognition: Implications for understanding and treating neurogenic communication disorders. Frontiers in Human Neuroscience, 14. https://doi.org/10.3389/fnhum.2020.00323
19.
CorpsR. E.CrossleyA.GambiC.PickeringM. J. (2018). Early preparation during turn-taking: Listeners use content predictions to determine what to say but not when to say it. Cognition, 175, 77–95. https://doi.org/10.1016/j.cognition.2018.01.015
20.
CorpsR. E.GambiC.PickeringM. J. (2017). Coordinating utterances during turn-taking: The role of prediction, response preparation, and articulation. Discourse Processes, 55(2), 230–240. https://doi.org/10.1080/0163853x.2017.1330031
21.
DaftR. L.LengelR. H.TrevinoL. K. (1987). Message equivocality, media selection, and manager performance: Implications for information systems. MIS Quarterly, 11(3), 355–366. https://doi.org/10.2307/248682
22.
de RuiterJ. P.MittererH.EnfieldN. J. (2006). Projecting the end of a speaker’s turn: A cognitive cornerstone of conversation. Language, 82(3), 515–535. https://doi.org/10.1353/lan.2006.0130
23.
DingQ. (2020). Comparative analysis and research on interrogative sentences in Chinese, French and Malagasy [Master’s thesis]. Jiangxi Normal University.
24.
DuncanS. (1972). Some signals and rules for taking speaking turns in conversation. Journal of Personality and Social Psychology, 23(2), 283–292. https://doi.org/10.1037/h0033031
25.
FerreiraF. (1991). Effects of length and syntactic complexity on initiation times for prepared utterances. Journal of Memory and Language, 30(2), 210–233. https://doi.org/10.1016/0749-596X(91)90004-4
26.
FurukawaH.NishidaM.JokinenK.YamamotoS. (2011, October26–28). A multimodal corpus for modeling turn management in multi-party conversations. In 14th Annual International Conference on Speech Database and Assessments, Oriental COCOSDA 2011, Hsinchu, Taiwan (pp. 142–146). https://doi.org/10.1109/icsda.2011.6085996
27.
GarrodS.PickeringM. J. (2015). The use of content and timing to predict turn transitions. Frontiers in Psychology, 6, 1–12. https://doi.org/10.3389/fpsyg.2015.00751
28.
GeigerI. (2020). From letter to Twitter: A systematic review of communication media in negotiation. Group Decision and Negotiation, 29(3), 207–250. https://doi.org/10.1007/s10726-020-09662-6
29.
GerwingJ.AllisonM. (2009). The relationship between verbal and gestural contributions in conversation: A comparison of three methods. Gesture, 9(3), 312–336. https://doi.org/10.1075/gest.9.3.03ger
30.
GratierM.DevoucheE.GuellaiB.InfantiR.YilmazE.Parlato-OliveiraE. (2015). Early development of turn-taking in vocal interaction between mothers and infants. Frontiers in Psychology, 6, Article 1167. https://doi.org/10.3389/fpsyg.2015.01167
31.
HassellM. D.CottonJ. L. (2017). Some things are better left unseen: Toward more effective communication and team performance in video-mediated interactions. Computers in Human Behavior, 73, 200–208. https://doi.org/10.1016/j.chb.2017.03.039
HollerJ.KendrickK. H.LevinsonS. C. (2017). Processing language in face-to-face conversation: Questions with gestures get faster responses. Psychonomic Bulletin and Review, 25(5), 1900–1908. https://doi.org/10.3758/s13423-017-1363-z
34.
JongmanS. R. (2021). The attentional demands of combining comprehension and production in conversation. Psychology of Learning and Motivation, 74, 95–140. https://doi.org/10.1016/bs.plm.2021.02.003
KendrickK. H. (2015). The intersection of turn-taking and repair: The timing of other-initiations of repair in conversation. Frontiers in Psychology, 6, Article 250. https://doi.org/10.3389/fpsyg.2015.00250
38.
KendrickK. H.HollerJ. (2017). Gaze direction signals response preference in conversation. Research on Language and Social Interaction, 50(1), 12–32. https://doi.org/10.1080/08351813.2017.1262120
39.
KendrickK. H.TorreiraF. (2015). The timing and construction of preference: A quantitative study. Discourse Processes, 52(4), 255–289. https://doi.org/10.1080/0163853X.2014.955997
40.
KosmalaL.CribleL. (2021). The dual status of filled pauses: Evidence from genre, proficiency and co-occurrence. Language and Speech, 65(4), 1–24. https://doi.org/10.1177/00238309211010862
LevinsonS. C. (2016). Turn-taking in human communication—Origins and implications for language processing. Trends in Cognitive Sciences, 20(1), 6–14. https://doi.org/10.1016/j.tics.2015.10.010
43.
LevinsonS. C.HollerJ. (2014). The origin of human multi-modal communication. Philosophical Transactions of the Royal Society B, 369(1651), 20130302. https://doi.org/10.1098/rstb.2013.0302
44.
LevinsonS. C.TorreiraF. (2015). Timing in turn-taking and its implications for processing models of language. Frontiers in Psychology, 6, Article 731. https://doi.org/10.3389/fpsyg.2015.00731
45.
LindsayL.GambiC.RabagliatiH. (2019). Preschoolers optimize the timing of their conversational turns through flexible coordination of language comprehension and production. Psychological Science, 30(4), 504–515. https://doi.org/10.1177/0956797618822802
46.
LiuH. (2004). Analysis of conversational structure. Peking University Press.
47.
LiuY. T. (2007). The rudiments of conversation analysis. Xue Lin Press.
48.
MagyariL.De RuiterJ. P.LevinsonS. C. (2017). Temporal preparation for speaking in question-answer sequences. Frontiers in Psychology, 8, Article 211. https://doi.org/10.3389/fpsyg.2017.00211
49.
McKennaK. Y. A.SeidmanG. (2005). Social identity and the self: Getting connected online. In WalkerW. R.HermannD. (Eds.), Cognitive technology: Essays on the transformation of thought and society (pp. 89–110). MacFarland and Company.
50.
MeredithJ. (2020). Conversation analysis, cyberpsychology and online interaction. Social and Personality Psychology Compass, 14, Article e12529. https://doi.org/10.1111/spc3.12529
51.
MeyerM.ChungH.DebnathR.FoxN.WoodwardA. L. (2022). Social context shapes neural processing of others’ actions in 9-month-old infants. Journal of Experimental Child Psychology, 213, Article 105260. https://doi.org/10.1016/j.jecp.2021.105260
52.
MondadaL. (2016). Challenges of multimodality: Language and the body in social interaction. Journal of Sociolinguistics, 20(3), 336–366. https://doi.org/10.1111/josl.1_12177
53.
NeibergD.GustafsonJ. (2011, August28–31). Predicting speaker changes and listener responses with and without eye-contact [Conference session]. INTERSPEECH 2011, 12th annual conference of the International Speech Communication Association, Florence, Italy.
54.
NguyenD. T.CannyJ. (2009, April4–9). More than face-to-face: Empathy effects of video framing [Conference session]. Proceedings of the 27th international conference on human factors in computing systems-CHI 2009, Boston, MA, United States. https://doi.org/10.1145/1518701.1518770
55.
RamirezA.Jr.BurgoonJ. K. (2004). The effect of interactivity on initial interactions: The influence of information valence and modality and information richness on computer-mediated interaction. Communication Monographs, 71(4), 422–447. https://doi.org/10.1080/0363452042000307461
56.
R Core Team. (2020). R: A language and environment for statistical computing. R Foundation for Statistical Computing. Available at: https://www.R-project.org/
57.
RobertsS. G.TorreiraF.LevinsonS. C. (2015). The effects of processing and sequence organization on the timing of turn taking: A corpus study. Frontiers in Psychology, 6, Article 509. https://doi.org/10.3389/fpsyg.2015.00509
58.
RuskF.PörnM. (2019). Delay in L2 interaction in video-mediated environments in the context of virtual tandem language learning. Linguistics and Education, 50, 56–70. https://doi.org/10.1016/j.linged.2019.02.003
59.
SacksH.SchegloffE. A.JeffersonG. (1974). A simplest systematics for the organization of turn-taking for conversation. Language, 50(4), 696–735. https://doi.org/10.1353/lan.1974.0010
60.
SchegloffE. A. (2002). Opening sequencing. In KatzJ. E.AakhusM. (Eds.), Perpetual contact: Mobile communication, private talk, public performance (pp. 326–385). Cambridge University Press.
61.
SeurenL. M.WhertonJ.GreenhalghT.ShawS. E. (2021). Whose turn is it anyway? Latency and the organization of turn-taking in video-mediated interaction. Journal of Pragmatics, 172(4), 63–78. https://doi.org/10.1016/j.pragma.2020.11.005
62.
SjerpsM. J.MeyerA. S. (2015). Variation in dual-task performance reveals late initiation of speech planning in turn-taking. Cognition, 136, 304–324. https://doi.org/10.1016/j.cognition.2014.10.008
63.
SkantzeG. (2021). Turn-taking in conversational systems and human-robot interaction: A review. Computer Speech & Language, 67(2021), Article 101178. https://doi.org/org/10.1016/j.csl.2020.101178
64.
SprecherS. (2014). Initial interactions online-text, online-audio, online-video, or face-to-face: Effects of modality on liking, closeness, and other interpersonal outcomes. Computers in Human Behavior, 31, 190–197. https://doi.org/10.1016/j.chb.2013.10.029
65.
SternD. N.GibbonJ. (1979). Temporal expectancies of social behaviours in mother-infant play. In ThomanE. B. (Ed.), Origins of the infant’s social responsiveness (pp. 409–429). Lawrence Erlbaum.
66.
StiversT.EnfieldN. J.BrownP.EnglertC.HayashiM.HeinemannT.HoymannG.RossanoF.de RuiterJ. P.YoonK.-E.LevinsonS. C. (2009). Universals and cultural variation in turn-taking in conversation. Proceedings of the National Academy of Sciences of the United States of America, 106(26), 10587–10592. https://doi.org/10.1073/pnas.0903616106
67.
SzekrényesI.KovácsG. (2017). Classification of formal and informal dialogues based on turn-taking and intonation using deep neural networks. In KarpovA.PotapovaR.MporasI. (Eds.), Speech and computer (pp. 233–243). Springer International Publishing. https://doi.org/10.1007/978-3-319-66429-3-22
68.
TanakaK.NakanishiH.IshiguroH. (2015). Physical embodiment can produce robot operator’s pseudo presence. Frontiers in ICT, 2(8), 1–12. https://doi.org/10.3389/fict.2015.00008
ten BoschL.OostdijkN.BovesL. (2005). On temporal aspects of turn-taking in conversational dialogues. Speech Communication, 47(1–2), 80–86. https://doi.org/10.1016/j.specom.2005.05.009
71.
ten BoschL.OostdijkN.de RuiterJ. P. (2004). Durational aspects of turn-taking in spontaneous face-to-face and telephone dialogues. Lecture Notes in Computer Science, 3206, 563–570. https://doi.org/10.1007/978-3-540-30120-2_71
72.
ter BekkeM.DrijversL.HollerJ. (2020). The predictive potential of hand gestures during conversation: An investigation of the timing of gestures in relation to speech. In Gesture and speech in interaction (GESPIN2020) (pp. 1–6). https://doi.org/10.31234/osf.io/b5zq7
73.
TorreiraF.BögelsS. (2022). Vocal reaction times to speech offsets: Implications for processing models of conversational turn-taking. Journal of Phonetics, 94(2022), Article 101175. https://doi.org/org/10.1016/j.wocn.2022.101175
74.
TorreiraF.BögelsS.LevinsonS. C. (2015). Breathing for answering: The time course of response planning in conversation. Frontiers in Psychology, 6, Article 284. https://doi.org/10.3389/fpsyg.2015.00284
75.
VilhelmsonB.ThulinE.ElldérE. (2016). Where does time spent on the internet come from? Tracing the influence of information and communications technology use on daily activities. Information, Communication & Society, 20(2), 1–14. https://doi.org/10.1080/1369118x.2016.1164741
76.
WangT.-Y.KawaguchiI.KuzuokaH.OtsukiM. (2018). Effect of manipulated amplitude and frequency of human voice on dominance and persuasiveness in audio conferences. Proceedings of the ACM on human-computer interaction, 2(CSCW), 1–18. https://doi.org/10.1145/3274446
77.
WeilhammerK.RaboldS. (2003, August3–9). Durational aspects in turn taking [Conference session]. Proceedings of the international conference of phonetic sciences (pp. 2145–2148). Barcelona, Spain.
78.
WenZ. L.ZhangH. O. U. J. T.LiuH. Y. (2004). Testing and application of the mediating effects. Acta Psychologica Sinica, 36(5), 614–620. https://doi.org/10.1007/BF02911031
79.
WheatleyD. J.BasapurS. (2011). Concept evaluation and usability testing of a TV based video communications system. Entertainment Computing, 2(3), 163–173. https://doi.org/10.1016/j.entcom.2011.03.003
80.
WibisonoB.HaryonoA. (2022). Turn-taking in conversation uttered by Madurese community in Jember. JOALL (Journal of Applied Linguistics and Literature), 7(2), 345–361. https://doi.org/org/10.33369/joall.v7i2.20773
81.
WilsonM.WilsonT. P. (2005). An oscillator model of the timing of turn-taking. Psychonomic Bulletin & Review, 12(6), 957–968. https://doi.org/10.3758/bf03206432
82.
WilsonT. P.ZimmermanD. H. (1986). The structure of silence between turns in two-party conversation. Discourse Processes, 9(4), 375–390. https://doi.org/10.1080/01638538609544649
83.
WittenburgP.BrugmanH.RusselA.KlassmannA.SloetjesH. (2006). ELAN: A professional framework for multimodality research. In Proceedings of the fifth international conference on language resources and evaluation (pp. 1556–1559). http://tla.mpi.nl/tools/tla-tools/elan/
84.
XiJ. (2011). The status quo of college students’ online communication and the characteristics of their psychological needs [Master’s thesis]. Shaanxi Normal University.
YangY. M. (2019). A preliminary study on the translation of modal particle “啊”” in the English versions of teahouse [Master’s thesis]. Guangxi University.
87.
YuG. D.WuY. X. (2016). A research proposal of speech acts in Mandarin from conversation analytic perspective. Journal of Shanxi University (Philosophy & Social Science), 39(4), 45–48.
88.
ZengQ. Y. (2019). A contrastive study of the interrogative in Chinese and Vietnamese [Doctoral dissertation]. Central China Normal University.
89.
ZhengS. Y. (2015). Research on WeChat chat language [Master’s thesis]. Xi’an International Studies University.
ZubekJ.NagórskaE.Komorowska-MachJ.SkowrońskaK.ZielińskiK.Rączaszek-LeonardiJ. (2022). Dynamics of remote communication: Movement coordination in video-mediated and face-to-face conversations. Entropy, 24(4), 559. https://doi.org/10.3390/e24040559
