Vocal-Stress Diary: A Longitudinal Investigation of the Association of Everyday Work Stressors and Human Voice Features

Abstract

The human voice conveys plenty of information about the speaker. A prevalent assumption is that stress-related changes in the human body affect speech production, thus affecting voice features. This suggests that voice data may be an easy-to-capture measure of everyday stress levels and can thus serve as a warning signal of stress-related health consequences. However, previous research is limited (i.e., has induced stress only through artificial tasks or has investigated only short-term or extreme stressors), leaving it open whether everyday work stressors are associated with voice features. Thus, our participants (111 adult working individuals) took part in a 1-week diary study (Sunday until Sunday), in which they provided voice messages and self-report data on daily work stressors. Results showed that work stressors were associated with voice features such as increased speech rate and voice intensity. We discuss theoretical, practical, and ethical implications regarding the voice as an indicator of psychological states.

Keywords

stress human voice diary study work stressors well-being multivariate Bayesian analyses open data open materials

Get full access to this article

View all access options for this article.

References

Bakker

A. B.

Demerouti

(2017). Job demands–resources theory: Taking stock and looking forward. Journal of Occupational Health Psychology, 22(3), 273–285. https://doi.org/10.1037/ocp0000056

Boersma

Van Heuven

(2001). Speak and unSpeak with PRAAT. Glot International, 5(9–10), 341–347.

Boersma

Weenink

(2019). PRAAT: Doing phonetics by computer (Version 6.1.38) [Computer software]. http://www.praat.org/

Brantley

P. J.

Waggoner

C. D.

Jones

G. N.

Rappaport

N. B.

(1987). A daily stress inventory: Development, reliability, and validity. Journal of Behavioral Medicine, 10(1), 61–73. https://doi.org/10.1007/BF00845128

Bürkner

P.-C.

(2017). brms: An R package for Bayesian multilevel models using Stan. Journal of Statistical Software, 80(1). https://doi.org/10.18637/jss.v080.i01

DeLongis

Coyne

J. C.

Dakof

Folkman

Lazarus

R. S.

(1982). Relationship of daily hassles, uplifts, and major life events to health status. Health Psychology, 1(2), 119–136. https://doi.org/10.1037/0278-6133.1.2.119

Engel

J. B.

(2017, September 13). MIT spinout Affectiva adds voice analysis to its emotion-sensing tech. Xconomy. https://xconomy.com/boston/2017/09/13/mit-spinout-affectiva-adds-voice-analysis-to-its-emotion-sensing-tech/

Giannakakis

Grigoriadis

Giannakaki

Simantiraki

Roniotis

Tsiknakis

(2022). Review on psychological stress detection using biosignals. IEEE Transactions on Affective Computing, 13(1), 440–460. https://doi.org/10.1109/TAFFC.2019.2927337

Giddens

C. L.

Barron

K. W.

Byrd-Craven

Clark

K. F.

Winter

A. S.

(2013). Vocal indices of stress: A review. Journal of Voice, 27(3), 390.e21–390.e29. https://doi.org/10.1016/j.jvoice.2012.12.010

10.

Giddens

C. L.

Barron

K. W.

Clark

K. F.

Warde

W. D.

(2010). Beta-adrenergic blockade and voice: A double-blind, placebo-controlled trial. Journal of Voice, 24(4), 477–489. https://doi.org/10.1016/j.jvoice.2008.12.002

11.

Goodday

S. M.

Friend

(2019). Unlocking stress and forecasting its consequences with digital technology. npj Digital Medicine, 2(1), Article 75. https://doi.org/10.1038/s41746-019-0151-8

12.

Hassard

Teoh

K. R. H.

Visockaite

Dewe

Cox

(2018). The cost of work-related stress to society: A systematic review. Journal of Occupational Health Psychology, 23(1), 1–17. https://doi.org/10.1037/ocp0000069

13.

Kamilog˘lu

R. G.

Fischer

A. H.

Sauter

D. A.

(2020). Good vibrations: A review of vocal expressions of positive emotions. Psychonomic Bulletin & Review, 27(2), 237–265. https://doi.org/10.3758/s13423-019-01701-x

14.

Kosmala

(2018). AutoResponder (Version 0.9.7) [Mobile app]. https://www.autoresponder.ai/

15.

Krohne

H. W.

Egloff

Kohlmann

C.-W.

Tausch

(1996). Untersuchungen mit einer Deutschen Version der “Positive and Negative Affect Schedule” (PANAS) [Investigations with a German version of the Positive and Negative Affect Schedule (PANAS)]. Diagnostica, 42(2), 139–156.

16.

Lass

N. J.

Almerino

C. A.

Jordan

L. F.

Walsh

J. M.

(1980). The effect of filtered speech on speaker race and sex identifications. Journal of Phonetics, 8(1), 101–112. https://doi.org/10.1016/S0095-4470(19)31445-7

17.

Frauendorfer

Rabbi

Schmid Mast

Chittaranjan

G. T.

Campbell

A. T.

Gatica-Perez

Choudhury

(2012). StressSense: Detecting stress in unconstrained acoustic environments using smartphones. In H.-H. Chu & G. Hayes (Program Chairs), Proceedings of the 2012 ACM Conference on Ubiquitous Computing (pp. 351–360). Association for Computing Machinery. https://doi.org/10.1145/2370216.2370270

18.

McElreath

(2020). Statistical rethinking: A Bayesian course with examples in R and Stan (2nd ed.). Chapman and Hall. https://doi.org/10.1201/9780429029608

19.

Mendoza

Carballo

(1998). Acoustic analysis of induced vocal stress by means of cognitive workload tasks. Journal of Voice, 12(3), 263–273. https://doi.org/10.1016/S0892-1997(98)80017-9

20.

Metzenthin

Helfricht

Loerbroks

Terris

D. D.

Haug

H. J.

Subramanian

S. V.

Fischer

J. E.

(2009). A one-item subjective work stress assessment tool is associated with cortisol secretion levels in critical care nurses. Preventive Medicine, 48(5), 462–466. https://doi.org/10.1016/j.ypmed.2009.02.001

21.

Mohr

D. C.

Zhang

Schueller

S. M.

(2017). Personal sensing: Understanding mental health using ubiquitous sensors and machine learning. Annual Review of Clinical Psychology, 13, 23–47. https://doi.org/10.1146/annurev-clinpsy-032816-044949

22.

Mundt

J. C.

Snyder

P. J.

Cannizzaro

M. S.

Chappie

Geralts

D. S.

(2007). Voice acoustic measures of depression severity and treatment response collected via interactive voice response (IVR) technology. Journal of Neurolinguistics, 20(1), 50–64. https://doi.org/10.1016/j.jneuroling.2006.04.001

23.

Peifer

Schulz

Schächinger

Baumann

Antoni

C. H.

(2014). The relation of flow-experience and physiological arousal under stress—Can u shape it? Journal of Experimental Social Psychology, 53, 62–69. https://doi.org/10.1016/j.jesp.2014.01.009

24.

Pisanski

Kobylarek

Jakubowska

Nowak

Walter

Błaszczyn´ski

Kasprzyka

Łysenkoa

Sukiennike

Pia˛teka

Frackowiak

Sorokowski

(2018). Multimodal stress detection: Testing for covariation in vocal, hormonal and physiological responses to Trier Social Stress Test. Hormones and Behavior, 106, 52–61. https://doi.org/10.1016/j.yhbeh.2018.08.014

25.

Pisanski

Nowak

Sorokowski

(2016). Individual differences in cortisol stress response predict increases in voice pitch during exam stress. Physiology & Behavior, 163, 234–238. https://doi.org/10.1016/j.physbeh.2016.05.018

26.

Ptacek

P. H.

Sander

E. K.

(1966). Age recognition from voice. Journal of Speech and Hearing Research, 9(2), 273–277. https://doi.org/10.1044/jshr.0902.273

27.

R Core Team. (2020). R: A language and environment for statistical computing (Version 3.6.3) [Computer software]. R Foundation for Statistical Computing. http://www.R-project.org

28.

Ruiz

Legros

Guell

(1990). Voice analysis to predict the psychological or physical state of a speaker. Aviation, Space, and Environmental Medicine, 61(3), 266–271.

29.

Satow

(2012). SCI - Stress- und Coping-Inventar [SCI – Stress and coping inventory]. Leibniz-Zentrum für Psychologische Information und Dokumentation (ZPID), Elektronisches Testarchiv (Psyndex Tests-Nr. 9006508). https://doi.org/10.23668/psycharchives.424

30.

Scherer

K. R.

(1986). Vocal affect expression: A review and a model for future research. Psychological Bulletin, 99(2), 143–165. https://doi.org/10.1037/0033-2909.99.2.143

31.

Scherer

K. R.

(2003). Vocal communication of emotion. Speech Communication, 40(1–2), 227–256. https://doi.org/10.1016/S0167-6393(02)00084-5

32.

Scherer

K. R.

Grandjean

Johnstone

Klasmeyer

Bänziger

(2002). Acoustic correlates of task load and stress. In Hansen

J. H. L.

Pellom

(Eds.), Proceedings of the International Conference on Spoken Language Processing (pp. 2017–2020). International Speech Communication Association.

33.

Schuller

B. W.

(2018). Speech emotion recognition: Two decades in a nutshell, benchmarks, and ongoing trends. Communications of the ACM, 61(5), 90–99. https://doi.org/10.1145/3129340

34.

Slavich

G. M.

Taylor

Picard

R. W.

(2019). Stress measurement using speech: Recent advancements, validation issues, and ethical and privacy considerations. Stress, 22(4), 408–413. https://doi.org/10.1080/10253890.2019.1584180

35.

Sondhi

Khan

Vijay

Salhan

A. K.

(2015). Vocal indicators of emotional stress. International Journal of Computer Applications, 122(15), 38–43. https://doi.org/10.5120/21780-5056

36.

Thompson

E. R.

(2007). Development and validation of an internationally reliable short-form of the Positive and Negative Affect Schedule (PANAS). Journal of Cross-Cultural Psychology, 38(2), 227–242. https://doi.org/10.1177/0022022106297301

37.

Tolkmitt

F. J.

Scherer

K. R.

(1986). Effect of experimentally induced stress on vocal parameters. Journal of Experimental Psychology: Human Perception and Performance, 12(3), 302–313. https://doi.org/10.1037/0096-1523.12.3.302

38.

Traue

H. C.

Hrabal

Kosarz

(2000). AlltagsBelastungsFragebogen (ABF): Zur inneren Konsistenz, Validierung und Stressdiagnostik mit dem deutschsprachigen Daily Stress Inventory [Daily Stress Inventory: Reliability, validity and stress diagnostic with a German version of the Daily Stress Inventory]. Verhaltenstherapie und Verhaltensmedizin, 21(1), 15–38.

39.

Watson

(1988). Intraindividual and interindividual analyses of positive and negative affect: Their relation to health complaints, perceived stress, and daily activities. Journal of Personality and Social Psychology, 54(6), 1020–1030. https://doi.org/10.1037/0022-3514.54.6.1020

40.

Zhang

(2016). Mechanics of human voice production and control. Journal of the Acoustical Society of America, 140(4), 2614–2635. https://doi.org/10.1121/1.4964509

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.05 MB