This study investigated whether sub-auditory, infrasonic measures of vocal cord microtremors are sensitive to workload manipulations in a collaborative command and control task. Research participants performed 16 hours of simulated military command and control scenarios during which time task demand and access to collaborative tools were manipulated. NASA-TLX scores were used to assess subjective workload while infrasonic measures of vocal cord undulations were used as an objective measure of workload. The results of this study suggest that during high task demand trials infrasonic measures increased. In addition, during trials with access to collaborative tools that have previously been found to decrease subjective workload, infrasonic measures also decreased. Subjective workload scores and infrasonic measures were also found to correlate during trials. These results provide promising empirical evidence for the efficacy of this non-intrusive, non-invasive measure of operator workload.
CongletonJ.J.JonesW.A.ShiflettS.G.McsweenyK.P.HuchingsonR.D. (1997). An evaluation of voice stress analysis techniques in a simulated AWACS environment. International Journal of Speech Technology, 2, 61–69. doi:10.1007/BF02539823.
3.
EkstromR. B.FrenchJ. W.HarmanH. H.DermanD. (1976). Manual for kit of factor-referenced cognitive tests. Princeton, NJ: Educational Testing Services.
4.
FinomoreV.S.KnottB.A.NelsonW.T.GalsterS.M.BoliaR.S. (2007). The effects of multimodal collaboration technology on subjective workload profiles of tactical air battle management teams. Proceedings of the International Symposium on Aviation Psychology, 14, 190–196.
5.
FunkeG.J.RussellS.M.KnottB.A.MillerB.T. (2009). What can a multidimensional measure of stress tell us about team collaborative tools?Proceedings of the International Symposium on Aviation Psychology, 15, 480–485.
6.
GriffinG.R.WilliamsC.E. (1987). The effects of different levels of task complexity on three vocal measures. Aviation, Space, and Environmental Medicine, 1165–1170.
7.
HagmuellerM.RankE.KubinG. (2006). Evaluation of the human voice for indications of workload induced stress in the aviation environment (Project No. INO-1 AC STSS). Eurocontrol.
8.
HartS.G.StavelandL.E. (1988). Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In HancockP.A.MeshkatiN. (Eds.), Human mental workload (pp. 139–183). Amsterdam: Elsevier Science. doi:10.1016/S0166-4115(08)62386-9.
9.
HollienH.MichelJ.DohertyE. (1973). A method for analyzing vocal jitter in sustained phonation. Journal of Phonetics, 1, 85–91.
10.
HoriiY. (1979). Fundamental frequency perturbation observed in sustained phonation. Journal of Speech and Hearing Research, 22, 5–19.
11.
HoriiY. (1982). Jitter and shimmer differences among sustained vowel phonations. Journal of Speech and Hearing Research, 25, 12–14.
KeränenH.VäyrynenE.PääkkönenR.LeinoT.KuronenP.ToivanenJ.SeppänenT. (2004). Prosodic features of speech produced by military pilots during demanding tasks. SeppänenT.SuomiK.ToivainenJ. (Eds.), Fonetiikan päivät 2004 – The Phonetics Symposium, 2004 (pp. 88–91). University of Oulu.
14.
KoikeY. (1969). Vowel amplitude modulations in patients with laryngeal diseases. Journal of the Acoustic Society of America, 45, 839–844. doi:10.1121/1.1911554.
15.
KoikeY. (1973). Application of some acoustic measures for the evaluation of laryngeal dysfunction. Studia Phonologia, 7, 17–23.
LivelyS.E.PisoniD.B.SummersW.V.BernackiR.H. (1993). Effects of cognitive workload on speech production: Acoustic analyses and perceptual consequences. Journal of the Acoustic Society of America, 93, 2963–2972. doi:10.1121/1.405815.
18.
MacMillanJ.EntinE.B.HessK.P.PaleyM.J. (2004). Measuring performance in a scaled world: Lessons learned from the Distributed Dynamic Decisionmaking (DDD) synthetic team task. In SchiflettS.G.ElliottL.R.SalasE.CoovertM.D. (Eds.), Scaled worlds: Development, validation, and applications (pp. 154–180). Brookfield, VT: Ashgate.
19.
MurryT.DohertyE. T. (1977). Frequency perturbation and duration characteristics of pathological and normal speakers. Journal of the Acoustic Society of America, 62, 55. doi:10.1121/1.2016284.
PrinzoO.V. (1998). An analysis of voice communication in a simulated approach control environment (Report No. DOT/FAA/AM-97/17). Federal Aviation Administration, Office of Aviation Medicine. Washington, DC.
22.
RothkrantzL.J.M.WiggersP.van WeesJ.W.A.van VarkR.J. (2004). Voice stress analysis. Proceedings of the International Conference on Text, Speech, and Dialogue, 7, 449–456. doi: 10.1007/b100511.
23.
RuizR.LegrosC.GuellA. (1990). Voice analysis to predict the psychological or physical state of a speaker. Aviation, Space, and Environmental Medicine, 61, 266–71.
24.
SmithB.WeinbergB.FethL.HorriY. (1978). Vocal roughness and jitter characteristics of voices produced by esophageal speakers. Journal of Speech and Hearing Research, 21, 240–249.
25.
SteenekenH.J.M.HansenJ.H.L. (1999). Speech under stress conditions: Overview of the effect on speech production and of system performance. Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, 4, 2079–2082.
26.
TolkmittF.J.SchererK.R., 1986. Effect of experimentally induced stress on vocal parameters. Journal of Experimental Psychology Human Perception & Performance, 12, 302–313. doi:10.1037/0096–1523.12.3.302.
27.
WoodC.TorkkolaK.KundalkarS. (2004, September). Using driver's speech to detect cognitive workload. Paper presented at SPECOM 2004: 9th Conference, St. Petersburg, Russia.
