Processing Relationships Between Language-Being-Spoken and Other Speech Dimensions in Monolingual and Bilingual Listeners

Abstract

While indexical information is implicated in many levels of language processing, little is known about the internal structure of the system of indexical dimensions, particularly in bilinguals. A series of three experiments using the speeded classification paradigm investigated the relationship between various indexical and non-linguistic dimensions of speech in processing. Namely, we compared the relationship between a lesser-studied indexical dimension relevant to bilinguals, which language is being spoken (in these experiments, either Mandarin Chinese or English), with: talker identity (Experiment 1), talker gender (Experiment 2), and amplitude of speech (Experiment 3). Results demonstrate that language-being-spoken is integrated in processing with each of the other dimensions tested, and that these processing dependencies seem to be independent of listeners’ bilingual status or experience with the languages tested. Moreover, the data reveal processing interference asymmetries, suggesting a processing hierarchy for indexical, non-linguistic speech features.

Keywords

Speech perception bilingualism indexical information Garner task selective attention

Get full access to this article

View all access options for this article.

References

Abercrombie

(1967). Elements of general phonetics. Edinburgh, UK: Edinburgh University Press.

Adesope

O. O.

Lavin

Thompson

Ungerleider

(2010). A systematic review and meta-analysis of the cognitive correlates of bilingualism. Review of Educational Research, 80(2), 207–245.

Baayen

R. H.

(2008). Analyzing linguistic data: a practical introduction to statistics using R. Cambridge, UK: Cambridge University Press.

Bakeman

(2005). Recommended effect size statistics for repeated measures designs. Behavior Research Methods, 37(3), 379–384.

Ben-Artzi

Marks

L. E.

(1999). Processing linguistic and perceptual dimensions of speech: Interactions in speeded classification. Journal of Experimental Psychology: Human Perception and Performance, 25(3), 579−595.

Bialystok

Craik

F. I. M.

Klein

Viswanathan

(2004). Bilingualism, aging, and cognitive control: Evidence from the Simon task. Psychology and Aging, 19(2), 290−303.

Bialystok

Craik

F. I. M.

Luk

(2008). Cognitive control and lexical access in younger and older bilinguals. Journal of Experimental Psychology: Learning, Memory, and Cognition, 34(4), 859−873.

Bialystok

Craik

F. I.

Luk

(2012). Bilingualism: Consequences for mind and brain. Trends in Cognitive Sciences, 16(4), 240−250.

Bialystok

Martin

M. M.

(2004). Attention and inhibition in bilingual children: Evidence from the developmental change card sort task. Developmental Science, 7(3), 325−339.

10.

Bialystok

Martin

M. M.

Viswanathan

(2005). Bilingualism across the lifespan: The rise and fall of inhibitory control. International Journal of Bilingualism, 9(1), 103–119.

11.

Biederman

Checkosky

S. F.

(1970). Processing redundant information. Journal of Experimental Psychology, 83(3), 486−490.

12.

Bradlow

A. R.

Ackerman

Burchfield

L. A.

Hesterberg

Luque

J. S.

Mok

(2010). ALLSSTAR: Archive of L1 and L2 Scripted and Spontaneous Transcripts and Recordings. Department of Linguistics, Northwestern University. Retrieved from http://groups.linguistics.northwestern.edu/speech_comm_group/allsstar/index.html

13.

Bradlow

A. R.

Ackerman

Burchfield

Hesterberg

Luque

Mok

(2011). Language- and talker-dependent variation in global features of native and non-native speech. In Lee

W.-S.

Zee

(Eds.), Proceedings of the 17th International Congress of Phonetic Sciences [ICPhS 2011] (pp. 356−359). Hong Kong: Department of Chinese, Translation and Linguistics, City University of Hong Kong.

14.

Bradlow

A. R.

Nygaard

L. C.

Pisoni

D. B.

(1999). Effects of talker, rate, and amplitude variation on recognition memory for spoken words. Perception & Psychophysics, 61(2), 206−219.

15.

Bregman

M. R.

Creel

S. C.

(2014). Gradient language dominance affects talker learning. Cognition, 130(1), 85−95.

16.

Carrell

T. D.

Smith

L. B.

Pisoni

D. B.

(1981). Some perceptual dependencies in speeded classification of vowel color and pitch. Perception & Psychophysics, 29(1), 1−10.

17.

Childers

D. G.

(1991). Gender recognition from speech. Part II: Fine analysis. Journal of the Acoustical Society of America, 90(4), 1841−1856.

18.

Coleman

R. O.

(1971). Male and female voice quality and its relationship to vowel formant frequencies. Journal of Speech and Hearing Research, 14(3), 565−577.

19.

Cox

D. R.

Snell

E.J.

(Eds.) (1970). The analysis of binary data. 2nd edition. London, UK: Chapman & Hall.

20.

Cutler

Andics

Fang

(2011). Inter-dependent categorization of voices and segments. In Lee

W.-S.

Zee

(Eds.), Proceedings of the 17th International Congress of Phonetic Sciences [ICPhS 2011] (pp. 552−555). Hong Kong: Department of Chinese, Translation and Linguistics, City University of Hong Kong.

21.

Eimas

P. D.

Tartter

V. C.

Miller

J. L.

Keuthen

N. J.

(1978). Asymmetric dependencies in processing phonetic features. Perception & Psychophysics, 23(1), 12−20.

22.

Flege

J. E.

Eefting

(1988). Imitation of a VOT continuum by native speakers of English and Spanish: Evidence for phonetic category formation. Journal of the Acoustical Society of America, 83(2), 729−740.

23.

Fuller

C. D.

Gaudrain

Clarke

J. N.

Galvin

J. J.

Q. J.

Free

R. H.

Başkent

(2014). Gender categorization is abnormal in cochlear implant users. Journal of the Association for Research in Otolaryngology, 15(6), 1037–1048.

24.

Ganel

Goshen-Gottstein

(2004). Effects of familiarity on the perceptual integrality of the identity and expression of faces: The parallel-route hypothesis revisited. Journal of Experimental Psychology: Human Perception and Performance, 30(3), 583−597.

25.

Garner

W. R.

(1974). The processing of information and structure. Potomac, MD: Lawrence Erlbaum.

26.

Goggin

J. P.

Thompson

C. P.

Strube

Simental

L. R.

(1991). The role of language familiarity in voice identification. Memory & Cognition, 19(5), 448−458.

27.

Green

K. P.

Tomiak

G. R.

Kuhl

P. K.

(1997). The encoding of rate and talker information during phonetic perception. Attention, Perception, & Psychophysics, 59(5), 675−692.

28.

Hilchey

M. D.

Klein

R. M.

(2011). Are there bilingual advantages on nonlinguistic interference tasks? Implications for the plasticity of executive control processes. Psychonomic Bulletin & Review, 18(4), 625−658.

29.

Hillenbrand

J. M.

Clark

M. J.

(2009). The role of f 0 and formant frequencies in distinguishing the voices of men and women. Attention, Perception, & Psychophysics, 71(5), 1150–1166.

30.

Jaeger

T. F.

(2008). Categorical data analysis: Away from ANOVAs (transformation or not) and towards logit mixed models. Journal of Memory and Language, 59(4), 434−446.

31.

Jerger

Pearson

D. A.

Spence

M. J.

(1999). Developmental course of auditory processing interactions: Garner interference and Simon interference. Journal of Experimental Child Psychology, 74(1), 44−67.

32.

Jerger

Pirozzolo

Jerger

Elizondo

Desai

Wright

Reynosa

(1993). Developmental trends in the interaction between auditory and linguistic processing. Attention, Perception, & Psychophysics, 54(3), 310−320.

33.

Kaganovich

Francis

A. L.

Melara

R. D.

(2006). Electrophysiological evidence for early interaction between talker and linguistic information during speech perception. Brain Research, 1114(1), 161−172.

34.

Klatt

D. H.

Klatt

L. C.

(1990). Analysis, synthesis, and perception of voice quality variations among female and male talkers. Journal of the Acoustical Society of America, 87(2), 820−857.

35.

Köster

Schiller

N. O.

Künzel

H. J.

(1995). The influence of native-language background on speaker recognition. In Elenius

Branderud

(Eds.), Proceedings of the 13th International Congress of Phonetic Sciences [ICPhS13], August 13–19. (pp. 306−309). Stockholm, Sweden.

36.

Lawrence

M. A.

(2013). ez: Easy analysis and visualization of factorial experiments. R package version 4.2–2. Retrieved from http://CRAN.R-project.org/package=ez

37.

Lee

Nusbaum

H. C.

(1993). Processing interactions between segmental and suprasegmental information in native speakers of English and Mandarin Chinese. Perception & Psychophysics, 53(2), 157−165.

38.

Lisker

Abramson

A. S.

(1964). A cross-language study of voicing in initial stops: Acoustical measurements. Word, 20(3), 384−422.

39.

Maddox

W. T.

Ashby

F. G.

(1996). Perceptual separability, decisional separability, and the identification–speeded classification relationship. Journal of Experimental Psychology: Human Perception and Performance, 22(4), 795–817.

40.

Martin

C. S.

Mullennix

J. W.

Pisoni

D. B.

Summers

W. V.

(1989). Effects of talker variability on recall of spoken word lists. Journal of Experimental Psychology: Learning, Memory, and Cognition, 15(4), 676−684.

41.

Melara

R. D.

Marks

L. E.

(1990). Dimensional interactions in language processing: investigating directions and levels of crosstalk. Journal of Experimental Psychology: Learning, Memory, and Cognition, 16(4), 539−554.

42.

Miller

J. L.

(1978). Interactions in processing segmental and suprasegmental features of speech. Perception & Psychophysics, 24(2), 175−180.

43.

Mitchel

A. D.

Weiss

D. J.

(2010). What’s in a face? Visual contributions to speech segmentation. Language and Cognitive Processes, 25(4), 456−482.

44.

Mullennix

J. W.

Pisoni

D. B.

(1990). Stimulus variability and processing dependencies in speech perception. Perception & Psychophysics, 47(4), 379−390.

45.

Mullennix

J. W.

Pisoni

D. B.

Martin

C. S.

(1989). Some effects of talker variability on spoken word recognition. Journal of the Acoustical Society of America, 85(1), 365−378.

46.

Muthusamy

Y. K.

Jain

Cole

R. A.

(1994). Perceptual benchmarks for automatic language identification. In Acoustics, Speech, and Signal Processing, 1994. ICASSP-94. 1994 IEEE International Conference (Volme 1, pp. 1−333). IEEE.

47.

Nazzi

Bertoncini

Mehler

(1998). Language discrimination by newborns: toward an understanding of the role of rhythm. Journal of Experimental Psychology: Human Perception and Performance, 24(3), 756−766.

48.

Nusbaum

H. C.

Morin

T. M.

(1992). Paying attention to differences among talkers. In Tohkura

Sagisaka

Vatikiotis-Bateson

(Eds.), Speech perception, production and linguistic structure (pp. 113−134). Tokyo, Japan: OHM Publishing Company.

49.

Nygaard

L. C.

Sommers

M. S.

Pisoni

D. B.

(1994). Speech perception as a talker-contingent process. Psychological Science, 5(1), 42−46.

50.

Nygaard

L. C.

Sommers

M. S.

Pisoni

D. B.

(1995). Effects of stimulus variability on perception and representation of spoken words in memory. Attention, Perception, & Psychophysics, 57(7), 989−1001.

51.

Paap

K. R.

Greenberg

Z. I.

(2013). There is no coherent evidence for a bilingual advantage in executive processing. Cognitive Psychology, 66(2), 232−258.

52.

Peirce

C.S.

(1940). The philosophy of Peirce: selected writings. Buchler

(Ed.). London, UK: Kegan Paul, Trench, Trubner & Co.

53.

Perrachione

T. K.

Pierrehumbert

J. B.

Wong

P. C. M.

(2009). Differential neural contributions to native- and foreign-language talker identification. Journal of Experimental Psychology: Human Perception and Performance, 35(6), 1950−1960.

54.

Perrachione

T. K.

Wong

P. C. M.

(2007). Learning to recognize speakers of a non-native language: Implications for the functional organization of human auditory cortex. Neuropsychologia, 45(8), 1899−1910.

55.

Remez

R. E.

Fellowes

J. M.

Rubin

P. E.

(1997). Talker identification based on phonetic information. Journal of Experimental Psychology: Human Perception and Performance, 23(3), 651−666.

56.

Remez

R.E.

Rubin

P.E.

Pisoni

D.B.

Carrell

T.D.

(1981) Speech perception without traditional speech cues. Science, 212(4497), 947–949.

57.

Soli

S. D.

Wong

L. L. N.

(2008). Assessment of speech intelligibility in noise with the hearing in noise test. International Journal of Audiology, 47(6), 356−361.

58.

Stockmal

(1995). Discrimination of unknown foreign languages in spoken utterances: A developmental study. MA thesis. Ohio University, Athens, Ohio, USA.

59.

Stockmal

Muljani

Bond

(1996, October). Perceptual features of unknown foreign languages as revealed by multi-dimensional scaling. In Spoken Language, 1996. ICSLP 96. Proceedings, Fourth International Conference on (Vol. 3, pp. 1748−1751). Philadelphia, PA: IEEE.

60.

Skuk

V. G.

Schweinberger

S. R.

(2014). Influences of fundamental frequency, formant frequencies, aperiodicity, and spectrum level on the perception of voice gender. Journal of Speech, Language, and Hearing Research, 57(1), 285–296.

61.

Sundara

Scutellaro

(2011). Rhythmic distance between languages affects the development of speech perception in bilingual infants. Journal of Phonetics, 39(4), 505−513.

62.

Thompson

C. P.

(1987). A language effect in voice identification. Applied Cognitive Psychology, 1(2), 121−131.

63.

Tong

Francis

A. L.

Gandour

J. T.

(2008). Processing dependencies between segmental and suprasegmental features in Mandarin Chinese. Language and Cognitive Processes, 23(5), 689−708.

64.

Van Lancker

Kreiman

Wickens

T. D.

(1985). Familiar voice recognition: Patterns and parameters. Part II: Recognition of rate-altered voices. Journal of Phonetics, 13(1), 39−52.

65.

Vaughn

(2014). Language-being-spoken and other indexical dimensions in monolingual and bilingual speech processing. Doctoral dissertation, Northwestern University, Evanston, Illinois, USA. Retrieved from http://www.linguistics.northwestern.edu/documents/dissertations/linguistics-research-graduate-dissertations-vaughndissertation2014.pdf

66.

Vaughn

Bradlow

(2015). Processing relationships between language-being-spoken and other speech dimensions. In The Scottish Consortium for ICPhS 2015 (Ed.), Proceedings of the 18th International Congress of Phonetic Sciences. Glasgow, UK: University of Glasgow.

67.

Vaughn

Brouwer

(2013). Perceptual integration of indexical information in bilingual speech. In Proceedings of Meetings on Acoustics (Volume 19, No. 1, p. 060208). Acoustical Society of America.

68.

von Bastian

C. C.

Souza

A. S.

Gade

(2016). No evidence for bilingual cognitive advantages: A test of four hypotheses. Journal of Experimental Psychology: General, 145(2), 246–258.

69.

Walden

B. E.

Montgomery

A. A.

Gibeily

G. J.

Prosek

R. A.

Schwartz

D. M.

(1978). Correlates of psychological dimensions in talker similarity. Journal of Speech, Language, and Hearing Research, 21(2), 265−275.

70.

Weiss

D. J.

Gerfen

Mitchel

A. D.

(2009). Speech segmentation in a simulated bilingual environment: A challenge for statistical learning? Language Learning and Development, 5(1), 30−49.

71.

Wester

(2012). Talker discrimination across languages. Speech Communication, 54(6), 781−790.

72.

Winters

S. J.

Levi

S. V.

Pisoni

D. B.

(2008). Identification and discrimination of bilingual talkers across languages. Journal of the Acoustical Society of America, 123(6), 4524−4538.

73.

Wong

L. L. N.

Liu

Han

Huang

V. M.

Soli

S. D.

(2007). Development of two versions of the Mandarin Hearing In Noise Test (MHINT). Ear & Hearing, 28(Supplement 2), 70−74.

74.

Wood

C. C.

(1975). Auditory and phonetic levels of processing in speech perception: Neurophysiological and information-processing analyses. Journal of Experimental Psychology: Human Perception and Performance, 104(1), 3−20.

75.

Xie

Myers

(2015). The impact of musical training and tone language experience on talker identification. Journal of the Acoustical Society of America, 137(1), 419–432.