Facial Impressions Are Not Set in Stone: Voice-Driven Changes in Facial Representations Obtained via Reverse Correlation

Abstract

Research has shown that face-based impressions change when integrated with valence-inconsistent voices. Yet, it remains unclear whether listening to a voice also alters mental representations of faces. We tested this possibility using reverse correlation (RC) in two preregistered experiments with Italian Prolific users. In Experiment 1 (N = 61), participants formed impressions based on negative behavioral statements about a target person (Time 1) and completed the RC task to visualize face representations (classification images). Next, they formed new impressions on valence-(in)consistent voices (Time 2) before repeating the RC task. In Experiment 2 (N = 120), participants memorized a positive or negative face at Time 1 to measure spontaneous face impressions without requiring an explicit judgment. Classification images were created only after listening to valence-(in)consistent voices at Time 2. Across both experiments, independent judges rated the images (N_total = 140). Valence-inconsistent voices changed the perceived valence of the mental face representations. Implications for cross-modal impression formation are discussed.

Keywords

impression updating face voice reverse correlation cross-modal integration

Get full access to this article

View all access options for this article.

References

Axt

Siemers

Discepola

M. N.

Martinez

Xiao

Wehrli

(2023). The mind’s “aye”? Investigating overlap in findings produced by reverse correlation versus self-report. Journal of Experimental Social Psychology, 107, Article 104473. https://doi.org/10.1016/j.jesp.2023.104473

Brinkman

Todorov

Dotsch

(2017). Visualising mental representations: A primer on noise-based reverse correlation in social psychology. European Review of Social Psychology, 28(1), 333–361. https://doi.org/10.1080/10463283.2017.1381469

Bülthoff

Newell

F. N.

(2017). Crossmodal priming of unfamiliar faces supports early interactions between voices and faces in person perception. Visual Cognition, 25(4-6), 611–628. https://doi.org/10.1080/13506285.2017.1290729

Cone

Brown-Iannuzzi

J. L.

Lei

Dotsch

(2021a). Type I error is inflated in the two-phase reverse correlation procedure. Social Psychological and Personality Science, 12(5), 760–768. https://doi.org/10.1177/1948550620938616

Cone

Flaharty

Ferguson

M. J.

(2021b). The long-term effects of new evidence on implicit impressions of other people. Psychological Science, 32(2), 173–188. https://doi.org/10.1177/0956797620963559

Cone

Mann

T. C.

Ferguson

M. J.

(2017). Changing our implicit minds: How, when, and why implicit evaluations can be rapidly revised. Advances in Experimental Social Psychology, 56, 131–199. https://doi.org/10.1016/bs.aesp.2017.03.001

Dotsch

(2023). rcicr: Reverse correlation image classification toolbox (R package version 1.0.1). https://github.com/rdotsch/rcicr

Dotsch

Todorov

(2012). Reverse correlating social face perception. Social Psychological and Personality Science, 3(5), 562–571. https://doi.org/10.1177/1948550611430272

Dotsch

Wigboldus

D. H.

Langner

Van Knippenberg

(2008). Ethnic out-group faces are biased in the prejudiced mind. Psychological Science, 19(10), 978–980. https://doi.org/10.1111/j.1467-9280.2008.02186.x

10.

Dotsch

Wigboldus

D. H.

Van Knippenberg

A. D.

(2013). Behavioral information biases the expected facial appearance of members of novel groups. European Journal of Social Psychology, 43(1), 116–125. https://doi.org/10.1002/ejsp.1928

11.

Farley

(2025). Introduction to the special issue on innovations in vocal research: Insights from emotion, personality perception, eyewitness accuracy and persuasion. Journal of Nonverbal Behavior, 49, 3–7. https://doi.org/10.1007/s10919-025-00483-2

12.

Freeman

J. B.

Stolier

R. M.

Brooks

J. A.

(2020). Dynamic interactive theory as a domain-general account of social perception. Advances in Experimental Social Psychology, 61, 237–287. https://doi.org/10.1016/bs.aesp.2019.09.005

13.

Green

MacLeod

C. J.

(2016). Simr: an R package for power analysis of generalised linear mixed models by simulation. Methods in Ecology and Evolution, 7(4), 493–498. https://doi.org/10.1111/2041-210X.12504

14.

Klein

S. A.

Hutchings

R. J.

Todd

A. R.

(2021). Revising mental representations of faces based on new diagnostic information. Cognition, 217, Article 104916. https://doi.org/10.1016/j.cognition.2021.104916

15.

Kuhn

L. K.

Wydell

Lavan

McGettigan

Garrido

(2017). Similar representations of emotions across faces and voices. Emotion, 17(6), 912–937. https://doi.org/10.1037/emo0000282

16.

Kuznetsova

Brockhoff

P. B.

Christensen

R. H. B.

(2017). LmerTest package: Tests in linear mixed effects models. Journal of Statistical Software, 82(13), 1–26. https://doi.org/10.18637/jss.v082.i13

17.

Langner

Dotsch

Bijlstra

Wigboldus

D. H.

Hawk

S. T.

Van Knippenberg

A. D.

(2010). Presentation and validation of the Radboud Faces Database. Cognition and emotion, 24(8), 1377–1388. https://doi.org/10.1080/02699930903485076

18.

Lavan

(2023). How do we describe other people from voices and faces? Cognition, 230, Article 105253. https://doi.org/10.1016/j.cognition.2022.105253

19.

Lenth

R. V.

(2022). emmeans: Estimated marginal means, aka least-squares means (R package version 181-1). https://CRAN.R-project.org/package=emmeans

20.

D. S.

Correll

Wittenbrink

(2015). The Chicago face database: A free stimulus set of faces and norming data. Behavior Research Methods, 47(4), 1122–1135. https://doi.org/10.3758/s13428-014-0532-5

21.

Masi

Mattavelli

Fasoli

Brambilla

(2022). Cross-modal impression updating: Dynamic impression updating from face to voice and the other way around. British Journal of Social Psychology, 61(3), 808–825. https://doi.org/10.1111/bjso.12511

22.

Masi

Mattavelli

Fasoli

Brambilla

(2023). When faces and voices come together: Face width-to-height ratio and voice pitch contribute independently to social perception. European Journal of Social Psychology, 53(2), 323–335. https://doi.org/10.1002/ejsp.2905

23.

Masi

Mattavelli

Fasoli

Brambilla

(2024). Multi-modal cues to change your mind: The intertwining of faces, voices, and behaviors in impression updating. Personality and Social Psychology Bulletin. Advance online publication. https://doi.org/10.1177/01461672241273209

24.

Matuschek

Kliegl

Vasishth

Baayen

Bates

(2017). Balancing Type I error and power in linear mixed models. Journal of Memory and Language, 94, 305–315. https://doi.org/10.1016/j.jml.2017.01.001

25.

McAleer

Belin

(2018). The perception of personality traits from voices. In Fruholz

Belin

(Eds.), The Oxford handbook of voice perception (pp. 585–606). Oxford University Press. https://doi.org/10.1093/oxfordhb/9780198743187.013.26

26.

McAleer

Todorov

Belin

(2014). How do you say ‘Hello’? Personality impressions from brief novel voices. PLOS ONE, 9(3), Article e90779. https://doi.org/10.1371/journal.pone.0090779

27.

McArthur

L. Z.

Baron

R. M.

(1983). Toward and ecological theory of social perception. Psychological Review, 90(3), 215–238. https://doi.org/10.1037/0033-295X.90.3.215

28.

Mileva

(2025). Multimodal person evaluation: First impressions from faces, voices, and names. Journal of Personality and Social Psychology. Advance online publication. https://doi.org/10.1037/pspa0000454

29.

Nisbett

R. E.

Zukier

Lemley

R. E.

(1981). The dilution effect: Nondiagnostic information weakens the implications of diagnostic information. Cognitive Psychology, 13(2), 248–277. https://doi.org/10.1016/0010-0285(81)90010-4

30.

Perugini

Gallucci

Costantini

(2014). Safeguard power as a protection against imprecise power estimates. Perspectives on Psychological Science, 9(3), 319–332. https://doi.org/10.1177/1745691614528519

31.

Rezlescu

Penton

Walsh

Tsujimura

Scott

S. K.

Banissy

M. J.

(2015). Dominant voices and attractive faces: The contribution of visual and auditory information to integrated person impressions. Journal of Nonverbal Behavior, 39(4), 355–370. https://doi.org/10.1007/s10919-015-0214-8

32.

Rougier

De Houwer

(2025). Unconstraining evaluative conditioning research by using the reverse correlation task. Social Psychological and Personality Science, 16(3), 291–299. https://doi.org/10.1177/19485506231217526

33.

Schmitz

(2025). schmitz (R package version 0.1.3). https://github.com/matschmitz/schmitz

34.

Schmitz

Rougier

Yzerbyt

(2024). Introducing the brief reverse correlation: An improved tool to assess visual representations. European Journal of Social Psychology, 54(7), 1446–1461. https://doi.org/10.1002/ejsp.3100

35.

Shen

Maiolatesi

A. J.

Mann

T. C.

Ferguson

M. J.

(2023). The relation between updated implicit evaluations and the trust game. Social Psychological and Personality Science, 14(8), 911–921. https://doi.org/10.1177/19485506221141661

36.

Shen

Mann

T. C.

Ferguson

M. J.

(2020). Beware a dishonest face?: Updating face-based implicit impressions using diagnostic behavioral information. Journal of Experimental Social Psychology, 86, Article 103888. https://doi.org/10.1016/j.jesp.2019.103888

37.

Skowronski

J. J.

Carlston

D. E.

Hartnett

(2008). Spontaneous impressions derived from observations of behavior: What a long, strange trip it’s been (and it’s not over yet). In Ambady

Skowronski

J. J.

(Eds.), First impressions (pp. 313–333). Guilford Press.

38.

Sutherland

C. A.

Young

A. W.

(2022). Understanding trait impressions from faces. British Journal of Psychology, 113(4), 1056–1078. https://doi.org/10.1111/bjop.12583

39.

Todorov

Uddenberg

Albohn

D. N.

(2025). Face evaluation: Findings, methods, and challenges. Annals of the New York Academy of Sciences, 1545(1), 28–37. https://doi.org/10.1111/nyas.15293

40.

Todorov

Olivola

C. Y.

Dotsch

Mende-Siedlecki

(2015). Social attributions from faces: Determinants, consequences, accuracy, and functional significance. Annual Review of Psychology, 66, 519–545. https://doi.org/10.1146/annurev-psych-113011-143831

41.

Vives

M. L.

Frances

Baus

(2023). Automating weighing of faces and voices based on cue saliency in trustworthiness impressions. Scientific Reports, 13(1), Article 20037. https://doi.org/10.1038/s41598-023-45471-y

42.

Young

A. W.

Frühholz

Schweinberger

S. R.

(2020). Face and voice perception: Understanding commonalities and differences. Trends in Cognitive Sciences, 24(5), 398–410. https://doi.org/10.1016/j.tics.2020.02.001

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.05 MB