This study shows how advertisers can leverage emotion and attention to engage consumers in watching Internet video advertisements. In a controlled experiment, the authors assessed joy and surprise through automated facial expression detection for a sample of advertisements. They assessed concentration of attention through eye tracking and viewer retention by recording zapping behavior. This allows tests of predictions about the interplay of these emotions and interperson attention differences at each point in time during exposure. Surprise and joy effectively concentrate attention and retain viewers. However, importantly, the level rather than the velocity of surprise affects attention concentration most, whereas the velocity rather than the level of joy affects viewer retention most. The effect of joy is asymmetric, with higher gains for increases than losses for decreases. Using these findings, the authors develop representative emotion trajectories to support ad design and testing.
BartlettMarian Stewart, JosephC. Hager, EkmanPaul, and TerrenceJ. Sejnowski (1999), “Measuring Facial Expressions by Computer Image Analysis,”Psychophysiology, 36 (2), 253–63.
2.
BaumgartnerHans, SujanMita, and PadgettDan (1997), “Patterns of Affective Reactions to Advertisements: The Integration of MTM Responses into Overall Judgments,”Journal of Marketing Research, 34 (May), 219–32.
3.
CalvoManuel G., and PeterJ. Lang (2004), “Gaze Patterns When Looking at Emotional Pictures: Motivationally Biased Attention,”Motivation and Emotion, 28 (3), 221–43.
4.
ClarksonDouglas B., FraleyChris, GuCharles, and JamesO. Ramsay (2005), S + Functional Data Analysis User's Guide.New York: Springer.
5.
CohenIra, SebeNicu, GargAshutosh, LawrenceS. Chen, and ThomasS. Huang (2003), “Facial Expression Recognition from Video Sequences: Temporal and Static Modeling,”Computer Vision and Image Understanding, 91 (1/2), 160–87.
6.
DarwinCharles (1872), The Expression of the Emotions in Man and Animals.London: Murray.
7.
DerbaixChristian M. (1995), “The Impact of Affective Reactions on Attitudes Toward the Advertisement and the Brand: A Step Toward Ecological Validity,”Journal of Marketing Research, 32 (November), 470–79.
8.
EkmanPaul (1999), “Facial Expressions,” in Handbook of Cognition and Emotion, DalgleishTim, and MichaelJ. Power, eds. Chichester, UK: John Wiley & Sons, 301–320.
9.
EkmanPaul, and WallaceV. Friesen (1978), The Facial Action Coding System.Palo Alto, CA: Consulting Psychologists Press.
FredricksonBarbara L. (1998), “What Good Are Positive Emotions?”Review of General Psychology, 2 (3), 300–319.
12.
FredricksonBarbara L., and BraniganChristine (2005), “Positive Emotions Broaden the Scope of Attention and Thought–Action Repertoires,”Cognition and Emotion, 19 (3), 313–32.
13.
Frühwirth-SchnatterSilvia (1994), “Data Augmentation and Dynamic Linear Models,”Journal of Time Series Analysis, 15 (2), 183–202.
14.
GablePhilip A., and Harmon-JonesEddie (2008), “Approach-Motivated Positive Affect Reduces Breadth of Attention,”Psychological Science, 19 (5), 476–82.
15.
GelmanAndrew, and PardoeIain (2006), “Bayesian Measures of Explained Variance and Pooling in Multilevel (Hierarchical) Models,”Technometrics, 48 (2), 241–51.
16.
GermeysFilip, and d'YdewalleGéry (2007), “The Psychology of Film: Perceiving Beyond the Cut,”Psychological Research, 71 (4), 458–66.
17.
GewekeJohn (1992), “Evaluating the Accuracy of Sampling-Based Approaches to the Calculation of Posterior Moments,” in Bayesian Statistics, Vol. 4, BernardoJ.M., BergerJ., DawidA.P., and SmithA.F.M., eds. Oxford: Oxford University Press, 169–93.
18.
GoldenbergJacob, MazurskyDavid, and SolomonSorin (1999), “The Fundamental Templates of Quality Ads,”Marketing Science, 18 (3), 333–51.
19.
GriskeviciusVladas, ShiotaMichelle, and NowlisStephen (2010), “The Many Shades of Rose-Colored Glasses: An Evolutionary Approach to the Influence of Different Positive Emotions,”Journal of Consumer Research, 37 (August), 238–50.
20.
GrossJames J., and RossA. Thomson (2007), “Emotion Regulation: Conceptual Foundations,” in:Handbook of Emotion Regulation, JamesJ. Gross, ed. New York: Guilford Press, 3–26.
GustafsonPaul, and SiddarthS. (2007), “Describing the Dynamics of Attention to TV Commercials: A Hierarchical Bayes Analysis of the Time to Zap an Ad,”Journal of Applied Statistics, 34 (5), 585–609.
23.
HajcakGreg, and DoreenM. Olvet (2008), “The Persistence of Attention to Emotion: Brain Potentials During and After Picture Presentation,”Emotion, 8 (2), 250–55.
24.
HansenChristine H., and RanaldD. Hansen (1994), “Automatic Emotion: Attention and Facial Efference,” in The Heart's Eye: Emotional Influences in Perception and Attention, NiedenthalP.M., and KitayamaS., eds. San Diego: Academic Press, 217–43.
25.
HseeChristopher K., and RobertP. Abelson (1991), “Velocity Relation: Satisfaction as a Function of the First Derivative of Outcome over Time,”Journal of Personality and Social Psychology, 60 (March), 341–47.
26.
KahnemanDaniel (2000), “Evaluation by Moments: Past and Future,” in Choices, Values, and Frames, KahnemanD., and TverskyA., eds. Cambridge, UK: Cambridge University Press, 673–92.
27.
LemminkJos, and MattssonJan (1998), “Warmth During Nonproductive Retail Encounters: the Hidden Side of Productivity,”International Journal of Research in Marketing, 15 (5), 505–517.
28.
MeyerWulf-Uwe, ReisenzeinRainer, and SchützwohlAchim (1997), “Toward a Process Analysis of Emotions: The Case of Surprise,”Motivation and Emotion, 21 (3), 251–74.
29.
MihaylovaMilena, StomonyakovVladislav, and VassilevAngel (1999), “Peripheral and Central Delay in Processing High Spatial Frequencies: Reaction Time and VEP Latency Studies,”Vision Research, 39 (4), 699–705.
NummenmaaLauri, HyönäJukka, and ManuelG. Calvo (2009), “Emotional Scene Content Drives the Saccade Generation System Reflexively,”Journal of Experimental Psychology: Human Perception and Performance, 35 (2), 305–323.
32.
OlneyThomas J., MorrisB. Holbrook, and BatraRajeev (1991), “Consumer Responses to Advertising: The Effects of Ad Content, Emotions, and Attitude Toward the Ad on Viewing Time,”Journal of Consumer Research, 17 (March), 440–53.
33.
OlsenG. Douglas, and JohnW. Pracejus (2004), “Integration of Positive and Negative Affective Stimuli,”Journal of Consumer Psychology, 14 (4), 374–84.
34.
PlutchikRobert (1980), Emotion: A Psychoevolutionary Synthesis.New York: Harper & Row.
35.
RamsayJames O., HookerGiles, and GravesSpencer (2009), Functional Data Analysis with R and MATLAB.New York: Springer.
36.
SueyoshiGlen T. (1995), “A Class of Binary Response Models for Grouped Duration Data,”Journal of Applied Econometrics, 10 (4), 411–31.
37.
TeixeiraThales, WedelMichel, and PietersRik (2010), “Moment-to-Moment Optimal Branding in TV Commercials: Preventing Avoidance by Pulsing,”Marking Science, 29 (5), 783–804.
38.
TibshiraniRobert, WaltherGuenther, and HastieTrevor (2001), “Estimating the Number of Clusters in a Dataset via the Gap Statistic,”Journal of the Royal Statistics Society: Series B, 63 (2), 411–23.
39.
VakratsasDemetrios, and AmblerTim (1999), “How Advertising Works: What Do We Really Know?”Journal of Marketing, 63 (January) 26–43.
40.
WehrleThomas, KaiserSusanne, SchmidtSusanne, and KlausR. Scherer (2000), “Studying the Dynamics of Emotional Expression Using Synthesized Facial Muscle Movements,”Journal of Personality and Social Psychology, 78 (1), 105–119.
Woltman-ElpersJosephine L.C.M., WedelMichel, and RikG.M. Pieters (2003), “Why Do Consumers Stop Watching TV Commercials? Two Experiments on the Influence of Moment-to-Moment Entertainment and Information Value,”Journal of Marketing Research, 40 (November), 437–53.
43.
YiendJenny (2010), “The Effects of Emotion on Attention: A Review of Attentional Processing of Emotional Information,”Cognition and Emotion, 24 (1), 3–47.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
