Mobile app users are often exposed to a sequence of short-lived marketing interventions (e.g., ads) within each usage session. This study examines how an increase in the variety of ads shown in a session affects a user's response to the next ad. The authors leverage the quasi-experimental variation in ad assignment in their data and propose an empirical framework that accounts for different types of confounding to isolate the effects of a unit increase in variety. Across a series of models, the authors consistently show that an increase in ad variety in a session results in a higher response rate to the next ad: holding all else fixed, a unit increase in variety of the prior sequence of ads can increase the click-through rate on the next ad by approximately 13%. The authors then explore the underlying mechanism and document empirical evidence for an attention-based account. The article offers important managerial implications by identifying a source of interdependence across ad exposures that is often ignored in the design of advertising auctions. Furthermore, the attention-based mechanism suggests that platforms can incorporate real-time attention measures to help advertisers with targeting dynamics.
AravindakshanAshwinPetersKayNaikPrasad A. (2012), “Spatiotemporal Allocation of Advertising Budgets,” Journal of Marketing Research, 49 (1), 1–14.
2.
ArnostiNickBeckMarissaMilgromPaul (2016), “Adverse Selection and Auction Design for Internet Display Advertising,” American Economic Review, 106 (10), 2852–66.
3.
BraunMichaelMoeWendy W. (2013), “Online Display Advertising: Modeling the Effects of Multiple Creatives and Individual Impression Histories,” Marketing Science, 32 (5), 753–67.
4.
BruceNorris I.MurthiB.P.S.RaoRam C. (2017), “A Dynamic Model for Digital Advertising: The Effects of Creative Format, Message Content, and Targeting on Engagement,” Journal of Marketing Research, 54 (2), 202–18.
5.
BucklinRandolph E.HobanPaul R. (2017), “Marketing Models for Internet Advertising,” in Handbook of Marketing Decision Models, Berend Wierenga and Ralf van der Lans, eds. Berlin: Springer, 431–62.
6.
CelisL. ElisaKapoorSayashSalehiFarnoodVishnoiNisheeth (2019), “Controlling Polarization in Personalization: An Algorithmic Framework,” in Proceedings of the Conference on Fairness, Accountability, and Transparency. New York: Association for Computing Machinery, 160–69.
7.
ChaeInyoungBrunoHernán A.FeinbergFred M. (2019), “Wearout or Weariness? Measuring Potential Negative Consequences of Online Ad Volume and Placement on Website Visits,” Journal of Marketing Research, 56 (1), 57–75.
8.
ChenTianqiGuestrinCarlos (2016), “XGBoost: A Scalable Tree Boosting System,” in Proceedings of the 22Nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. New York: Association for Computing Machinery, 785–94.
DanaherPeter J. (1995), “What Happens to Television Ratings During Commercial Breaks?” Journal of Advertising Research, 35 (1), 37–37.
11.
DanaherPeter J.MullarkeyGuy W. (2003), “Factors Affecting Online Advertising Recall: A Study of Students,” Journal of Advertising Research, 43 (3), 252–67.
12.
DanaherPeter J.van HeerdeHarald J. (2018), “Delusion in Attribution: Caveats in Using Attribution for Multimedia Budget Allocation,” Journal of Marketing Research, 55 (5), 667–85.
13.
DattaHannesKnoxGeorgeBronnenbergBart J. (2017), “Changing Their Tune: How Consumers’ Adoption of Online Streaming Affects Music Consumption and Discovery,” Marketing Science, 37 (1), 5–21.
14.
DeanSarahRichSarahRechtBenjamin (2020), “Recommendations and User Agency: The Reachability of Collaboratively-Filtered Information,” in Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency. New York: Association for Computing Machinery, 436–45.
15.
DengYitingMelaCarl F. (2018), “TV Viewing and Advertising Targeting,” Journal of Marketing Research, 55 (1), 99–118.
16.
DworkCynthiaHardtMoritzPitassiToniannReingoldOmerZemelRichard (2012), “Fairness Through Awareness,” in Proceedings of the 3rd Innovations in Theoretical Computer Science Conference. New York: Association for Computing Machinery, 214–26.
17.
EdelmanBenjaminOstrovskyMichaeSchwarzMichael (2007), “Internet Advertising and the Generalized Second-Price Auction: Selling Billions of Dollars Worth of Keywords,” American Economic Review, 97 (1), 242–59.
GodesDavidMayzlinDina (2004), “Using Online Conversations to Study Word-Of-Mouth Communication,” Marketing Science, 23 (4), 545–60.
22.
HanSuk WonMaroisRené (2014), “Functional Fractionation of the Stimulus-Driven Attention Network,” Journal of Neuroscience, 34 (20), 6958–69.
23.
HeXinranPanJunfengJinOuXuTianbingLiuBoXuTao, et al (2014), “Practical Lessons from Predicting Clicks on Ads at Facebook,” in Proceedings of the Eighth International Workshop on Data Mining for Online Advertising. New York: Association for Computing Machinery, 1–9.
24.
HelsonHarry (1948), “Adaptation-Level as a Basis for a Quantitative Theory of Frames of Reference,” Psychological Review, 55 (6), 297–313.
25.
HiranoKeisukeImbensGuido W.RidderGeert (2003), “Efficient Estimation of Average Treatment Effects Using the Estimated Propensity Score,” Econometrica, 71 (4), 1161–89.
26.
HochStephen J.BradlowEric T.WansinkBrian (1999), “The Variety of an Assortment,” Marketing Science, 18 (4), 527–46.
27.
JeziorskiPrzemyslawSegalIlya (2015), “What Makes Them Click: Empirical Analysis of Consumer Demand for Search Advertising,” American Economic Journal: Microeconomics, 7 (3), 24–53.
28.
KahnemanDaniel (1973), Attention and Effort. Englewood Cliffs, NJ: Prentice Hall.
29.
KimJaehwanAllenbyGreg M.RossiPeter E. (2002), “Modeling Consumer Demand for Variety,” Marketing Science, 21 (3), 229–50.
30.
LattimoreTorSzepesváriCsaba (2020), Bandit Algorithms. Cambridge, UK: Cambridge University Press.
31.
LiHongshuang (Alice)KannanP.K. (2014), “Attributing Conversions in a Multichannel Online Marketing Environment: An Empirical Model and a Field Experiment,” Journal of Marketing Research, 51 (1), 40–56.
32.
LingXiaoliangDengWeiweiGuChenZhouHuchengLiCuiSunFeng (2017), “Model Ensemble for Click Prediction in Bing Search Ads,” in Proceedings of the 26th International Conference on World Wide Web Companion. New York: Association for Computing Machinery, 689–98.
33.
LittleR.YauL. (1996), “Intent-to-Treat Analysis for Longitudinal Studies with Drop-Outs,” Biometrics, 52 (4), 1324–33.
34.
McAlisterLeigh (1982), “A Dynamic Attribute Satiation Model of Variety-Seeking Behavior,” Journal of Consumer Research, 9 (2), 141–50.
McMahanH. BrendanHoltGarySculleyD.YoungMichaelEbnerDietmarGradyJulian, et al (2013), “Ad Click Prediction: A View from the Trenches,” in Proceedings of the 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. New York: Association for Computing Machinery, 1222–30.
37.
MirrokniVahabMuthukrishnanS.NadavUri (2010), “Quasi-Proportional Mechanisms: Prior-Free Revenue Maximization,” in Latin American Symposium on Theoretical Informatics. New York: Springer, 565–76.
38.
NaikPrasad A.MantralaMurali K.SawyerAlan G. (1998), “Planning Media Schedules in the Presence of Dynamic Advertising Quality,” Marketing Science, 17 (3), 214–35.
39.
NairHarikesh S.MisraSanjogHornbuckle IVWilliam J.MishraRanjanAcharyaAnand (2017), “Big Data and Marketing Analytics in Gaming: Combining Empirical Models and Field Experimentation,” Marketing Science, 36 (5), 699–725.
40.
PietersRikRosbergenEdwardWedelMichel (1999), “Visual Attention to Repeated Print Advertising: A Test of Scanpath Theory,” Journal of Marketing Research, 36 (4), 424–38.
41.
RafieianOmid (2020), “Revenue-Optimal Dynamic Auctions for Adaptive Ad Sequencing,” working paper, https://omidraf.github.io/data/AdSeqAuction.pdf.
42.
RafieianOmid (2022), “Optimizing User Engagement Through Adaptive Ad Sequencing.” working paper.
43.
RafieianOmidYoganarasimhanHema (2021), “Targeting and Privacy in Mobile Advertising,” Marketing Science, 40 (2), 193–218.
44.
RatnerRebecca K.KahnBarbara E.KahnemanDaniel (1999), “Choosing Less Preferred Experiences for the Sake of Variety,” Journal of Consumer Research, 26 (1), 1–15.
45.
ReddenJoseph P. (2008), “Reducing Satiation: The Role of Categorization Level,” Journal of Consumer Research, 34 (5), 624–34.
46.
RosenbaumPaul R.RubinDonald B. (1983), “The Central Role of the Propensity Score in Observational Studies for Causal Effects,” Biometrika, 70 (1), 41–55.
47.
RutzOliver J.BucklinRandolph. E. (2011), “From Generic to Branded: A Model of Spillover in Paid Search Advertising,” Journal of Marketing Research, 48 (1), 87–102.
48.
SahniNavdeep S. (2015), “Effect of Temporal Spacing Between Advertising Exposures: Evidence from Online Field Experiments,” Quantitative Marketing and Economics, 13 (3), 203–47.
49.
SahniNavdeep S. (2016), “Advertising Spillovers: Evidence from Online Field Experiments and Implications for Returns on Advertising,” Journal of Marketing Research, 53 (4), 459–78.
50.
SchumannDavid W.PettyRichard E.Scott ClemonsD. (1990), “Predicting the Effectiveness of Different Strategies of Advertising Variation: A Test of the Repetition-Variation Hypotheses,” Journal of Consumer Research, 17 (2), 192–202.
51.
TellisGerard J. (2003), Effective Advertising: Understanding When, How, and Why Advertising Works. Thousand Oaks, CA: SAGE Publications.
52.
TheocharousGeorgiosThomasPhilip S.GhavamzadehMohammad (2015), “Personalized Ad Recommendation Systems for Life-Time Value Optimization with Guarantees,” in Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence. New York: Association for Computing Machinery, 1806–12.
53.
TuchmanAnna E.NairHarikesh S.GardetePedro M. (2018), “Television Ad-Skipping, Consumption Complementarities and the Consumer Demand for Advertising,” Quantitative Marketing and Economics, 16 (2), 111–74.
54.
TunuguntlaSrinivasHobanPaul R. (2021), “A Near-Optimal Bidding Strategy for Real-Time Display Advertising Auctions,” Journal of Marketing Research, 58 (1), 1–21.
55.
VarianHal R. (2007), “Position Auctions,” International Journal of Industrial Organization, 25 (6), 1163–78.
56.
WilburKenneth C. (2008), “A Two-Sided Empirical Model of Television Advertising and Viewing Markets,” Marketing Science, 27 (3), 356–78.
57.
WilburKenneth C. (2016), “Advertising Content and Television Advertising Avoidance,” Journal of Media Economics, 29 (2), 51–72.
58.
WilburKenneth C.XuLinliKempeDavid (2013), “Correcting Audience Externalities in Television Advertising,” Marketing Science, 32 (6), 892–912.
59.
YaoSongMelaCarl F. (2011), “A Dynamic Model of Sponsored Search Advertising,” Marketing Science, 30 (3), 447–68.
60.
YoganarasimhanHema (2013), “The Value of Reputation in an Online Freelance Marketplace,” Marketing Science, 32 (6), 860–91.
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
