Online review platforms often present reviews from both critics and general users. In this research, the authors propose a measure called “topic consistency” to capture the degree of overlap between critic and user review content. High topic consistency suggests greater information recall due to repeated presentation of the same topics, which may increase the memorability of movie attributes and therefore positively affect movie demand. The authors measure the topic consistency between critic and user reviews using topic models and further study the financial consequences of this measure using data for movies released in the United States. Topic consistency is positively associated with subsequent box office revenue, suggesting a positive relationship between topic consistency and movie demand. Furthermore, the effect of topic consistency on demand is the greatest for movies with mediocre review ratings and when the review ratings from critics are close to those from users. Using lab experiments, the authors provide evidence of the causal link between topic consistency and consumers’ willingness to watch a movie, and support for the potential mediation through the information recall of reviews. Movie producers and advertisers should consider highlighting or inducing a central theme for critics and users to discuss, as the more the review content of critics and users overlaps, the higher a movie's revenue.
AlbaJoseph W.HutchinsonWesley J.LynchJohn G. (1991), “Memory and Decision Making,” in Handbook of Consumer Theory and Research, KassarjianHarold H.RobertsonThomas S., eds. Prentice Hall, 1–49.
2.
AmbleeNaveenBuiTung (2007), “Freeware Downloads: An Empirical Investigation into the Impact of Expert and User Reviews on Demand for Digital Goods,” AMCIS 2007 Proceedings, 21, https://aisel.aisnet.org/amcis2007/21.
3.
Babić RosarioAnaSotgiuFrancescaDe ValckKristineBijmoltTammo H.A. (2016), “The Effect of Electronic Word of Mouth on Sales: A Meta-Analytic Review of Platform, Product, and Metric Factors,” Journal of Marketing Research, 53 (3), 297–318.
4.
BasuroySumanChatterjeeSubimalRavidAbraham S. (2003), “How Critical Are Critical Reviews? The Box Office Effects of Film Critics, Star Power, and Budgets,” Journal of Marketing, 67 (4), 103–17.
5.
BergerJonahHumphreysAshleeLudwigStephanMoeWendy W.NetzerOdedSchweidelDavid A. (2020), “Uniting the Tribes: Using Text for Marketing Insight,” Journal of Marketing, 84 (1), 1–25.
6.
BleiDavid M.LaffertyJohn D. (2009), “Topic Models,” in Text Mining: Classification, Clustering, and Applications, SrivastavaAshok N.SahamiMehran, eds. Chapman & Hall/CRC, 71–94.
7.
BleiDavid M.NgAndrew Y.JordanMichael I. (2003), “Latent Dirichlet Allocation,” Journal of Machine Learning Research, 3 (January), 993–1022.
8.
BoatwrightPeter H.KamakuraWagnerBasuroySuman (2007), “Reviewing the Reviewers: The Impact of Individual Film Critics on Box Office Performance,” Quantitative Marketing and Economics, 5 (4), 401–25.
9.
BurmesterAlexa B.BeckerJan U.van HeerdeHarald J.ClementMichel (2015), “Pre- and Post-Launch Effects of Publicity and Advertising on Sales,” International Journal of Research in Marketing, 32 (4), 408–17.
10.
BurtchGordonHongYiliBapnaRaviGriskeviciusVladas (2018), “Stimulating Online Reviews by Combining Financial Incentives and Social Norms,” Management Science, 64 (5), 2065–82.
11.
BuschkenJoachimAllenbyGreg M. (2016), “Sentence-Based Text Analysis for Customer Reviews,” Marketing Science, 35 (6), 953–75.
12.
CacioppoJohn T.PettyRichard E. (1980), “Persuasiveness of Communications Is Affected by Exposure Frequency and Message Quality: A Theoretical and Empirical Analysis of Persisting Attitude Change,” Current Issues and Research in Advertising, 3 (1), 97–122.
13.
ChakravartyAninditaLiuYongMazumdarTridib (2010), “The Differential Effects of Online Word-of-Mouth and Critics’ Reviews on Pre-Release Movie Evaluation,” Journal of Interactive Marketing, 24 (3), 185–97.
ChenYuboLiuYongZhangJurui (2012), “When Do Third-Party Product Reviews Affect Firm Value and What Can Firms Do? The Case of Media Critics and Professional Movie Reviews,” Journal of Marketing, 76 (2), 116–34.
16.
ChenYuboXieJinhong (2008), “Online Consumer Reviews: Word-of-Mouth as a New Element of Marketing Communication Mix,” Management Science, 54 (3), 477–91.
17.
ChevalierJudith A.MayzlinDina (2006), “The Effect of Word of Mouth on Sales: Online Book Reviews,” Journal of Marketing Research, 43 (3), 345–54.
18.
ChintaguntaPradeep K.GopinathShyamVenkataramanSriram (2010), “The Effects of Online User Reviews on Movie Box Office Performance: Accounting for Sequential Rollout and Aggregation Across Local Markets,” Marketing Science, 29 (5), 944–57.
19.
ClemonsEric K.GaoGuodong GordonHittLorin M. (2006), “When Online Reviews Meet Hyperdifferentiation: A Study of the Craft Beer Industry,” Journal of Management Information Systems, 23 (2), 149–71.
20.
ConesJohn W. (1992), Film Finance & Distribution: A Dictionary of Terms. Silman-James Press.
21.
CrowderRobert G. (2015), Principles of Learning and Memory: Classic Edition. Psychology Press.
22.
DellarocasChrysanthosAwadNeveenZhangXiaoquan (2004), “Exploring the Value of Online Reviews to Organizations: Implications for Revenue Forecasting and Planning,” ICIS 2004 Proceedings, 30, https://aisel.aisnet.org/icis2004/30.
23.
DellarocasChrysanthosNarayanRitu (2006), “A Statistical Measure of a Population’s Propensity to Engage in Post-Purchase Online Word-of-Mouth,” Statistical Science, 21 (2), 277–85.
24.
DellarocasChrysanthosZhangXiaoquan MichaelAwadNeveen F. (2007), “Exploring the Value of Online Product Reviews in Forecasting Sales: The Case of Motion Pictures,” Journal of Interactive Marketing, 21 (4), 23–45.
25.
DengTianjie (2020), “Investigating the Effects of Textual Reviews from Consumers and Critics on Movie Sales,” Online Information Review, 44 (6), 1245–65.
26.
DengYipuZhengJinyangKhern-am-nuaiWarutKannanKarthik Natarajan (2021), “More Than the Quantity: The Value of Editorial Reviews for a UGC Platform,” Management Science, 68 (9), 6355–7064.
27.
DuanWenjingGuBinWhinstonAndrew B. (2008), “Do Online Reviews Matter?—An Empirical Investigation of Panel Data,” Decision Support Systems, 45 (4), 1007–16.
28.
EliashbergJehoshuaShuganSteven (1997), “Film Critics: Influencers or Predictors?” Journal of Marketing, 61 (2), 68–78.
29.
FaberRonald J.O’GuinnThomas C. (1984), “Effect of Media Advertising and Other Sources on Movie Selection,” Journalism Quarterly, 61 (2), 371–77.
30.
GardialSarah FisherBiehalGabriel J. (1985), “Memory Accessibility and Task Involvement as Factors in Choice,” in Advances in Consumer Research, Vol. 12, Elizabeth C. Hirschman and Moris B. Holbrook, eds. Association for Consumer Research, 414–19.
31.
GelperSarahPeresRenanaEliashbergJehoshua (2018), “Talk Bursts: The Role of Spikes in Prerelease Word-of-Mouth Dynamics,” Journal of Marketing Research, 55 (6), 801–17.
32.
GodesDavidMayzlinDina (2004), “Using Online Conversations to Study Word-of-Mouth Communication,” Marketing Science, 23 (4), 545–60.
33.
GodesDavidSilvaJosé C. (2012), “Sequential and Temporal Dynamics of Online Opinion,” Marketing Science, 31 (3), 448–73.
34.
HandelLeo A. (1950), Hollywood Looks at Its Audience. University of Illinois Press.
35.
HayesAndrew F. (2018), Introduction to Mediation, Moderation, and Conditional Process Analysis: A Regression-Based Approach, 2nd ed.Guilford Press.
36.
Hennig-ThurauThorstenHoustonMark B. (2019), Entertainment Science: Data Analytics and Practical Theory for Movies, Games, Books, and Music. Springer.
37.
Hennig-ThurauThorstenWiertzCarolineFeldhausFabian (2015), “Does Twitter Matter? The Impact of Microblogging Word of Mouth on Consumers’ Adoption of New Movies,” Journal of the Academy of Marketing Science, 43 (3), 375–94.
38.
HerhausenDennisLudwigStephanGrewalDhruvWulfJochenSchoegelMarcus (2019), “Detecting, Preventing, and Mitigating Online Firestorms in Brand Communities,” Journal of Marketing, 83 (3), 1–21.
39.
HolbrookMorris B. (1999), “Popular Appeal Versus Expert Judgments of Motion Pictures,” Journal of Consumer Research, 26 (2), 144–15.
40.
HolbrookMorris B.AddisMichela (2007), “Taste Versus the Market: An Extension of Research on the Consumption of Popular Culture,” Journal of Consumer Research, 34 (3), 415–24.
41.
HomburgChristianEhmLauraArtzMartin (2015), “Measuring and Managing Consumer Sentiment in an Online Community Environment,” Journal of Marketing Research, 52 (5), 629–41.
42.
JansenBernard J.ZhangMimiSobelKateChowduryAbdur (2009), “Twitter Power: Tweets as Electronic Word of Mouth,” Journal of the American Society for Information Science and Technology, 60 (11), 2169–88.
43.
LauJey HanBaldwinTimothyNewmanDavid (2013), “On Collocations and Topic Models,” ACM Transactions on Speech and Language Processing, 10 (3), 1–14.
44.
LeeThomas Y.BradlowEric T. (2011), “Automated Marketing Research Using Online Customer Reviews,” Journal of Marketing Research, 48 (5), 881–94.
45.
LiMengxiangHuangLiqiangTanChuan-HooWeiKwok-Kee (2013), “Helpfulness of Online Product Reviews as Seen by Consumers: Source and Content Features,” International Journal of Electronic Commerce, 17 (4), 101–36.
46.
LitwakMark (1986), Reel Power: The Struggle for Influence and Success in the New Hollywood. William Morrow.
47.
LiuYong (2006), “Word of Mouth for Movies: Its Dynamics and Impact on Box Office Revenue,” Journal of Marketing, 70 (3), 74–89.
48.
LiuXiaoLeeDokyunSrinivasanKannan (2019), “Large-Scale Cross-Category Analysis of Consumer Review Content on Sales Conversion Leveraging Deep Learning,” Journal of Marketing Research, 56 (6), 918–43.
49.
LiuAngela XiaSteenkampJan-Benedict E.M.ZhangJurui (2018), “Agglomeration as a Driver of the Volume of Electronic Word of Mouth in the Restaurant Industry,” Journal of Marketing Research, 55 (4), 507–23.
50.
LiuXiaoVir SinghParamSrinivasanKannan (2016), “A Structured Analysis of Unstructured Big Data by Leveraging Cloud Computing,” Marketing Science, 35 (3), 363–88.
51.
LordKenneth R.PutrevuSanjay (1998), “Communicating in Print: A Comparison of Consumer Responses to Different Promotional Formats,” Journal of Current Issues & Research in Advertising, 20 (2), 1–18.
52.
LuShijieWangXin (Shane)BendleNeil (2020), “Does Piracy Create Online Word of Mouth? An Empirical Analysis in the Movie Industry,” Management Science, 66 (5), 2140–62.
53.
MaLiyeSunBaohongKekreSunder (2015), “The Squeaky Wheel Gets the Grease: An Empirical Analysis of Customer Voice and Firm Intervention on Twitter,” Marketing Science, 34 (5), 627–45.
54.
MankadShawnHanHyunjeong “Spring”GohJoelGavirneniSrinagesh (2016), “Understanding Online Hotel Reviews Through Automated Text Analysis,” Service Science, 8 (2), 124–38.
55.
MoeWendy W.SchweidelDavid A. (2012), “Online Product Opinions: Incidence, Evaluation, and Evolution,” Marketing Science, 31 (3), 372–86.
56.
MoeWendy W.TrusovMichael (2011), “The Value of Social Dynamics in Online Product Ratings Forums,” Journal of Marketing Research, 48 (3), 444–56.
57.
MoonSangkilBergeyPaul K.IacobucciDawn (2010), “Dynamic Effects Among Movie Ratings, Movie Revenues, and Viewer Satisfaction,” Journal of Marketing, 74 (1), 108–21.
58.
PuranamDineshNarayanVishalKadiyaliVrinda (2017), “The Effect of Calorie Posting Regulation on Consumer Opinion: A Flexible Latent Dirichlet Allocation Model with Informative Priors,” Marketing Science, 36 (5), 726–46.
59.
ReinsteinDavid A.SnyderChristopher M. (2005), “The Influence of Expert Reviews on Consumer Demand for Experience Goods: A Case Study of Movie Critics,” Journal of Industrial Economics, 53 (1), 27–51.
60.
RossiPeter E.(2014), “Even the Rich Can Make Themselves Poor: A Critical Examination of IV Methods in Marketing Applications,” Marketing Science, 33 (5), 655–72.
61.
RyooJun Hyun (Joseph)WangXin (Shane)LuShijie (2021), “Do Spoilers Really Spoil? Using Topic Modeling to Measure the Effect of Spoiler Reviews on Box Office Revenue,” Journal of Marketing, 85 (2), 70–88.
62.
SchofieldAlexandraMagnussonMånsMimnoDavid (2017), “Pulling Out the Stops: Rethinking Stopword Removal for Topic Models,” in Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 2, Short Papers. Association for Computational Linguistics, 432–36.
63.
SchweidelDavid A.MoeWendy W. (2014), “Listening In on Social Media: A Joint Model of Sentiment and Venue Format Choice,” Journal of Marketing Research, 51 (4), 387–402.
64.
SievertCarsonShirleyKenneth (2014), “LDAvis: A Method for Visualizing and Interpreting Topics,” in Proceedings of the Workshop on Interactive Language Learning, Visualization, and Interfaces. Association for Computational Linguistics, 63–70.
65.
StammerjohanClaireWoodCharles M.ChangYuhmiinThorsonEsther (2005), “An Empirical Investigation of the Interaction Between Publicity, Advertising, and Previous Brand Attitudes and Knowledge,” Journal of Advertising, 34 (4), 55–67.
SunMonic (2012), “How Does the Variance of Product Ratings Matter?” Management Science, 58 (4), 696–707.
68.
TimoshenkoArtemHauserJohn R. (2019), “Identifying Customer Needs from User-Generated Content,” Marketing Science, 38 (1), 1–20.
69.
TirunillaiSeshadriTellisGerard J. (2014), “Mining Marketing Meaning from Online Chatter: Strategic Brand Analysis of Big Data Using Latent Dirichlet Allocation,” Journal of Marketing Research, 51 (4), 463–79.
70.
ToubiaOlivierIyengarGarudBunnellRenéeLemaireAlain (2019), “Extracting Features of Entertainment Products: A Guided Latent Dirichlet Allocation Approach Informed by the Psychology of Media Consumption,” Journal of Marketing Research, 56 (1), 18–36.
71.
WangYangChaudhryAlexander (2018), “When and How Managers’ Responses to Online Reviews Affect Subsequent Reviews,” Journal of Marketing Research, 55 (2), 163–77.
72.
WangFengLiuXuefengFangEric Er (2015), “User Reviews Variance, Critic Reviews Variance, and Product Sales: An Exploration of Customer Breadth and Depth Effects,” Journal of Retailing, 91 (3), 372–89.
ZhangXiaoquanDellarocasChrysanthos (2006), “The Lord of the Ratings: Is a Movie’s Fate Is Influenced by Reviews?” ICIS 2006 Proceedings, 117, https://aisel.aisnet.org/icis2006/117.
75.
ZhongNingSchweidelDavid A. (2020), “Capturing Changes in Social Media Content: A Multiple Latent Changepoint Topic Model,” Marketing Science, 39 (4), 827–46.
76.
ZhouWenqiDuanWenjing (2016), “Do Professional Reviews Affect Online User Choices Through User Reviews? An Empirical Study,” Journal of Management Information Systems, 33 (1), 202–28.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
