In this research, the authors investigate the prevalence, robustness, and possible reasons underlying the polarity of online review distributions, with the majority of the reviews at the positive end of the rating scale, a few reviews in the midrange, and some reviews at the negative end of the scale. Compiling a large data set of online reviews—over 280 million reviews from 25 major online platforms—the authors find that most reviews on most platforms exhibit a high degree of polarity, but the platforms vary in the degree of polarity on the basis of how selective customers are in reviewing products on the platform. Using cross-platform and multimethod analyses, including secondary data, experiments, and survey data, the authors empirically confirm polarity self-selection, described as the higher tendency of consumers with extreme evaluations to provide a review as an important driver of the polarity of review distributions. In addition, they describe and demonstrate that polarity self-selection and the polarity of the review distribution reduce the informativeness of online reviews.
AndersonEric T.SimesterDuncan I. (2014), “Reviews Without a Purchase: Low Ratings, Loyal Customers, and Deception,” Journal of Marketing Research, 51 (3), 249–69.
2.
AndersonEugene W. (1998), “Customer Satisfaction and Word of Mouth,” Journal of Service Research, 1 (1), 5–17.
3.
AndersonEugene W.FornellClaes (2000), “Foundations of the American Customer Satisfaction Index,” Total Quality Management, 11 (7), 869–82.
4.
ArchakNikolayGhoseAnindyaIpeirotisPanagiotis G. (2011), “Deriving the Pricing Power of Product Features by Mining Consumer Reviews,” Management Science, 57 (8), 1485–1509.
5.
Babić RosarioAnaSotgiuFrancescaDe ValckKristineBijmoltTammo H.A. (2016), “The Effect of Electronic Word of Mouth on Sales: A Meta-Analytic Review of Platform, Product, and Metric Factors,” Journal of Marketing Research, 53 (3), 297–318.
6.
BaraschAlixandraBergerJonah (2014), “Broadcasting and Narrowcasting: How Audience Size Affects What People Share,” Journal of Marketing Research, 51 (3), 286–99.
7.
BergerJonah (2014), “Word of Mouth and Interpersonal Communication: A Review and Directions for Future Research,” Journal of Consumer Psychology, 24 (4), 586–607.
8.
BikhchandaniSushilHirshleiferDavidWelchIvo (1992), “A Theory of Fads, Fashion, Custom, and Cultural Change as Informational Cascades,” Journal of Political Economy, 100 (5), 992–1026.
9.
BrandesLeifGodesDavidMayzlinDina (2019), “What Drives Extremity Bias in Online Reviews? Theory and Experimental Evidence,” working paper.
10.
ChevalierJudith A.MayzlinDina (2006), “The Effect of Word of Mouth on Sales: Online Book Reviews,” Journal of Marketing Research, 43 (3), 345–54.
11.
ChintaguntaPradeep K.GopinathShyamVenkataramanSriram (2010), “The Effects of Online User Reviews on Movie Box Office Performance: Accounting for Sequential Rollout and Aggregation Across Local Markets,” Marketing Science, 29 (5), 944–57.
DanaherPeter J.HaddrellVanessa (1996), “A Comparison of Question Scales Used for Measuring Customer Satisfaction,” International Journal of Service Industry Management, 7 (4), 4–26.
14.
De LangheBartFernbachPhilip M.LichtensteinDonald R. (2015), “Navigating by the Stars: Investigating the Actual and Perceived Validity of Online User Ratings,” Journal of Consumer Research, 42 (6), 817–33.
15.
DellarocasChrysanthos (2003), “The Digitization of Word of Mouth: Promise and Challenges of Online Feedback Mechanisms,” Management Science, 49 (10), 1407–24.
16.
DellarocasChrysanthosGaoGuodongNarayanRitu (2010), “Are Consumers More Likely to Contribute Online Reviews for Hit or Niche Products?” Journal of Management Information Systems, 27 (2), 127–58.
17.
DellarocasChrysanthosWoodCharles A. (2008), “The Sound of Silence in Online Feedback: Estimating Trading Risks in the Presence of Reporting Bias,” Management Science, 54 (3), 460–76.
18.
DellarocasChrysanthosZhangXiaoquan (Michael)AwadNeveen F. (2007), “Exploring the Value of Online Reviews in Forecasting Sales: The Case of Motion Pictures,” Journal of Interactive Marketing, 21 (4), 23–45.
19.
EastRobertHammondKathyWrightMalcolm (2007), “The Relative Incidence of Positive and Negative Word of Mouth: A Multi-Category Study,” International Journal of Research in Marketing, 24 (2), 175–84.
20.
EngelJames F.KegerreisRobert J.BlackwellRoger D. (1969), “Word-of-Mouth Communication by the Innovator,” Journal of Marketing, 33 (3), 15–19.
FestingerLeon (1957), A Theory of Cognitive Dissonance. Stanford, CA: Stanford University Press.
23.
FisherMatthewNewmanGeorge E.DharRavi (2018), “Seeing Stars: How the Binary Bias Distorts the Interpretation of Customer Ratings,” Journal of Consumer Research, 45 (3), 471–89.
24.
FloydKristopherFrelingRyanAlhoqailSaadChoHyun YoungFrelingTraci (2014), “How Online Reviews Affect Retail Sales: A Meta-Analysis,” Journal of Retailing, 90 (2), 217–32.
25.
FormanChrisGhoseAnindyaWiesenfeldBatia (2008), “Examining the Relationship Between Reviews and Sales: The Role of Reviewer Identity Disclosure in Electronic Markets,” Information Systems Research, 19 (3), 291–313.
GershoffAndrew D.MukherjeeAsheshMukhopadhyayAnirban (2003), “Consumer Acceptance of Online Agent Advice: Extremity and Positivity Effects,” Journal of Consumer Psychology, 13 (1/2), 161–70.
28.
GhoseAnindyaIpeirotisPanagiotis G. (2011), “Estimating the Helpfulness and Economic Impact of Online Reviews: Mining Text and Reviewer Characteristics,” IEEE Transactions on Knowledge and Data Engineering, 23 (10), 1498–1512.
29.
GodesDavidSilvaJosé C. (2012), “Sequential and Temporal Dynamics of Online Opinion,” Marketing Science, 31 (3), 448–73.
30.
HeskettJames L.SasserW.EarlJrSchlesingerLeonard A. (1997), The Service Profit Chain: How Leading Companies Link Profit and Growth to Loyalty, Satisfaction, and Value. New York: The Free Press.
HuNanZhangJiePavlouPaul A. (2009), “Overcoming the J-Shaped Distribution of Online Reviews,” Communications of the ACM, 52 (10), 144–47.
33.
HuNanKohNoi SianReddySrinivas K. (2014), “Ratings Lead You to the Product, Reviews Help You Clinch It? The Mediating Role of Online Review Sentiments on Product Sales,” Decision Support Systems, 57, 42–53.
34.
HuNanPavlouPaul A.ZhangJie (2017), “On Self-Selection Biases in Online Product Reviews” MIS Quarterly, 41 (2), 449–71.
KingRobert A.RacherlaPradeepBushVictoria D. (2014), “What We Know and Don’t Know About Online Word-of-Mouth: A Review and Synthesis of the Literature,” Journal of Interactive Marketing, 28 (3), 167–83.
39.
KramerMark A. (2007), “Self-Selection Bias in Reputation Systems,” in Trust Management. IFIPTM 2007. IFIP International Federation for Information Processing, Vol. 238, EtalleS.MarshS., eds. Boston: Springer.
40.
LebowJay L. (1982), “Consumer Satisfaction with Mental Health Treatment,” Psychological Bulletin, 91 (2), 85–86.
41.
LiNengDuSuguoZhengHaizhongXueMinhuiZhuHaojin (2018), “Fake Reviews Tell No Tales? Dissecting Click Farming in Content-Generated Social Networks,” China Communications, 15 (4), 98–109.
42.
LiXinxinHittLorin M. (2008), “Self-Selection and Information Role of Online Product Reviews,” Information Systems Research, 19 (4), 456–74.
43.
LiuYong (2006), “Word of Mouth for Movies: Its Dynamics and Impact on Box Office Revenue,” Journal of Marketing, 70 (3), 74–89.
44.
LucaMichaelZervasGeorgios (2016), “Fake It Till You Make It: Reputation, Competition, and Yelp Review Fraud,” Management Science, 62 (12), 3412–27.
45.
MarlinBenjamin M.ZemelRichard S.RoweisSamSlaneyMalcolm (2012), “Collaborative Filtering and the Missing at Random Assumption,” arXiv preprint arXiv: 1206.5267.
46.
MayzlinDinaDoverYanivChevalierJudith (2014), “Promotional Reviews: An Empirical Investigation of Online Review Manipulation,” American Economic Review, 104 (8), 2421–55.
47.
MinnemaAlecBijmoltTammo H.GenslerSonjaWieselThorsten (2016), “To Keep or Not to Keep: Effects of Online Customer Reviews on Product Returns,” Journal of Retailing, 92 (3), 253–67.
48.
MittalBanwariLassarWalfried M. (1998), “Why Do Customers Switch? The Dynamics of Satisfaction Versus Loyalty,” Journal of Services Marketing, 12 (3), 177–94.
49.
MittalVikasKamakuraWagner A. (2001), “Satisfaction, Repurchase Intent, and Repurchase Behavior: Investigating the Moderating Effect of Customer Characteristics,” Journal of Marketing Research, 38 (1), 131–42.
50.
MoeWendy W.NetzerOdedSchweidelDavid A. (2017), “Social Media and User Generated Content Analysis,” in Handbook of Marketing Decision Models, WierengaBerendLansRalf van der, eds. Berlin: Springer.
51.
MoeWendy W.SchweidelDavid A. (2012), “Online Product Opinions: Incidence, Evaluation, and Evolution,” Marketing Science, 31 (3), 372–86.
52.
MoeWendy W.TrusovMichael (2011), “The Value of Social Dynamics in Online Product Ratings Forums,” Journal of Marketing Research, 48 (3), 444–56.
53.
MoorsGuyKierujNatalia D.VermuntJeroen K. (2014), “The Effect of Labeling and Numbering of Response Scales on the Likelihood of Response Bias,” Sociological Methodology, 44 (1), 369–99.
54.
MuchnikLevAralSinanTaylorSean J. (2013), “Social Influence Bias: A Randomized Experiment,” Science, 341 (6146), 647–51.
55.
MudambiSusan M.SchuffDavid (2010), “What Makes a Helpful Review? A Study of Customer Reviews on Amazon.com,” MIS Quarterly, 34 (1), 185–200.
56.
NaylorGillianKleiserSusan B. (2000), “Negative Versus Positive Word-of-Mouth: An Exception to the Rule,” Journal of Satisfaction, Dissatisfaction and Complaining Behavior, 13 (1), 26–36.
57.
PetersonRobert A.WilsonWilliam R. (1992), “Measuring Customer Satisfaction: Fact and Artifact,” Journal of the Academy of Marketing Science, 20 (1), 61–71.
SchlosserAnn E. (2005), “Posting Versus Lurking: Communicating in a Multiple Audience Context,” Journal of Consumer Research, 32 (2), 260–65.
60.
Sharpe WesslingKathrynHuberJoelNetzerOded (2017), “MTurk Character Misrepresentation: Assessment and Solutions,” Journal of Consumer Research, 44 (1), 211–30.
61.
SilvermanGeorge (1997), “How to Harness the Awesome Power of Word of Mouth,” Direct Marketing, 60 (7), 32–37.
62.
SkowronskiJohn J.CarlstonDonal E. (1987), “Social Judgment and Social Memory: The Role of Cue Diagnosticity in Negativity, Positivity, and Extremity Biases,” Journal of Personality and Social Psychology, 52 (4), 689–98.
63.
SridharShrihariSrinivasanRaji (2012), “Social Influence Effects in Online Product Ratings,” Journal of Marketing, 76 (5), 70–88.
64.
WeijtersBertCabooterElkeSchillewaertNiels (2010), “The Effect of Rating Scale format on Response Styles: The Number of Response Categories and Response Category Labels,” International Journal of Research in Marketing, 27 (3), 236–47.
ZhangYinlongFeickLawrenceMittalVikas (2014), “How Males and Females Differ in Their Likelihood of Transmitting Negative Word of Mouth,” Journal of Consumer Research, 40 (6), 1097–108.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
