Despite current practices of social media platforms, scholars have not confirmed whether content moderation facilitates community participation. Based on 1,739 submission threads and 21,237 associated comments on a COVID-19 U.S. subreddit, we found that content labels that cued high-source credibility (HSC) predicted more voting and commenting behaviors than content labels that cued low-source credibility (LSC). Further examination of the potential mediation of discrete emotions revealed that HSC cues evoked more emotion than LSC cues for all discrete emotions. However, only positive emotions (i.e., joy, trust, and anticipation) encouraged voting, while a mixed pattern across emotions emerged for commenting.
AhnJ.KimH. K.KahlorL. A.AtkinsonL.NohG.-Y. (2021). The impact of emotion and government trust on individuals’ risk information seeking and avoidance during the COVID-19 pandemic: A cross-country comparison. Journal of Health Communication, 26(10), 728–741. https://doi.org/10.1080/10810730.2021.1999348
2.
ArnoldM. B. (1960). Emotion and personality. Columbia University Press.
3.
BakerS. A.WadeM.WalshM. J. (2020). The challenges of responding to misinformation during a pandemic: Content moderation and the limitations of the concept of harm. Media International Australia, 177(1), 103–107. https://doi.org/10.1177/1329878X20951301
4.
BanerjeeD.MeenaK. S. (2021). COVID-19 as an “Infodemic” in public health: Critical role of the social media. Frontiers in Public Health, 9, Article 610623. https://doi.org/10.3389/fpubh.2021.610623
5.
BaumgartnerJ.ZannettouS.SquireM.BlackburnJ. (2020, June8–11). The pushshift reddit dataset. In Proceedings of the 14th International AAAI Conference on Web and Social Media, ICWSM 2020 (pp. 840–847). Association for the Advancement of Artificial Intelligence.
6.
BergS. H.O’HaraJ. K.ShorttM. T.ThuneH.BrønnickK. K.LunguD. A.RøislienJ.WiigS. (2021). Health authorities’ health risk communication with the public during pandemics: A rapid scoping review. BMC Public Health, 21(1), Article 1401. https://doi.org/10.1186/s12889-021-11468-3
BhuiyanM. M.HorningM.LeeS. W.MitraT. (2021). NudgeCred: Supporting news credibility assessment on social media through nudges. Proceedings of the ACM on Human-computer Interaction, 5(CSCW2), Article 427. https://doi.org/10.1145/3479571
9.
Bil-JaruzelskaA.MonzerC. (2022). All about feelings? Emotional appeals as drivers of user engagement with Facebook posts. Politics and Governance, 10(1), 172–184. https://doi.org/10.17645/pag.v10i1.4758
10.
BrooksJ. J.WalterN. (2020). Cognitive Functional Model of the effects of discrete negative emotions. In BulckJ. (Ed.), The international encyclopedia of media psychology (pp. 1–7). Wiley. https://doi.org/10.1002/9781119011071.iemp0291
11.
ByrneB. M. (2001). Structural equation modeling with AMOS: Basic concepts, applications, and programming (1st ed.). Taylor & Francis.
ChaikenS. (1980). Heuristic versus systematic information processing and the use of source versus message cues in persuasion. Journal of Personality and Social Psychology, 39(5), 752–766. https://doi.org/10.1037/0022-3514.39.5.752
14.
ChoiJ.LeeS. Y.JiS. W. (2021). Engagement in emotional news on social media: Intensity and type of emotions. Journalism and Mass Communication Quarterly, 98(4), 1017–1040. https://doi.org/10.1177/1077699020959718
15.
ChoiW.StviliaB. (2015). Web credibility assessment: Conceptualization, operationalization, variability, and models. Journal of the American Society for Information Science and Technology, 66(12), 2399–2414. https://doi.org/10.1002/asi
16.
De CandiaS.De Francisci MoralesG.MontiC.BonchiF. (2022, June 26–29). Social norms on Reddit: A demographic analysis. In WebSci ’22: ACM International Conference Proceeding Series (pp. 139–147). Association for Computing Machinery. https://doi.org/10.1145/3501247.3531549
17.
de los SantosT. M.NabiR. L. (2019). Emotionally charged: Exploring the role of emotion in online news information seeking and processing. Journal of Broadcasting and Electronic Media, 63(1), 39–58. https://doi.org/10.1080/08838151.2019.1566861
18.
EaglyA. H.ChaikenS. (1993). The psychology of attitudes. Brace & Janovich.
19.
FoggB. J. (2003, April 5–10). Prominence-interpretation theory: Explaining how people assess credibility online. In CHI ’03 Extended Abstracts on Human Factors in Computing Systems—CHI ’03 (pp. 722–723). Association for Computing Machinery. https://doi.org/10.1145/765891.765951
20.
FoggB. J.HallC.SoohooC.DanielsonD. R.TauberE. R.DesignS. B.ViewM.StanfordJ.MarableL.WebwatchC. (2003, June 6–7). How do users evaluate the credibility of web sites? A study with over 2,500 participants. In Proceedings of the 2003 Conference on Designing for User Experiences (DUX ’03) (pp. 1–15). Association for Computing Machinery.
21.
GaoM.XiaoZ.KarahaliosK.FuW.-T. (2018). To label or not to label: The effect of stance and credibility labels on readers’ selection and perception of news articles. Proceedings of the ACM on Human-computer Interaction, 2(CSCW), 1–16. https://doi.org/10.1145/3274324
22.
GinscaA. L.PopescuA.LupuM.GinscaA. L.PopescuA.LupuM. (2015). Credibility in information retrieval. Foundations and Trends® in Information Retrieval, 9(5), 355–475. http://doi.org/10.1561/1500000046
HartW.AlbarracínD.EaglyA. H.BrechanI.LindbergM. J.MerrillL. (2009). Feeling validated versus being correct: A meta-analysis of selective exposure to information. Psychological Bulletin, 135(4), 555–588. https://doi.org/10.1037/a0015701
25.
HeQ.HongY.RaghuT. S. (2022, January4). The effects of machine-powered content moderation: An empirical study on Reddit. In The 55th Hawaii International Conference on System Sciences (HICSS) (Vol. 7, pp. 5963–5972). https://hdl.handle.net/10125/80064
HovlandC. I.JanisI. L.KelleyH. H. (1953). Communication and persuasion; psychological studies of opinion change. Yale University Press.
28.
HuangY.SundarS. S. (2022). Do we trust the crowd? Effects of crowdsourcing on perceived credibility of online health information. Health Communication, 37(1), 93–102. https://doi.org/10.1080/10410236.2020.1824662
29.
HuhJ.McDonaldD. W.HartzlerA.PrattW. (2013). Patient moderator interaction in online health communities. AMIA Annual Symposium Proceedings. AMIA Symposium, 2013, 627–636. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3900205/
30.
IslamM. S.SarkarT.KhanS. H.Mostofa KamalA.-H.HasanS. M. M.KabirA.YeasminD.IslamM. A.Amin ChowdhuryK. I.AnwarK. S.ChughtaiA. A.SealeH. (2020). COVID-19-related infodemic and its impact on public health: A global social media analysis. American Journal of Tropical Medicine and Hygiene, 103(4), 1621–1629. https://doi.org/10.4269/ajtmh.20-0812
31.
JeongY.ShawJ. Y.WengJ. (2023). Covering COVID-19 in the United States: Factors influencing the news coverage of the global health crisis during different pandemic situations. Journalism and Mass Communication Quarterly. Advance online publication. https://doi.org/10.1177/10776990231211925
32.
JhaverS.BruckmanA.GilbertE. (2019, November). Does transparency in moderation really matter? User behavior after content removal explanations on reddit. In Proceedings of the ACM on Human-Computer Interaction (Vol. 3, Issue CSCW). Association for Computing Machinery. https://doi.org/10.1145/3359252
33.
JohnsonS. L.FarajS.KudaravalliS. (2014). Emergence of power laws in online communities: The role of social mechanisms and preferential attachment. MIS Quarterly, 38(3), 795–808. https://doi.org/10.25300/MISQ/2014/38.3.08
KangH.BaeK.ZhangS.SundarS. S. (2011). Source cues in online news: Is the proximate source more powerful than distal sources?Journalism and Mass Communication Quarterly, 88(4), 719–736. https://doi.org/10.1177/107769901108800403
36.
KanthawalaS.PengW. (2021). Credibility in online health communities: Effects of moderator credentials and endorsement cues. Journalism and Media, 2(3), 379–396. https://doi.org/10.3390/journalmedia2030023
37.
KimC.YangS.-U. (2017). Like, comment, and share on Facebook: How each behavior differs from the other. Public Relations Review, 43(2), 441–449. https://doi.org/10.1016/j.pubrev.2017.02.006
38.
KimH.-S.SundarS. S. (2011, May 7–12). Using interface cues in online health community boards to change impressions and encourage user contribution. In SIGCHI Conference on Human Factors in Computing Systems (pp. 599–608). Association for Computing Machinery. https://doi.org/10.1145/1978942.1979028
39.
KimK.KwonN. (2010). Profile of e-patients: Analysis of their cancer information-seeking from a national survey. Journal of Health Communication, 15(7), 712–733. https://doi.org/10.1080/10810730.2010.514031
40.
KlineR. B. (2005). Principles and practice of structural equation modeling (2nd ed.). Guilford Press.
LangA. (2006). Using the limited capacity model of motivated mediated message processing to design effective cancer communication messages. Journal of Communication, 56(Suppl. 1), S57–S80. https://doi.org/10.1111/j.1460-2466.2006.00283.x
43.
LazarusR. S. (1991). Emotion and adaptation. Oxford University Press.
44.
LiuB. F.FraustinoJ. D.JinY. (2016). Social media use during disasters: How information form and source influence intended behavioral responses. Communication Research, 43(5), 626–646. https://doi.org/10.1177/0093650214565917
45.
LuoC.JiK.TangY.DuZ. (2021). Exploring the expression differences between professionals and laypeople toward the COVID-19 vaccine: Text mining approach. Journal of Medical Internet Research, 23(8), Article e30715. https://doi.org/10.2196/30715
46.
MaT.AtkinD. (2017). User generated content and credibility evaluation of online health information: A meta analytic study. Telematics and Informatics, 34(5), 472–486. https://doi.org/10.1016/j.tele.2016.09.009
47.
MalinenS. (2015). Understanding user participation in online communities: A systematic literature review of empirical studies. Computers in Human Behavior, 46, 228–238. https://doi.org/10.1016/j.chb.2015.01.004
48.
MarcusG. E.MacKuenM.NeumanW. R. (2011). Parsimony and complexity: Developing and testing theories of affective intelligence. Political Psychology, 32(2), 323–336. https://doi.org/10.1111/j.1467-9221.2010.00806.x
49.
McCroskeyJ. C.TevenJ. J. (1999). Goodwill: A reexamination of the construct and its measurement. Communication Monographs, 66(1), 90–103. https://doi.org/10.1080/03637759909376464
50.
McHughM. L. (2012). Lessons in biostatistics interrater reliability: The kappa statistic. Biochemica Medica, 22(3), 276–282. https://hrcak.srce.hr/89395
51.
MedvedevA. N.LambiotteR.DelvenneJ.-C. (2019). The anatomy of Reddit: An overview of academic research. In GhanbarnejadF.Saha RoyR.KarimiF.DelvenneJ.MitraB. (Eds.), Dynamics on and of complex networks III (pp. 183–204). Springer. https://doi.org/10.1007/978-3-030-14683-2_9
52.
MenaP. (2020). Cleaning up social media: The effect of warning labels on likelihood of sharing false news on Facebook. Policy and Internet, 12(2), 165–183. https://doi.org/10.1002/poi3.214
53.
MetzgerM. J. (2007). Making sense of credibility on the web: Models for evaluating online information and recommendations for future research. Journal of the American Society for Information Science and Technology, 58(13), 2078–2091. https://doi.org/10.1002/asi.20672
MorrowG.Swire-ThompsonB.PolnyJ. M.KopecM.WihbeyJ. P. (2022). The emerging science of content labeling: Contextualizing social media content moderation. Journal of the Association for Information Science and Technology, 73(10), 1365–1386. https://doi.org/10.1002/asi.24637
56.
NabiR. L. (1999). A cognitive-functional model for the effects of discrete negative emotions on information processing, attitude change, and recall. Communication Theory, 9(3), 292–320. https://doi.org/10.1111/j.1468-2885.1999.tb00172.x
57.
NabiR. L. (2007). Emotion and persuasion: A social cognitive perspective. In Roskos-EwoldsenD. R.MonahanJ. L. (Eds.), Communication and social cognition: Theories and methods (pp. 377–398). Routledge. https://doi.org/10.4324/9780203936313
58.
NabiR. L. (2010). The case for emphasizing discrete emotions in communication research. Communication Monographs, 77(2), 153–159. https://doi.org/10.1080/03637751003790444
59.
NassettaJ.GrossK. (2020). State media warning labels can counteract the effects of foreign disinformation. Harvard Kennedy School Misinformation Review, 1, 1–11. https://doi.org/10.37016/mr-2020-45
Oeldorf-HirschA.SchmierbachM.AppelmanA.BoyleM. P. (2020). The ineffectiveness of fact-checking labels on news memes and articles. Mass Communication and Society, 23(5), 682–704. https://doi.org/10.1080/15205436.2020.1733613
64.
OxmanA. D.FretheimA.LewinS.FlottorpS.GlentonC.HelleveA.VestrheimD. F.IversenB. G.RosenbaumS. E. (2022). Health communication in and out of public health emergencies: To persuade or to inform?Health Research Policy and Systems, 20(1), Article 28. https://doi.org/10.1186/s12961-022-00828-z
65.
PapakyriakopoulosO.GoodmanE. (2022, April 25–29). The impact of Twitter labels on misinformation spread and user engagement: Lessons from Trump’s election tweets. In WWW ‘22: The ACM Web Conference 2022 (pp. 2541–2551). Association for Computing Machinery. https://doi.org/10.1145/3485447.3512126
66.
PeacockC.MasulloG. M.StroudN. J. (2022). The effect of news labels on perceived credibility. Journalism, 23(2), 301–319. https://doi.org/10.1177/1464884920971522
67.
PettyR. E.CacioppoJ. T. (1986). The elaboration likelihood model of persuasion. Advances in Experimental Social Psychology, 19, 123–205. https://doi.org/10.1016/S0065-2601(08)60214-2
68.
PramiyantiA.MayangsariI. D.NuraeniR.FirdausY. D. (2020). Public perception on transparency and trust in government information released during the COVID-19 pandemic. Asian Journal for Public Opinion Research, 8(3), 351–376. https://doi.org/10.15206/ajpor.2020.8.3.351
69.
ProferesN.JonesN.GilbertS.FieslerC.ZimmerM. (2021). Studying Reddit: A systematic overview of disciplines, approaches, methods, and ethics. Social Media + Society, 7(2), 1–14. https://doi.org/10.1177/20563051211019004
70.
RabanD. R.MoldovanM.JonesQ. (2010, February 6–10). An empirical study of critical mass and online community survival. In CSCW ‘10: Proceedings of the 2010 ACM Conference on Computer Supported Cooperative Work (pp. 71–80). Association for Computing Machinery. https://doi.org/10.1145/1718918.1718932
RowleyJ.JohnsonF. (2013). Understanding trust formation in digital information sources: The case of Wikipedia. Journal of Information Science, 39(4), 494–508. https://doi.org/10.1177/0165551513477820
SalvucciD. D.TaatgenN. A. (2008). Threaded cognition: An integrated theory of concurrent multitasking. Psychological Review, 115(1), 101–130. https://doi.org/10.1037/0033-295X.115.1.101
76.
SchreinerM.FischerT.RiedlR. (2021). Impact of content characteristics and emotion on behavioral engagement in social media: Literature review and research agenda. Electronic Commerce Research, 21(2), 329–345. https://doi.org/10.1007/s10660-019-09353-8
77.
SinghalM.LingC.KumarswamyN.StringhiniG.NilizadehS. (2022). SoK: Content moderation in social media from guidelines to enforcement, and research to practice [ArXiv:2206.14855]. ArXiv. https://arxiv.org/abs/2206.14855#:~:text=https%3A//doi.org/10.48550/arXiv.2206.14855
78.
SmithC. A.EllsworthP. C. (1985). Patterns of cognitive appraisal in emotion. Journal of Personality and Social Psychology, 48(4), 813–838. https://doi.org/10.1037/0022-3514.48.4.813
79.
SmithC. A.KirbyL. D. (2001). Affect and cognitive appraisal processes. In ForgasJ. P. (Ed.), Handbook of affect and social cognition (pp. 75–92). Lawrence Erlbaum Associates Publishers.
80.
SongH. (2017). Why do people (sometimes) become selective about news? The role of emotions and partisan differences in selective approach and avoidance. Mass Communication and Society, 20(1), 47–67. https://doi.org/10.1080/15205436.2016.1187755
81.
StraubJ.SpradlingM. (2022). Americans’ perspectives on online media warning labels. Behavioral Sciences, 12(3), 1–46. https://doi.org/10.3390/bs12030059
82.
SundarS. S. (2008). The MAIN model: A heuristic approach to understanding technology effects on credibility. In MetzgerM. J.FlanaginA. J. (Eds.), Digital media,youth, and credibility (pp. 73–100). MIT Press. https://doi.org/10.1162/dmal.9780262562324.073
WellsC.ShahD. V.PevehouseJ. C.FoleyJ.LukitoJ.PelledA.YangJ. (2019). The temporal turn in communication research: Time series analyses using computational approaches. International Journal of Communications, 13, 4021–4043. http://ijoc.org
86.
WimmerR. D.DominickJ. R. (2013). Mass media research: An introduction (10th ed.). Wadsworth Publishing.
87.
WitteK. (1992). Putting the fear back into fear appeals: The extended parallel process model. Communication Monographs, 59(4), 329–349. https://doi.org/10.1080/03637759209376276
