Moderating content on social media can lead to severe psychological distress. However, little is known about the type, severity, and consequences of distress experienced by volunteer content moderators (VCMs), who do this work voluntarily. We present results from a survey that investigated why Facebook Group and subreddit VCMs quit, and whether reasons for quitting are correlated with psychological distress, demographics, and/or community characteristics. We found that VCMs are likely to experience psychological distress that stems from struggles with other moderators, moderation team leads’ harmful behaviors, and having too little available time, and these experiences of distress relate to their reasons for quitting. While substantial research has focused on making the task of detecting and assessing toxic content easier or less distressing for moderation workers, our study shows that social interventions for VCM workers, for example, to support them in navigating interpersonal conflict with other moderators, may be necessary.
BlackwellLChenTSchoenebeckS, et al. (2018) When online harassment is perceived as justified. Twelfth International AAAI Conference on Web and Social Media. Available at: https://ojs.aaai.org/index.php/ICWSM/article/view/15036
2.
BrunoBFiorilloD (2012) Why without pay? Intrinsic motivation in the unpaid labour supply. Journal of Socio-Economics41(5): 659–669.
ChenCFYuT (2014) Effects of positive vs negative forces on the burnout-commitment-turnover relationship. Journal of Service Management25(3): 388–410.
5.
CrawfordKGillespieT (2016) What is a flag for? Social media reporting tools and the vocabulary of complaint. New Media & Society18(3): 410–428.
6.
DosonoBSemaanB (2019) Moderation practices as emotional labor in sustaining online communities: the case of AAPI identity work on Reddit. In: Proceedings of the 2019 CHI conference on human factors in computing systems, Glasgow, 4–9 May, pp. 1–13. New York: Association for Computing Machinery.
7.
DugasLSierraMBerriosGE (1996) A case of depersonalization. History of Psychiatry7(27): 455–461.
8.
FortunaPNunesS (2018) A survey on automatic detection of hate speech in text. ACM Computing Surveys51(4): 1–30.
9.
FullertonAS (2009) A conceptual framework for ordered logistic regression models. Sociological Methods & Research38(2): 306–347.
10.
GabardDL (1997) Volunteer burnout and dropout: issues in AIDS service organizations. Journal of Health and Human Services Administration19(3): 283–303.
11.
GillespieT (2018) Custodians of the Internet: Platforms, Content Moderation, and the Hidden Decisions That Shape Social Media. New Haven, CT: Yale University Press.
12.
GrayDStevensonC (2020) How can “we” help? Exploring the role of shared social identity in the experiences and benefits of volunteering. Journal of Community and Applied Social Psychology30(4): 341–353.
13.
HughesJLCamdenAAYangchenT (2016) Rethinking and updating demographic questions: guidance to improve descriptions of research samples. Psi Chi Journal of Psychological Research21(3): 138–151.
14.
HuntWScottP (2020) Paid and unpaid graduate internships: prevalence, quality and motivations at six months after graduation. Studies in Higher Education45(2): 464–476.
15.
HustinxLHandyFCnaanRA, et al. (2010) Social and cultural origins of motivations to volunteer: a comparison of university students in six countries. International Sociology25(3): 349–382.
16.
KieneCJiangJAHillBM (2019) Technological frames and user innovation: exploring technological change in community moderation teams. ACM Human-Computer Interaction3(CSCW): 1–23.
17.
KinzelANansonJ (2000) Education and debriefing: strategies for preventing crises in crisis-line volunteers. Crisis: The Journal of Crisis Intervention and Suicide Prevention21(3): 126–134.
18.
LoC (2018) When all you have is a banhammer: the social and communicative work of volunteer moderators. PhD Thesis, Massachusetts Institute of Technology, Cambridge, MA.
19.
LyberakiA (2011) Migrant women, care work, and women’s employment in Greece. Feminist Economics17(3): 103–131.
20.
MarchandADemersADurandP (2005) Do occupation and work conditions really matter? A longitudinal analysis of psychological distress experiences among Canadian workers. Sociology of Health and Illness27(5): 602–627.
21.
MaslachCJacksonSE (1981) The measurement of experienced burnout. Journal of Organizational Behavior2(2): 99–113.
22.
MatiasJN (2019) The civic labor of volunteer moderators online. Social Media + Society5(2): 1–12.
23.
PadiosJM (2017) Mining the mind: emotional extraction, productivity, and predictability in the twenty-first century. Cultural Studies of Science Education31(2–3): 205–231.
24.
ParksL (2019) Dirty data: content moderation, regulatory outsourcing, and the cleaners. Film Quarterly73(1): 11–18.
25.
RobertsST (2019) Behind the Screen: Content Moderation in the Shadows of Social Media. New Haven, CT: Yale University Press.
26.
RossMWGreenfieldSABennettL (1999) Predictors of dropout and burnout in AIDS volunteers: a longitudinal study. AIDS Care11(6): 723–731.
27.
SaldanaJ (2015) The Coding Manual for Qualitative Researchers. Thousand Oaks, CA: SAGE.
28.
SchmidtAWiegandM (2017) A survey on hate speech detection using natural language processing. In: Proceedings of the fifth international workshop on natural language processing for social media, Valencia, Spain, 3 April, pp. 1–10. Association for Computational Linguistics, Stroudsburg, PA.
29.
SeeringJWangTYoonJ, et al. (2019) Moderator engagement and community development in the age of algorithms. New Media & Society21(7): 1417–1443.
30.
SengJSLopezWDSperlichM, et al. (2012) Marginalized identities, discrimination burden, and mental health: empirical exploration of an interpersonal-level approach to modeling intersectionality. Social Science & Medicine75(12): 2437–2445.
31.
SinghPSuarDLeiterMP (2012) Antecedents, work-related consequences, and buffers of job burnout among Indian software developers. Journal of Leadership & Organizational Studies19(1): 83–104.
32.
Soto Blauert v Microsoft (2017) no. 16-2-31049-4 SEA.
TalbotA (2015) The negative impacts of volunteering: a qualitative case study of one UK scout group. Voluntary Sector Review; Manchester6(2): 209–220.
35.
ThormarSBGersonsBPRJuenB, et al. (2010) The mental health impact of volunteering in a disaster setting: a review. The Journal of Nervous and Mental Disease198(8): 529–538.
36.
UttalLTuominenM (1999) Tenuous relationships: exploitation, emotion, and racial ethnic significance in paid child care work. Gender & Society13(6): 758–780.
37.
VenablesWNRipleyBD (2002) Modern Applied Statistics with S. 4th ed.New York: Springer.
38.
WillemsJHuybrechtsGJegersM, et al. (2012) Volunteer decisions (not) to leave: reasons to quit versus functional motives to stay. Human Relations65(7): 883–900.
39.
WohnDY (2019) Volunteer moderators in twitch micro communities: how they get involved, the roles they play, and the emotional labor they experience. In: CHI ’19 Proceedings of the 2019 CHI conference on human factors in computing systems, pp. 1–13. New York: Association for Computing Machinery.
40.
WuGHuZZhengJ (2019) Role stress, job burnout, and job performance in construction project managers: the moderating role of career calling. International Journal of Environmental Research and Public Health16(13): 2319.
41.
YanayGVYanayV (2008) The decline of motivation? From commitment to dropping out of volunteering. Nonprofit Management Leadership19(1): 65–78.
42.
YangY (2019) When power goes wild online: how did a voluntary moderator’s abuse of power affect an online community?Proceedings of the Association for Information Science and Technology56(1): 504–508.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
