Online radicalization is among the most vexing challenges the world faces today. Here, we demonstrate that homogeneity in moral concerns results in increased levels of radical intentions. In Study 1, we find that in Gab—a right-wing extremist network—the degree of moral convergence within a cluster predicts the number of hate-speech messages members post. In Study 2, we replicate this observation in another extremist network, Incels. In Studies 3 to 5 (N = 1,431), we demonstrate that experimentally leading people to believe that others in their hypothetical or real group share their moral views increases their radical intentions as well as willingness to fight and die for the group. Our findings highlight the role of moral convergence in radicalization, emphasizing the need for diversity of moral worldviews within social networks.
AndersonC.JohnO. P.KeltnerD. (2012). The personal sense of power. Journal of Personality, 80, 313–344.
2.
AronA.AronE. N.SmollanD. (1992). Inclusion of other in the self scale and the structure of interpersonal closeness. Journal of Personality and Social Psychology, 63, 596–612.
3.
AshokkumarA.TalaifarS.FraserW. T.LandaburR.BuhrmesterM.GómezA.ParedesB.SwannW. B. (2020). Censoring political opposition online: Who does it and why. Journal of Experimental Social Psychology, 91, 104031.
4.
AtranS. (2010). Talking to the enemy: Faith, brotherhood, and the (un) making of terrorists. Harper Collins.
5.
AtranS. (2021). Psychology of transnational terrorism and extreme political conflict. Annual Review of Psychology, 72, 471–501.
6.
AtranS.AxelrodR.DavisR. (2007). Sacred barriers to conflict resolution. Science, 317, 1039–1040.
7.
BradyW. J.CrockettM.Van BavelJ. J. (2020). The MAD model of moral contagion: The role of motivation, attention, and design in the spread of moralized content online. Perspectives on Psychological Science, 15, 978–1010.
8.
ByrtT.BishopJ.CarlinJ. B. (1993). Bias, prevalence and kappa. Journal of Clinical Epidemiology, 46, 423–429.
9.
CollobertR.WestonJ. (2008). A unified architecture for natural language processing: Deep neural networks with multitask learning. In Proceedings of the 25th International Conference on Machine Learning (pp. 160–167). Association for Computing Machinery.
10.
DehghaniM.JohnsonK.HooverJ.SagiE.GartenJ.ParmarN. J.VaiseyS.IlievR.GrahamJ. (2016). Purity homophily in social networks. Journal of Experimental Psychology: General, 145, 366–375.
11.
DellaPostaD.ShiY.MacyM. (2015). Why do liberals drink lattes?American Journal of Sociology, 120, 1473–1511.
12.
FiedlerK.SchottM.MeiserT. (2011). What mediation analysis can (not) do. Journal of Experimental Social Psychology, 47, 1231–1236.
13.
FinkelE. J.BailC. A.CikaraM.DittoP. H.IyengarS.KlarS.MasonL.McgrathM. C.NyhanB.RandD. G.SkitkaL. J.TuckerJ. A.Van BavelJ. J.WangC. S.DruckmanJ. N. (2020). Political sectarianism in America. Science, 370, 533–536.
14.
FiskeA. P.RaiT. S. (2014). Virtuous violence: Hurting and killing to create, sustain, end, and honor social relationships. Cambridge University Press.
15.
FleissJ. L. (1971). Measuring nominal scale agreement among many raters. Psychological Bulletin, 76, 378–382.
16.
FredmanL. A.BuhrmesterM. D.GómezA.FraserW. T.TalaifarS.BrannonS. M.SwannW. B. (2015). Identity fusion, extreme pro-group behavior, and the path to defusion. Social & Personality Psychology Compass, 9, 468–480.
GómezA.BrooksM. L.BuhrmesterM. D.VázquezA.JettenJ.SwannW. B. (2011). On the nature of identity fusion: Insights into the construct and a new measure. Journal of Personality and Social Psychology, 100, 918–933.
19.
GómezA.López-RodríguezL.SheikhH.GingesJ.WilsonL.WaziriH.VázquezA.DavisR.AtranS. (2017). The devoted actor’s will to fight and the spiritual dimension of human conflict. Nature Human Behaviour, 1, 673–679.
20.
GómezA.VázquezA.López-RodríguezL.TalaifarS.MartínezM.BuhrmesterM. D.SwannW. BJr. (2019). Why people abandon groups: Degrading relational vs collective ties uniquely impacts identity fusion and identification. Journal of Experimental Social Psychology, 85, 103853.
21.
GrahamJ.HaidtJ. (2012). Sacred values and evil adversaries: A moral foundations approach. In MikulincerM.ShaverP. R.(Eds.), The social psychology of morality: Exploring the causes of good and evil (pp. 11–31). American Psychological Association.
22.
GrahamJ.HaidtJ.KolevaS.MotylM.IyerR.WojcikS. P.DittoP. H. (2013). Moral foundations theory: The pragmatic validity of moral pluralism. Advances in Experimental Social Psychology, 47, 55–130.
23.
HochreiterS.SchmidhuberJ. (1997). Long short-term memory. Neural Computation, 9, 1735–1780.
24.
HooverJ.Portillo-WightmanG.YehL.HavaldarS.DavaniA. M.LinY.KennedyB.AtariM.KamelZ.MendlenM.MorenoG.ParkC.ChangT. E.ChinJ.LeongC.LeungJ. Y.MirinjianA.DehghaniM. (2020). Moral Foundations Twitter Corpus: A collection of 35k tweets annotated for moral sentiment. Social Psychological and Personality Science, 11, 1057–1071.
25.
JakiS.De SmedtT.GwóüdüM.PanchalR.RossaA.De PauwG. (2019). Online hatred of women in the Incels.me forum: Linguistic analysis and automatic detection. Journal of Language Aggression and Conflict, 7, 240–268.
26.
JohnsonN.LeahyR.RestrepoN. J.VelasquezN.ZhengM.ManriqueP.DevkotaP.WuchtyS. (2019). Hidden resilience and adaptive dynamics of the global online hate ecology. Nature, 573, 261–265.
27.
KennedyB.AtariM.DavaniA. M.YehL.OmraniA.KimY.CoombsK.HavaldarS.Portillo-WightmanG.GonzalezE.HooverJ.AzatianA.HussainA.LaraA.OlmosG.OmaryA.ParkC.WijayaC.WangX.. . . DehghaniM. (2020). The gab hate corpus: A collection of 27k posts annotated for hate speech. Psyarxiv. https://doi.org/10.31234/osf.io/hqjxn
28.
KruglanskiA. W.GelfandM. J.BélangerJ. J.ShevelandA.HetiarachchiM.GunaratnaR. (2014). The psychology of radicalization and deradicalization: How significance quest impacts violent extremism. Political Psychology, 35, 69–93.
29.
KruglanskiA. W.JaskoK.ChernikovaM.DugasM.WebberD. (2017). To the fringe and back: Violent extremism and the psychology of deviance. American Psychologist, 72, 217.
30.
KunstJ. R.DovidioJ. F.ThomsenL. (2019). Fusion with political leaders predicts willingness to persecute immigrants and political opponents. Nature Human Behaviour, 3, 1180–1189.
31.
MooijmanM.HooverJ.LinY.JiH.DehghaniM. (2018). Moralization in social networks and the emergence of violence during protests. Nature Human Behaviour, 2, 389–396.
32.
MoskalenkoS.McCauleyC. (2009). Measuring political mobilization: The distinction between activism and radicalism. Terrorism and Political Violence, 21, 239–260.
33.
PenningtonJ.SocherR.ManningC. D. (2014). Glove: Global vectors for word representation. In Proceedings of the empirical methods in natural language processing (emnlp 2014) (Vol. 12, pp. 1532–1543). Association for Computational Linguistics.
34.
PriceV.NirL.CappellaJ. N. (2006). Normative and informational influences in online political discussions. Communication Theory, 16, 47–74.
35.
RosvallM.AxelssonD.BergstromC. T. (2009). The map equation. The European Physical Journal Special Topics, 178, 13–23.
ShaliziC. R.ThomasA. C. (2011). Homophily and contagion are generically confounded in observational social network studies. Sociological Methods & Research, 40, 211–239.
38.
SimonsD. J.ShodaY.LindsayD. S. (2017). Constraints on generality (COG): A proposed addition to all empirical papers. Perspectives on Psychological Science, 12, 1123–1128.
39.
SkitkaL. J.HansonB. E.MorganG. S.WisneskiD. C. (2021). The psychology of moral conviction. Annual Review of Psychology, 72, 347–366.
40.
SrivastavaN.HintonG.KrizhevskyA.SutskeverI.SalakhutdinovR. (2014). Dropout: A simple way to prevent neural networks from overfitting. The Journal of Machine Learning Research, 15, 1929–1958.
41.
SwannW. B.BuhrmesterM. D.GómezA.JettenJ.BastianB.VázquezA.AriyantoA.BestaT.ChristO.CuiL.FinchilescuG.GonzálezR.GotoN.HornseyM.SharmaS.SusiantoH.ZhangA. (2014). What makes a group worth dying for? identity fusion fosters perception of familial ties, promoting self-sacrifice. Journal of Personality and Social Psychology, 106, 912–926.
42.
SwannW. B.GómezA.SeyleD. C.MoralesJ.HuiciC. (2009). Identity fusion: The interplay of personal and social identities in extreme group behavior. Journal of Personality and Social Psychology, 96, 995–1011.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
