Sage Journals: Discover world-class research

Abstract

In this paper, we investigate the issue of hate speech by presenting a novel task of translating hate speech into non-hate speech text while preserving its meaning. As a case study, we use Spanish texts. We provide a dataset and several baselines as a starting point for further research in the task. We evaluated our baseline results using multiple metrics, including BLEU scores. We used a cross-validation approach and an average of the metrics per fold for evaluation. We achieved a 0.236 sentenceBLEU score on four folds. This study aims to contribute to developing more effective methods for reducing the spread of hate speech in online communities.

Keywords

Hate speech translation Spanish

Get full access to this article

View all access options for this article.

References

Abdalghani Abujabal Rishiraj Saha Roy Mohamed Yahya Gerhard Weikum , Comqa: A community-sourced dataset for complex factoid question answering with paraphrase clusters, arXiv preprint arXiv:1809.09528, 2018.

Roee Aharoni Melvin Johnson Orhan Firat , Massively multilingual neural machine translation, arXiv preprint arXiv:1903.00089, 2019.

Fatimah Alkomah Xiaogang Ma , A literature review of textual hate speech detection methods and datasets, Information13(6) (2022), ISSN 2078–2489, doi: 10.3390/info13060273, URL https://www.mdpi.com/2078-2489/13/6/273.

Maria Anzovino Elisabetta Fersini Paolo Rosso , Automatic identification and classification of misogynistic language on twitter, In International Conference on Applications of Natural Language to Information Systems, pages 57–64. Springer, 2018.

Mikel Artetxe Gorka Labaka Eneko Agirre Kyunghyun Cho , Unsupervised neural machine translation, arXiv preprint arXiv:1710.11041, 2017.

Pinkesh Badjatiya Shashank Gupta Manish Gupta Vasudeva Varma , Deep learning for hate speech detection in tweets, In Proceedings of the 26th international conference on World Wide Web companion, pages 759–760, 2017.

Dzmitry Bahdanau Kyunghyun Cho Yoshua Bengio , Neural machine translation by jointly learning to align and translate, 2016.

Tadesse Destaw Belay Atnafu Lambebo Tonja Olga Kolesnikova Seid Muhie Yimam Abinew Ali Ayele Silesh Bogale Haile GrigoriSidorov Alexander Gelbukh , The effect of normalization for bi-directional amharic-english neural machine translation, In 2022 International Conference on Information and Communication Technology for Development for Africa (ICT4DA), pages 84–89. IEEE, 2022.

Jonathan Berant Percy Liang , Semantic parsing via paraphrasing, In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 1415–1425, 2014.

10.

Steven Bird Ewan Klein Edward Loper , Natural language processing with Python: analyzing text with the natural language toolkit, “O’Reilly Media, Inc.”, 2009.

11.

Ondřej Bojar Rajen Chatterjee Christian Federmann YvetteGraham Barry Haddow Matthias Huck Antonio Jimeno Yepes Philipp Koehn Varvara Logacheva Christof Monz Matteo Negri Aurélie Névéol Mariana Neves Martin Popel Matt Post Raphael Rubino Carolina Scarton Lucia Specia Marco Turchi Karin Verspoor Marcos Zampieri , Findings of the 2016 conference on machine translation, In Proceedings of the First Conference on Machine Translation: Volume 2, Shared Task Papers, pages 131–198, Berlin, Germany, August 2016. Association for Computational Linguistics, doi: 10.18653/v1/W16-2301, URL https://aclanthology.org/W16-2301.

12.

Christopher Callison-Burch , Paraphrasing and translation, PhD thesis, University of Edinburgh Edinburgh, 2007.

13.

José Cañete Gabriel Chaperon Rodrigo Fuentes Jou-Hui Ho Hojin Kang Jorge Pérez , Spanish pre-trained bert model and evaluation data, In PML4DC at ICLR 2020, 2020.

14.

David Chen William Dolan

, Collecting highly parallel data for paraphrase evaluation, In Proceedings of the 49th annual meeting of the association for computational linguistics: human language technologies, pages 190–200, 2011.

15.

Himanshu Choudhary Aditya Kumar Pathak Rajiv Ratan Saha Ponnurangam Kumaraguru , Neural machine translation for english-tamil, In Proceedings of the third conference on machine translation: shared task papers, pages 770–775, 2018.

16.

Anna Currey Kenneth Heafield , Zero-resource neural machine translation with monolingual pivot data, In Proceedings of the 3rd Workshop on Neural Generation and Translation, pages 99–107, 2019.

17.

Thomas Davidson Dana Warmsley Michael Macy Ingmar Weber , Automated hate speech detection and the problem of offensivelanguage, In Proceedings of the International AAAI Conferenceon Web and Social Media11 (2017), 512–515.

18.

Angel Felipe Magnossão de Paula Roberto Fray da Silva Ipek Baris Schlicht , Sexism prediction in spanish and english tweets using monolingual and multilingual bert and ensemble models, 2021, URL https://arxiv.org/abs/2111.04551

19.

Gloria del Valle-Cano Lara Quijano-Sánchez Federico Liberatore Jesús Gómez , Socialhaterbert: A dichotomous approach for automatically detecting hate speech on twitter through textual analysis and user profiles, Expert Systems with Applications216 (2023), 119446. ISSN 0957-4174, doi: https://doi.org/10.1016/j.eswa.2022.119446, URl https://www.sciencedirect.com/science/article/pii/S095741742202465425/04/202425/04/2024.

20.

Fabio Del Vigna12 andrea Cimino23 Felice Dell’Orletta MarinellaPetrocchi Maurizio Tesconi , Hate me, hate me not: Hate speech detection on facebook, In Proceedings of the first Italian conference on cybersecurity (ITASEC17), pages 86–95, 2017.

21.

Elozino Egonmwan Yllias Chali , Transformer and seq2seq model for paraphrase generation, In Proceedings of the 3rdWorkshop on Neural Generation and Translation, pages 249–255, Hong Kong, November 2019. Association for Computational Linguistics, doi:10.18653/v1/D19-5627, URl https://aclanthology.org/D19-5627.

22.

Anthony Fader Luke Zettlemoyer Oren Etzioni , Paraphrase-driven learning for open question answering, In Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 1608–1618, 2013.

23.

Elisabetta Fersini , Paolo Rosso , Maria Anzovino , Overview of the task on automatic misogyny identification at ibereval 2018, In IberEval@ SEPLN, pages 214–228, 2018.

24.

Iakes Goenaga Aitziber Atutxa Koldo Gojenola Arantza Casillas Arantza Díaz de Ilarraza Nerea Ezeiza Maite Oronoz AliciaPérez Olatz Perez-de-Viñaspre ,Automatic misogyny identification using neural networks, In Paolo Rosso, Julio Gonzalo, Raquel Mart´ýnez, Soto Montalvo and Jorge Carrillo de Albornoz, editors, Proceedings of the Third Workshop on Evaluation of Human Language Technologies for Iberian Languages (IberEval 2018) co-located with 34th Conference of the Spanish Society for Natural Language Processing (SEPLN 2018), Sevilla, Spain, September 18th, 2018, volume 2150 of CEURWorkshop Proceedings, pages 249–254. CEUR-WS.org, 2018, URL http://ceur-ws.org/Vol-2150/AMI paper4.pdf.

25.

Tommi Gröndahl Luca Pajola Mika Juuti Mauro Conti Asokan

, All you need is “love” evading hate speech detection, In Proceedings of the 11th ACM workshop on artificial intelligence and security, pages 2–12, 2018.

26.

John Hutchins

, Machine translation: A brief history, In Concise history of the language sciences, pages 431–445. Elsevier, 1995.

27.

Mohit Iyyer John Wieting Kevin Gimpel Luke Zettlemoyer , Adversarial example generation with syntactically controlled paraphrase networks, In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers), pages 1875–1885, New Orleans, Louisiana, June 2018. Association for Computational Linguistics, doi: 10.3233/CH-211286. , URL https://aclanthology.org/N18-1170.

28.

Melvin Johnson Mike Schuster Quoc Le

Maxim Krikun Yonghui Wu Zhifeng Chen Nikhil Thorat Fernanda Viégas Martin Wattenberg Greg Corrado , et al, Google’s multilingual neural machinetranslation system: Enabling zero-shot translation ,Transactions of the Association for Computational Linguistics5 (2017), 351–339.

29.

Marcin Junczys-Dowmunt Roman Grundkiewicz Tomasz Dwojak Hieu Hoang Kenneth Heafield Tom Neckermann Frank Seide UlrichGermann Alham Fikri Aji Nikolay Bogoychev andré Martins

F.T

Alexandra Birch , Marian: Fast neural machine translation in C++, In Proceedings of ACL 2018, System Demonstrations, pages 116–121, Melbourne, Australia, July 2018. Association for Computational Linguistics, URL http://www.aclweb.org/anthology/P18-4020.

30.

Endri Kacupaj Barshana Banerjee Kuldeep Singh Jens Lehmann , Paraqa: A question answering dataset with paraphrase responses for single-turn conversation, In The SemanticWeb: 18th International Conference, ESWC 2021, Virtual Event, June 6–10, 2021, Proceedings 18, pages 598–613. Springer, 2021.

31.

David Kauchak Regina Barzilay , Paraphrasing for automatic evaluation, In Proceedings of the Human Language Technology Conference of the NAACL, Main Conference, pages 455–462, 2006.

32.

Dorothy Kenny , Machine translation, In The Routledge handbook of translation and philosophy, pages 428–445. Routledge, 2018.

33.

Philipp Koehn Rebecca Knowles , Six challenges for neural machine translation, In Proceedings of the First Workshop on Neural Machine Translation, pages 28–39, Vancouver, August 2017. Association for Computational Linguistics, doi: 10.18653/v1/W17-3204, URL https://aclanthology.org/W17-3204.

34.

Mike Yinhan Liu Naman Goyal Marjan Ghazvininejad Abdelrahman Mohamed Omer Levy Veselin Stoyanov LukeZettlemoyer , BART: Denoising sequence-to-sequence pre-training for natural language generation, translation and comprehension, In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 7871–7880, Online, July 2020. Association for Computational Linguistics, doi: 10.18653/v1/2020.acl-main.703, URL https://aclanthology.org/2020.acl-main.703.

35.

Han Liu Fatima Chiroma Mihaela Cocea , Identification and classification of misogynous tweets using multiclassifier fusion, In Paolo Rosso, Julio Gonzalo, Raquel Martínez, Soto Montalvo and Jorge Carrillo de Albornoz, editors, Proceedings of the Third Workshop on Evaluation of Human Language Technologies for Iberian Languages (IberEval 2018) co-located with 34th Conference of the Spanish Society for Natural Language Processing (SEPLN 2018), Sevilla, Spain, September 18th, 2018, volume 2150 of CEUR Workshop Proceedings, pages 268–273. CEUR-WS.org, 2018, URL http://ceurws.org/Vol-2150/AMI paper7.pdf.

36.

Yinhan Liu Jiatao Gu Naman Goyal Xian Li Sergey Edunov Marjan Ghazvininejad Mike Luke Zettlemoyer , Multilingual Denoising Pre-training for Neural Machine Translation, Transactions of the Association for Computational Linguistics8 (2020), 726–742, ISSN 2307-387X, doi:10.1162/tacl_a_00343, URL https://doi.org/10.1162/tacl a 00343.

37.

Adam Lopez , Statistical machine translation, ACM ComputingSurveys (CSUR)40(3) (2008), 1––49.

38.

Mounica Maddela Fernando Alva-Manchego Wei Xu , Controllable text simplification with explicit paraphrasing, arXiv preprint arXiv:2010.11004, 2020.

39.

Nitin Madnani Bonnie Dorr

, Generating phrasal and sentential paraphrases: A survey of data-driven methods, Computational Linguistics36(3) (2010), 341–387. doi: 10.1162/coli_a_00002, URL https://aclanthology.org/J10-3003 .

40.

Thomas Mandl Sandip Modha M. Anand Kumar

, Bharathi Raja Chakravarthi , Overview of the hasoc track at fire 2020: Hate speech and offensive language identificationin tamil, malayalam, hindi, english and german, In Proceedings of the 12th Annual Meeting of the Forum for Information Retrieval Evaluation, FIRE ’’20, page 29–32, NewYork, NY, USA, 2021. Association for Computing Machinery, ISBN 9781450389785, doi: 10.1145/3441501.3441517, URL https://doi.org/10.1145/3441501.3441517.

41.

Binny Mathew Ritam Dutt Pawan Goyal Animesh Mukherjee , Spread of hate speech in online social media, In Proceedings of the 10th ACM conference on web science, pages 173–182, 2019.

42.

Hiroki Nakayama Takahiro Kubo Junya Kamura Yasufumi Taniguchi Xu Liang , doccano: Text annotation tool for human, 2018, URL https://github.com/doccano/doccano, Software available from https://github.com/doccano/doccano.

43.

Eda Okur Saurav Sahay Lama Nachman , Data augmentation with paraphrase generation and entity extraction for multimodal dialogue system, In Proceedings of the Thirteenth Language Resources and Evaluation Conference, pages 4114–4125, Marseille, France, June 2022. European Language Resources Association, URL https://aclanthology.org/2022.lrec-1.437.

44.

Germán Ortiz Helena Gómez-Adorno Jorge Reyes-Magaña Gemma Bel-Enguix Gerardo Sierra , Detection of aggressive tweets in mexican spanish using multiple features with parameter optimization, In IberLEF@ SEPLN, pages 520–525, 2019.

45.

Flor-Miriam Plaza-Del-Arco M. Dolores Molina-González Alfonso Ureña López

Teresa Martín-Valdivia

, Detecting misogyny and xenophobia in spanish tweets using language technologies, ACM Trans. Internet Technol. 20(2) (2022), ISSN doi: 10.1145/3369869, URL https://doi.org/10.1145/3369869.

46.

Shrimai Prabhumoye Yulia Tsvetkov Ruslan Salakhutdinov Alan Black

, Style transfer through back-translation, In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 866–876, Melbourne, Australia, July 2018. Association for Computational Linguistics, doi: 10.18653/v1/P18-1080, URL https://aclanthology.org/P18-1080.

47.

Colin Raffel Noam Shazeer Adam Roberts Katherine Lee Sharan Narang Michael Matena Yanqi Zhou Wei Li Peter Liu

, Exploring the limits of transfer learning with a unified text-to-text transformer, Journal of Machine Learning Research21(140) (2020), 1–67, URL http://jmlr.org/papers/v21/20-074.html.

48.

Tharindu Ranasinghe Marcos Zampieri , Multilingual offensive language identification with cross-lingual embeddings, In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 5838–5844, Online, November 2020. Association for Computational Linguistics, doi: 10.18653/v1/2020.emnlp-main.470, URL https://aclanthology.org/2020.emnlp-main.470.

49.

Paolo Rosso Julio Gonzalo Raquel Martínez Soto Montalvo Jorge Carrillo de Albornoz , editors, Proceedings of the Third Workshop on Evaluation of Human Language Technologies for Iberian Languages (IberEval 2018) co-located with 34th Conference of the Spanish Society for Natural Language Processing (SEPLN 2018), Sevilla, Spain, September 18th, 2018, volume 2150 of CEUR Workshop Proceedings, 2018. CEUR-WS.org, URL http://ceur-ws.org/Vol-2150.

50.

Koustuv Saha Eshwar Chandrasekharan Munmun De Choudhury , Prevalence and psychological effects of hateful speech in online college communities, In Proceedings of the 10th ACM conference on web science, pages 255–264, 2019.

51.

Sandeep Saini Vineet Sahula , Neural machine translation for english to hindi, In 2018 Fourth International Conference on Information Retrieval and Knowledge Management (CAMP), pages 1–6. IEEE, 2018.

52.

Sukanta Sen Kamal Kumar Gupta Asif Ekbal Pushpak Bhattacharyya , Iitp-mt at wat2018: Transformer-based multilingual indic-english neural machine translation system, In Proceedings of the 32nd Pacific Asia conference on language, information and computation: 5th workshop on Asian translation: 5th workshop on Asian translation, 2018.

53.

Tianxiao Shen Tao Lei Regina Barzilay Tommi Jaakkola , Style transfer from non-parallel text by crossalignment, In I. Guyon, U. Von Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan and R. Garnett, editors, Advances in Neural Information Processing Systems, volume 30. Curran Associates, Inc., 2017, URL https://proceedings.neurips.cc/paper_files/paper/2017/file/2d2c8394e31101a261abf1784302bf75-Paper.pdf.

54.

Yusuke Shinyama Satoshi Sekine , Paraphrase acquisition for information extraction, Technical report, NEW YORK UNIV NY DEPT OF COMPUTER SCIENCE, 2003.

55.

Elena Shushkevich John Cardiff , Classifying misogynistic tweets using a blended model: The AMI shared task in IBEREVAL 2018, In Paolo Rosso, Julio Gonzalo, Raquel Mart´ýnez, Soto Montalvo and Jorge Carrillo de Albornoz, editors, Proceedings of the Third Workshop on Evaluation of Human Language Technologies for Iberian Languages (IberEval 2018) co-located with 34th Conference of the Spanish Society for Natural Language Processing (SEPLN 2018), Sevilla, Spain, September 18th, 2018, volume 2150 of CEUR Workshop Proceedings, pages 255–259. CEUR-WS.org, 2018, URL http://ceurws.org/Vol-2150/AMI_paper5.pdf.

56.

Richard Socher Eric H. Huang

Jeffrey Pennington andrew Ng

Christopher Manning

, Dynamic pooling and unfolding recursive autoencoders for paraphrase detection, In Proceedings of the 24th International Conference on Neural Information Processing Systems, NIPS’11, page 801–809, Red Hook, NY, USA, 2011. Curran Associates Inc, ISBN 9781618395993.

57.

Felix Stahlberg , Neural machine translation: A review, Journalof Artificial Intelligence Research69 (2020), 343–418.

58.

Yu Su Xifeng Yan , Cross-domain semantic parsing via paraphrasing, arXiv preprint arXiv:1704.05974, 2017.

59.

Steven Sumner

Brock Ferguson Brian Bason Jacob Dink EllenYard Marci Hertz Brandon Hilkert Kristin Holland Melissa Mercado-Crespo Shichao Tang Christopher Jones

, Association of Online Risk Factors With Subsequent Youth Suicide-Related Behaviors in the US, JAMA Network Open4(9) (2021), e2125860–e2125860, ISSN 2574-3805,. doi: 10.1001/jamanetworkopen.2021.25860, URL https://doi.org/10.1001/jamanetworkopen.2021.25860.

60.

Ilya Sutskever Oriol Vinyals Quoc Le

, Sequence to sequence learning with neural networks, In Z. Ghahramani, M. Welling, C. Cortes, N. Lawrence and K.Q. Weinberger, editors, Advances in Neural Information Processing Systems, volume 27. Curran Associates, Inc., 2014, URL https://proceedings.neurips.cc/paper_files/paper/2014/file/a14ac55a4f27472c5d894ec1c3c743d2-Paper.pdf.

61.

Xu Tan Yi Ren Di He Tao Qin Zhou Zhao Tie-Yan Liu , Multilingual neural machine translation with knowledge distillation, arXiv preprint arXiv:1902.10461, 2019.

62.

Aswini Thota , Priyanka Tilak , Simrat Ahluwalia Nibrat Lohia , Fake news detection: a deep learning approach, SMU Data ScienceReview1(3) (2018), 10.

63.

Jörg Tiedemann Santhosh Thottingal , OPUS-MT —Building open translation services for the World, In Proceedings of the 22nd Annual Conferenec of the European Association for Machine Translation (EAMT), Lisbon, Portugal, 2020.

64.

Jörg Tiedemann , Parallel data, tools and interfaces in opus, In Nicoletta Calzolari (Conference Chair), Khalid Choukri, Thierry Declerck, Mehmet Ugur Dogan, Bente Maegaard, Joseph Mariani, Jan Odijk and Stelios Piperidis, editors, Proceedings of the Eight International Conference on Language Resources and Evaluation (LREC’12), Istanbul, Turkey, may 2012. European Language Resources Association (ELRA), ISBN 978-2-9517408-7-7.

65.

Atnafu Lambebo Tonja Muhammad Arif Olga Kolesnikova Alexander Gelbukh Grigori Sidorov , Detection of aggressive and violent incidents from social media in spanish using pre-trained language model, In Proceedings of the Iberian Languages Evaluation Forum (IberLEF 2022), CEUR Workshop Proceedings. CEUR-WS. org, 2022.

66.

Atnafu Lambebo Tonja Olga Kolesnikova Muhammad Arif AlexanderGelbukh Grigori Sidorov , Improving neural machine translation for low resource languages using mixed training: The case of ethiopian languages, In Advances in Computational Intelligence: 21st Mexican International Conference on Artificial Intelligence, MICAI 2022, Monterrey, Mexico, October 24–29, 2022, Proceedings, Part II, pages 30–40. Springer, 2022.

67.

Atnafu Lambebo Tonja Olga Kolesnikova Alexander Gelbukh Grigori Sidorov , Low-resource neural machine translation improvementusing source-side monolingual data, Applied Sciences13(2) (2023), 1201.

68.

Ashish Vaswani Noam Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan N Gomez

ukasz Kaiser

Illia Polosukhin , Attention is all you need, In I. Guyon, U. Von Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan and R. Garnett, editors, Advances in Neural Information Processing Systems, volume 30. Curran Associates, Inc., 2017, URL https://proceedings.neurips.cc/paperfiles/paper/2017/file/3f5ee243547dee91fbd053c1c4a845aa-Paper.pdf

69.

John Wieting Kevin Gimpel Graham Neubig Taylor Berg-Kirkpatrick , Simple and effective paraphrastic similarity from parallel translations, In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 4602–4608, Florence, Italy, July 2019. Association for Computational Linguistics, doi: 10.18653/v1/P19-1453, URL https://aclanthology.org/P19-453.

70.

Sam Witteveen Martin Andrews , Paraphrasing with large language models, In Proceedings of the 3rd Workshop on Neural Generation and Translation, pages 215–220, Hong Kong, November 2019. Association for Computational Linguistics, doi: 10.18653/v1/D19-5623, URL https://aclanthology.org/D19-5623.

71.

Yonghui Wu Mike Schuster Zhifeng Chen Quoc Le Mohammad Norouzi

Wolfgang Macherey Maxim Krikun Yuan Cao Qin Gao Klaus Macherey Jeff Klingner Apurva Shah Melvin Johnson Xiaobing Liu Łukasz Kaiser Stephan Gouws Yoshikiyo Kato Taku Kudo Hideto Kazawa Keith Stevens George Kurian Nishant Patil Wei Wang Cliff Young Jason Smith Jason Riesa Alex Rudnick Oriol Vinyals Greg Corrado Macduff Hughes Jeffrey Dean , Google’s neural machine translation system: Bridging the gap between human and machine translation, 2016.

72.

Wei Xu Courtney Napoles Ellie Pavlick Quanze Chen Chris Callison-Burch , Optimizing Statistical Machine Translation for Text Simplification, Transactions of the Association for Computational Linguistics4 (2016), 401–415 ISSN 2307-387X, doi: 10.1162/tacl_a_00107, URL https://doi.org/10.1162/tacl_a_00107.

73.

Seid Muhie Yimam Chris Biemann , Par4sim–adaptive paraphrasing for text simplification, arXiv preprint arXiv:1806.08309, 2018.

74.

Jianing Zhou Suma Bhat , Paraphrase generation: A survey of the state of the art, In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, pages 5075–5086, Online and Punta Cana, Dominican Republic, November 2021. Association for Computational Linguistics, doi: 10.18653/v1/2021.emnlp-main.414, URL https://aclanthology.org/2021.emnlp-main.414.

Reframing social media discourse: Converting hate speech to non-hate speech

Abstract

Keywords

Get full access to this article

References