English
Related papers

Related papers: HateBERT: Retraining BERT for Abusive Language Det…

200 papers

With the COVID-19 pandemic continuing, hatred against Asians is intensifying in countries outside Asia, especially among the Chinese. There is an urgent need to detect and prevent hate speech towards Asians effectively. In this work, we…

Computation and Language · Computer Science 2022-08-23 Xin Lian

Automatic hate speech detection is hampered by the scarcity of labeled datasetd, leading to poor generalization. We employ pretrained language models (LMs) to alleviate this data bottleneck. We utilize the GPT LM for generating large…

Computation and Language · Computer Science 2021-09-03 Tomer Wullach , Amir Adler , Einat Minkov

Algorithms are widely applied to detect hate speech and abusive language in social media. We investigated whether the human-annotated data used to train these algorithms are biased. We utilized a publicly available annotated Twitter dataset…

Computation and Language · Computer Science 2020-05-29 Jae Yeon Kim , Carlos Ortiz , Sarah Nam , Sarah Santiago , Vivek Datta

In the current landscape of language model research, larger models, larger datasets and more compute seems to be the only way to advance towards intelligence. While there have been extensive studies of scaling laws and models' scaling…

Computation and Language · Computer Science 2024-08-01 Muhammad Ali , Swetasudha Panda , Qinlan Shen , Michael Wick , Ari Kobren

With the spread of social networks and their unfortunate use for hate speech, automatic detection of the latter has become a pressing problem. In this paper, we reproduce seven state-of-the-art hate speech detection models from prior work,…

Computation and Language · Computer Science 2018-11-06 Tommi Gröndahl , Luca Pajola , Mika Juuti , Mauro Conti , N. Asokan

Hate speech and toxic comments are a common concern of social media platform users. Although these comments are, fortunately, the minority in these platforms, they are still capable of causing harm. Therefore, identifying these comments is…

Computation and Language · Computer Science 2020-10-12 João A. Leite , Diego F. Silva , Kalina Bontcheva , Carolina Scarton

Adversarial attacks for discrete data (such as texts) have been proved significantly more challenging than continuous data (such as images) since it is difficult to generate adversarial samples with gradient-based methods. Current…

Computation and Language · Computer Science 2020-10-05 Linyang Li , Ruotian Ma , Qipeng Guo , Xiangyang Xue , Xipeng Qiu

In this review, we describe the application of one of the most popular deep learning-based language models - BERT. The paper describes the mechanism of operation of this model, the main areas of its application to the tasks of text…

Computation and Language · Computer Science 2021-03-23 M. V. Koroteev

The advent of social media has given rise to numerous ethical challenges, with hate speech among the most significant concerns. Researchers are attempting to tackle this problem by leveraging hate-speech detection and employing language…

Computation and Language · Computer Science 2023-05-31 Pranath Reddy Kumbam , Sohaib Uddin Syed , Prashanth Thamminedi , Suhas Harish , Ian Perera , Bonnie J. Dorr

The lack of a commonly used benchmark data set (collection) such as (Super-)GLUE (Wang et al., 2018, 2019) for the evaluation of non-English pre-trained language models is a severe shortcoming of current English-centric NLP-research. It…

Computation and Language · Computer Science 2021-07-06 M. Aßenmacher , A. Corvonato , C. Heumann

This paper explores hate speech detection in Devanagari-scripted languages, focusing on Hindi and Nepali, for Subtask B of the CHIPSAL@COLING 2025 Shared Task. Using a range of transformer-based models such as XLM-RoBERTa, MURIL, and…

Computation and Language · Computer Science 2024-12-13 Anmol Guragain , Nadika Poudel , Rajesh Piryani , Bishesh Khanal

Warning: This paper contains examples of the language that some people may find offensive. Detecting and reducing hateful, abusive, offensive comments is a critical and challenging task on social media. Moreover, few studies aim to mitigate…

Computation and Language · Computer Science 2023-12-21 Neeraj Kumar Singh , Koyel Ghosh , Joy Mahapatra , Utpal Garain , Apurbalal Senapati

The hate speech detection task is known to suffer from bias against African American English (AAE) dialect text, due to the annotation bias present in the underlying hate speech datasets used to train these models. This leads to a disparity…

Computation and Language · Computer Science 2025-01-28 Diana Iftimie , Erik Zinn

Twitter is a well-known microblogging social site where users express their views and opinions in real-time. As a result, tweets tend to contain valuable information. With the advancements of deep learning in the domain of natural language…

Computation and Language · Computer Science 2020-10-22 Mohiuddin Md Abdul Qudar , Vijay Mago

The spread of cyber hatred has led to communal violence, fueling aggression and conflicts between various religious, ethnic, and social groups, posing a significant threat to social harmony. Despite its critical importance, the…

Computation and Language · Computer Science 2025-06-25 Abdullah Khondoker , Enam Ahmed Taufik , Md. Iftekhar Islam Tashik , S M Ishtiak Mahmud , Farig Sadeque

This paper is a contribution to the Hate Speech and Offensive Content Identification in Indo-European Languages (HASOC) 2021 shared task. Social media today is a hotbed of toxic and hateful conversations, in various languages. Recent news…

Computation and Language · Computer Science 2021-09-29 Mehar Bhatia , Tenzin Singhay Bhotia , Akshat Agarwal , Prakash Ramesh , Shubham Gupta , Kumar Shridhar , Felix Laumann , Ayushman Dash

Language model pretraining has led to significant performance gains but careful comparison between different approaches is challenging. Training is computationally expensive, often done on private datasets of different sizes, and, as we…

Computation and Language · Computer Science 2019-07-29 Yinhan Liu , Myle Ott , Naman Goyal , Jingfei Du , Mandar Joshi , Danqi Chen , Omer Levy , Mike Lewis , Luke Zettlemoyer , Veselin Stoyanov

The advent of Large Language Models (LLMs) has advanced the benchmark in various Natural Language Processing (NLP) tasks. However, large amounts of labelled training data are required to train LLMs. Furthermore, data annotation and training…

Computation and Language · Computer Science 2024-03-05 Sargam Yadav , Abhishek Kaushik , Kevin McDaid

Most research on hate speech detection has focused on English where a sizeable amount of labeled training data is available. However, to expand hate speech detection into more languages, approaches that require minimal training data are…

Computation and Language · Computer Science 2023-06-13 Janis Goldzycher , Moritz Preisig , Chantal Amrhein , Gerold Schneider

Offensive language detection is one of the most challenging problem in the natural language processing field, being imposed by the rising presence of this phenomenon in online social media. This paper describes our Transformer-based…

Computation and Language · Computer Science 2020-10-28 Mircea-Adrian Tanase , Dumitru-Clementin Cercel , Costin-Gabriel Chiru