English
Related papers

Related papers: DefVerify: Do Hate Speech Models Reflect Their Dat…

200 papers

Hate speech is a major issue in social networks due to the high volume of data generated daily. Recent works demonstrate the usefulness of machine learning (ML) in dealing with the nuances required to distinguish between hateful posts from…

Computation and Language · Computer Science 2022-01-19 Rafael M. O. Cruz , Woshington V. de Sousa , George D. C. Cavalcanti

Most research on hate speech detection has focused on English where a sizeable amount of labeled training data is available. However, to expand hate speech detection into more languages, approaches that require minimal training data are…

Computation and Language · Computer Science 2023-06-13 Janis Goldzycher , Moritz Preisig , Chantal Amrhein , Gerold Schneider

Bias mitigation approaches reduce models' dependence on sensitive features of data, such as social group tokens (SGTs), resulting in equal predictions across the sensitive features. In hate speech detection, however, equalizing model…

Computation and Language · Computer Science 2021-08-05 Aida Mostafazadeh Davani , Ali Omrani , Brendan Kennedy , Mohammad Atari , Xiang Ren , Morteza Dehghani

Hate speech classifiers exhibit substantial performance degradation when evaluated on datasets different from the source. This is due to learning spurious correlations between words that are not necessarily relevant to hateful language, and…

Computation and Language · Computer Science 2022-03-24 Tulika Bose , Nikolaos Aletras , Irina Illina , Dominique Fohr

The widespread use of social media platforms like Twitter and Facebook has enabled people of all ages to share their thoughts and experiences, leading to an immense accumulation of user-generated content. However, alongside the benefits,…

Computation and Language · Computer Science 2025-03-26 Aniket Deroy , Subhankar Maity

Toxic speech, also known as hate speech, is regarded as one of the crucial issues plaguing online social media today. Most recent work on toxic speech detection is constrained to the modality of text and written conversations with very…

Computation and Language · Computer Science 2022-04-05 Sreyan Ghosh , Samden Lepcha , S Sakshi , Rajiv Ratn Shah , S. Umesh

Statistical natural language inference (NLI) models are susceptible to learning dataset bias: superficial cues that happen to associate with the label on a particular dataset, but are not useful in general, e.g., negation words indicate…

Computation and Language · Computer Science 2019-11-26 He He , Sheng Zha , Haohan Wang

A growing body of work has focused on text classification methods for detecting the increasing amount of hate speech posted online. This progress has been limited to only a select number of highly-resourced languages causing detection…

Computation and Language · Computer Science 2023-10-05 Aman Khullar , Daniel Nkemelu , Cuong V. Nguyen , Michael L. Best

Language models are prone to dataset biases, known as shortcuts and spurious correlations in data, which often result in performance drop on new data. We present a new debiasing framework called ``FairFlow'' that mitigates dataset biases by…

Machine Learning · Computer Science 2025-03-25 Jiali Cheng , Hadi Amiri

Standard approaches to hate speech detection rely on sufficient available hate speech annotations. Extending previous work that repurposes natural language inference (NLI) models for zero-shot text classification, we propose a simple…

Computation and Language · Computer Science 2022-10-04 Janis Goldzycher , Gerold Schneider

Hate speech detection deals with many language variants, slang, slurs, expression modalities, and cultural nuances. This outlines the importance of working with specific corpora, when addressing hate speech within the scope of Natural…

Computation and Language · Computer Science 2024-10-17 Juan Manuel Pérez , Paula Miguel , Viviana Cotik

Although social media platforms are a prominent arena for users to engage in interpersonal discussions and express opinions, the facade and anonymity offered by social media may allow users to spew hate speech and offensive content. Given…

Computation and Language · Computer Science 2024-05-09 Ayushi Nirmal , Amrita Bhattacharjee , Paras Sheth , Huan Liu

Despite the widespread adoption, there is a lack of research into how various critical aspects of pretrained language models (PLMs) affect their performance in hate speech detection. Through five research questions, our findings and…

Computation and Language · Computer Science 2024-02-06 Sarah Masud , Mohammad Aflah Khan , Vikram Goyal , Md Shad Akhtar , Tanmoy Chakraborty

This paper investigates how hate speech varies in systematic ways according to the identities it targets. Across multiple hate speech datasets annotated for targeted identities, we find that classifiers trained on hate speech targeting…

Computation and Language · Computer Science 2022-12-08 Michael Miller Yoder , Lynnette Hui Xian Ng , David West Brown , Kathleen M. Carley

In current hate speech datasets, there exists a high correlation between annotators' perceptions of toxicity and signals of African American English (AAE). This bias in annotated training data and the tendency of machine learning models to…

Computation and Language · Computer Science 2020-05-26 Mengzhou Xia , Anjalie Field , Yulia Tsvetkov

The detection of hate speech online has become an important task, as offensive language such as hurtful, obscene and insulting content can harm marginalized people or groups. This paper presents TU Berlin team experiments and results on the…

Computation and Language · Computer Science 2022-01-13 Salar Mohtaj , Vera Schmitt , Sebastian Möller

Decomposable tasks are complex and comprise of a hierarchy of sub-tasks. Spoken intent prediction, for example, combines automatic speech recognition and natural language understanding. Existing benchmarks, however, typically hold out…

Computation and Language · Computer Science 2021-06-30 Siddhant Arora , Alissa Ostapenko , Vijay Viswanathan , Siddharth Dalmia , Florian Metze , Shinji Watanabe , Alan W Black

Recently efforts have been made by social media platforms as well as researchers to detect hateful or toxic language using large language models. However, none of these works aim to use explanation, additional context and victim community…

Computation and Language · Computer Science 2023-10-31 Sarthak Roy , Ashish Harshavardhan , Animesh Mukherjee , Punyajoy Saha

Hate speech on social media is a growing concern, and automated methods have so far been sub-par at reliably detecting it. A major challenge lies in the potentially evasive nature of hate speech due to the ambiguity and fast evolution of…

Computation and Language · Computer Science 2021-03-17 Maximilian Kupi , Michael Bodnar , Nikolas Schmidt , Carlos Eduardo Posada

Our study addresses a significant gap in online hate speech detection research by focusing on homophobia, an area often neglected in sentiment analysis research. Utilising advanced sentiment analysis models, particularly BERT, and…

Computation and Language · Computer Science 2024-05-16 Josh McGiff , Nikola S. Nikolov