English
Related papers

Related papers: ToxiGen: A Large-Scale Machine-Generated Dataset f…

200 papers

Accurate detection and classification of online hate is a difficult task. Implicit hate is particularly challenging as such content tends to have unusual syntax, polysemic words, and fewer markers of prejudice (e.g., slurs). This problem is…

Computation and Language · Computer Science 2021-06-11 Austin Botelho , Bertie Vidgen , Scott A. Hale

To address the global challenge of online hate speech, prior research has developed detection models to flag such content on social media. However, due to systematic biases in evaluation datasets, the real-world effectiveness of these…

Computation and Language · Computer Science 2025-06-04 Manuel Tonneau , Diyi Liu , Niyati Malhotra , Scott A. Hale , Samuel P. Fraiberger , Victor Orozco-Olvera , Paul Röttger

What should a malicious user write next to fool a detection model? Identifying malicious users is critical to ensure the safety and integrity of internet platforms. Several deep learning-based detection models have been created. However,…

Machine Learning · Computer Science 2021-10-20 Bing He , Mustaque Ahamad , Srijan Kumar

With the exponential rise in user-generated web content on social media, the proliferation of abusive languages towards an individual or a group across the different sections of the internet is also rapidly increasing. It is very…

Computation and Language · Computer Science 2021-03-24 Prashant Kapil , Asif Ekbal

Automatic identification of hateful and abusive content is vital in combating the spread of harmful online content and its damaging effects. Most existing works evaluate models by examining the generalization error on train-test splits on…

Computation and Language · Computer Science 2025-04-07 Lanqin Yuan , Marian-Andrei Rizoiu

Technologies for abusive language detection are being developed and applied with little consideration of their potential biases. We examine racial bias in five different sets of Twitter data annotated for hate speech and abusive language.…

Computation and Language · Computer Science 2019-05-30 Thomas Davidson , Debasmita Bhattacharya , Ingmar Weber

Large Language Models (LLMs) have raised increasing concerns about their misuse in generating hate speech. Among all the efforts to address this issue, hate speech detectors play a crucial role. However, the effectiveness of different…

Cryptography and Security · Computer Science 2025-01-29 Xinyue Shen , Yixin Wu , Yiting Qu , Michael Backes , Savvas Zannettou , Yang Zhang

Hate speech classification has been a long-standing problem in natural language processing. However, even though there are numerous hate speech detection methods, they usually overlook a lot of hateful statements due to them being implicit…

Computation and Language · Computer Science 2022-08-30 Debaditya Pal , Kaustubh Chaudhari , Harsh Sharma

Detecting and classifying instances of hate in social media text has been a problem of interest in Natural Language Processing in the recent years. Our work leverages state of the art Transformer language models to identify hate speech in a…

Computation and Language · Computer Science 2021-01-12 Sayar Ghosh Roy , Ujwal Narayan , Tathagata Raha , Zubair Abid , Vasudeva Varma

Well-annotated data is a prerequisite for good Natural Language Processing models. Too often, though, annotation decisions are governed by optimizing time or annotator agreement. We make a case for nuanced efforts in an interdisciplinary…

Computation and Language · Computer Science 2022-10-31 Federico Bianchi , Stefanie Anja Hills , Patricia Rossini , Dirk Hovy , Rebekah Tromble , Nava Tintarev

With the proliferation of social media, there has been a sharp increase in offensive content, particularly targeting vulnerable groups, exacerbating social problems such as hatred, racism, and sexism. Detecting offensive language use is…

Computation and Language · Computer Science 2023-12-05 Toygar Tanyel , Besher Alkurdi , Serkan Ayvaz

The tremendous growth of social media users interacting in online conversations has led to significant growth in hate speech, affecting people from various demographics. Most of the prior works focus on detecting explicit hate speech, which…

Machine Learning · Computer Science 2023-10-25 Sreyan Ghosh , Manan Suri , Purva Chiniya , Utkarsh Tyagi , Sonal Kumar , Dinesh Manocha

Social media platforms are increasingly dominated by long-form multimodal content, where harmful narratives are constructed through a complex interplay of audio, visual, and textual cues. While automated systems can flag hate speech with…

Artificial Intelligence · Computer Science 2026-05-29 Girish A. Koushik , Helen Treharne , Diptesh Kanojia

Automated hate speech detection is an important tool in combating the spread of hate speech, particularly in social media. Numerous methods have been developed for the task, including a recent proliferation of deep-learning based…

Computation and Language · Computer Science 2023-12-08 Jitendra Singh Malik , Hezhe Qiao , Guansong Pang , Anton van den Hengel

We present a dataset and classifier for detecting the language of white supremacist extremism, a growing issue in online hate speech. Our weakly supervised classifier is trained on large datasets of text from explicitly white supremacist…

Computation and Language · Computer Science 2023-06-29 Michael Miller Yoder , Ahmad Diab , David West Brown , Kathleen M. Carley

Pretrained neural language models (LMs) are prone to generating racist, sexist, or otherwise toxic language which hinders their safe deployment. We investigate the extent to which pretrained LMs can be prompted to generate toxic language,…

Computation and Language · Computer Science 2020-09-29 Samuel Gehman , Suchin Gururangan , Maarten Sap , Yejin Choi , Noah A. Smith

Hate speech remains prevalent in human society and continues to evolve in its forms and expressions. Modern advancements in internet and online anonymity accelerate its rapid spread and complicate its detection. However, hate speech…

Computation and Language · Computer Science 2026-04-24 Yejin Lee , Hyeseon Ahn , Yo-Sub Han

Recently efforts have been made by social media platforms as well as researchers to detect hateful or toxic language using large language models. However, none of these works aim to use explanation, additional context and victim community…

Computation and Language · Computer Science 2023-10-31 Sarthak Roy , Ashish Harshavardhan , Animesh Mukherjee , Punyajoy Saha

The meteoric rise in text generation capability has been accompanied by parallel growth in interest in machine-generated text detection: the capability to identify whether a given text was generated using a model or written by a person.…

Computation and Language · Computer Science 2026-04-24 Kevin Stowe , Svetlana Afanaseva , Rodolfo Raimundo , Yitao Sun , Kailash Patil

Toxic online content has become a major issue in today's world due to an exponential increase in the use of internet by people of different cultures and educational background. Differentiating hate speech and offensive language is a key…

Computation and Language · Computer Science 2018-09-25 Aditya Gaydhani , Vikrant Doma , Shrikant Kendre , Laxmi Bhagwat