English
Related papers

Related papers: Directions in Abusive Language Training Data: Garb…

200 papers

The fundamental problem in toxicity detection task lies in the fact that the toxicity is ill-defined. This causes us to rely on subjective and vague data in models' training, which results in non-robust and non-accurate results: garbage in…

Computation and Language · Computer Science 2023-10-23 Sergey Berezin , Reza Farahbakhsh , Noel Crespi

Abusive language detection models tend to have a problem of being biased toward identity words of a certain group of people because of imbalanced training datasets. For example, "You are a good woman" was considered "sexist" when trained on…

Computation and Language · Computer Science 2018-08-23 Ji Ho Park , Jamin Shin , Pascale Fung

Data poisoning is a type of adversarial attack on training data where an attacker manipulates a fraction of data to degrade the performance of machine learning model. Therefore, applications that rely on external data-sources for training…

Machine Learning · Computer Science 2021-04-28 Sanjay Seetharaman , Shubham Malaviya , Rosni KV , Manish Shukla , Sachin Lodha

Idioms are figurative expressions whose meanings often cannot be inferred from their individual words, making them difficult to process computationally and posing challenges for human experimental studies. This survey reviews datasets…

Computation and Language · Computer Science 2025-08-19 Michael Flor , Xinyi Liu , Anna Feldman

With the advance of language models, privacy protection is receiving more attention. Training data extraction is therefore of great importance, as it can serve as a potential tool to assess privacy leakage. However, due to the difficulty of…

Computation and Language · Computer Science 2023-06-02 Weichen Yu , Tianyu Pang , Qian Liu , Chao Du , Bingyi Kang , Yan Huang , Min Lin , Shuicheng Yan

Current research on hate speech analysis is typically oriented towards monolingual and single classification tasks. In this paper, we present a new multilingual multi-aspect hate speech analysis dataset and use it to test the current…

Computation and Language · Computer Science 2019-08-30 Nedjma Ousidhoum , Zizheng Lin , Hongming Zhang , Yangqiu Song , Dit-Yan Yeung

The original goal of any social media platform is to facilitate users to indulge in healthy and meaningful conversations. But more often than not, it has been found that it becomes an avenue for wanton attacks. We want to alleviate this…

Computation and Language · Computer Science 2020-01-31 Tuhin Chakrabarty , Kilol Gupta

Large language models (LLMs) excel in many diverse applications beyond language generation, e.g., translation, summarization, and sentiment analysis. One intriguing application is in text classification. This becomes pertinent in the realm…

Computation and Language · Computer Science 2024-03-14 Tharindu Kumarage , Amrita Bhattacharjee , Joshua Garland

There is an increase in the proliferation of online hate commensurate with the rise in the usage of social media. In response, there is also a significant advancement in the creation of automated tools aimed at identifying harmful text…

Computation and Language · Computer Science 2024-06-10 Rabiraj Bandyopadhyay , Dennis Assenmacher , Jose M. Alonso Moral , Claudia Wagner

The emergence of open data portals necessitates more attention to protecting sensitive data before datasets get published and exchanged. To do so effectively, we observe the need to refine and broaden our definitions of sensitive data, and…

Cryptography and Security · Computer Science 2026-03-16 Liang Telkamp , Madelon Hulsebos

The purpose of this paper is to ascertain the influence of sociocultural factors (i.e., social, cultural, and political) in the development of hate speech detection systems. We set out to investigate the suitability of using open-source…

Computation and Language · Computer Science 2024-07-02 Sidney G. -J. Wong

To identify and classify toxic online commentary, the modern tools of data science transform raw text into key features from which either thresholding or learning algorithms can make predictions for monitoring offensive conversations. We…

Machine Learning · Computer Science 2018-10-05 David Noever

The widespread use of offensive content in social media has led to an abundance of research in detecting language such as hate speech, cyberbullying, and cyber-aggression. Recent work presented the OLID dataset, which follows a taxonomy for…

Computation and Language · Computer Science 2021-09-27 Sara Rosenthal , Pepa Atanasova , Georgi Karadzhov , Marcos Zampieri , Preslav Nakov

The prevalence of toxic content on social media platforms, such as hate speech, offensive language, and misogyny, presents serious challenges to our interconnected society. These challenging issues have attracted widespread attention in…

Computation and Language · Computer Science 2022-06-20 Abdelkader El Mahdaouy , Abdellah El Mekki , Ahmed Oumar , Hajar Mousannif , Ismail Berrada

Hate speech is commonly defined as any communication that disparages a target group of people based on some characteristic such as race, colour, ethnicity, gender, sexual orientation, nationality, religion, or other characteristic. Due to…

Computation and Language · Computer Science 2018-09-13 Ona de Gibert , Naiara Perez , Aitor García-Pablos , Montse Cuadros

Text classification is an important topic in the field of natural language processing. It has been preliminarily applied in information retrieval, digital library, automatic abstracting, text filtering, word semantic discrimination and many…

Computation and Language · Computer Science 2023-12-20 Hao Li , Brandon Bennett

Hate speech, offensive language, aggression, racism, sexism, and other abusive language are common phenomena in social media. There is a need for Artificial Intelligence(AI)based intervention which can filter hate content at scale. Most…

Computation and Language · Computer Science 2024-11-13 Prashant Kapil , Asif Ekbal

The recent progress in language-based open-vocabulary object detection can be largely attributed to finding better ways of leveraging large-scale data with free-form text annotations. Training such models with a discriminative objective…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Shiyu Zhao , Long Zhao , Vijay Kumar B. G , Yumin Suh , Dimitris N. Metaxas , Manmohan Chandraker , Samuel Schulter

Implicit hate speech has recently emerged as a critical challenge for social media platforms. While much of the research has traditionally focused on harmful speech in general, the need for generalizable techniques to detect veiled and…

Computation and Language · Computer Science 2025-06-23 Saad Almohaimeed , Saleh Almohaimeed , Damla Turgut , Ladislau Bölöni

Large language models produce human-like text that drive a growing number of applications. However, recent literature and, increasingly, real world observations, have demonstrated that these models can generate language that is toxic,…