English
Related papers

Related papers: Challenges in Automated Debiasing for Toxic Langua…

200 papers

With the recent rise of toxicity in online conversations on social media platforms, using modern machine learning algorithms for toxic comment detection has become a central focus of many online applications. Researchers and companies have…

Artificial Intelligence · Computer Science 2020-03-30 Ameya Vaidya , Feng Mai , Yue Ning

To collect large scale annotated data, it is inevitable to introduce label noise, i.e., incorrect class labels. To be robust against label noise, many successful methods rely on the noisy classifiers (i.e., models trained on the noisy…

Computer Vision and Pattern Recognition · Computer Science 2020-11-23 Songzhu Zheng , Pengxiang Wu , Aman Goswami , Mayank Goswami , Dimitris Metaxas , Chao Chen

Hate speech classifiers exhibit substantial performance degradation when evaluated on datasets different from the source. This is due to learning spurious correlations between words that are not necessarily relevant to hateful language, and…

Computation and Language · Computer Science 2022-03-24 Tulika Bose , Nikolaos Aletras , Irina Illina , Dominique Fohr

Many studies have shown various biases targeting different demographic groups in language models, amplifying discrimination and harming fairness. Recent parameter modification debiasing approaches significantly degrade core capabilities…

Computation and Language · Computer Science 2025-10-01 Dianqing Liu , Yi Liu , Guoqing Jin , Zhendong Mao

Business communication digitisation has reorganised the process of persuasive discourse, which allows not only greater transparency but also advanced deception. This inquiry synthesises classical rhetoric and communication psychology with…

Computation and Language · Computer Science 2025-08-14 Sayem Hossen , Monalisa Moon Joti , Md. Golam Rashed

Previous works on the fairness of toxic language classifiers compare the output of models with different identity terms as input features but do not consider the impact of other important concepts present in the context. Here, besides…

Computation and Language · Computer Science 2022-10-20 Isar Nejadgholi , Esma Balkır , Kathleen C. Fraser , Svetlana Kiritchenko

The social biases and unwelcome stereotypes revealed by pretrained language models are becoming obstacles to their application. Compared to numerous debiasing methods targeting word level, there has been relatively less attention on biases…

Computation and Language · Computer Science 2024-01-26 Bingkang Shi , Xiaodan Zhang , Dehan Kong , Yulei Wu , Zongzhen Liu , Honglei Lyu , Longtao Huang

Vision-language models can encode societal biases and stereotypes, but there are challenges to measuring and mitigating these multimodal harms due to lacking measurement robustness and feature degradation. To address these challenges, we…

Machine Learning · Computer Science 2022-10-27 Hugo Berg , Siobhan Mackenzie Hall , Yash Bhalgat , Wonsuk Yang , Hannah Rose Kirk , Aleksandar Shtedritski , Max Bain

Word embeddings trained on large corpora have shown to encode high levels of unfair discriminatory gender, racial, religious and ethnic biases. In contrast, human-written dictionaries describe the meanings of words in a concise, objective…

Computation and Language · Computer Science 2021-01-26 Masahiro Kaneko , Danushka Bollegala

Large Language Models have demonstrated impressive fluency across diverse tasks, yet their tendency to produce toxic content remains a critical challenge for AI safety and public trust. Existing toxicity mitigation approaches primarily…

Computation and Language · Computer Science 2025-09-23 Zuhair Hasan Shaik , Abdullah Mazhar , Aseem Srivastava , Md Shad Akhtar

Disparate biases associated with datasets and trained classifiers in hateful and abusive content identification tasks have raised many concerns recently. Although the problem of biased datasets on abusive language detection has been…

Social and Information Networks · Computer Science 2021-01-27 Marzieh Mozafari , Reza Farahbakhsh , Noel Crespi

Hate speech detection is a crucial area of research in natural language processing, essential for ensuring online community safety. However, detecting implicit hate speech, where harmful intent is conveyed in subtle or indirect ways,…

Computation and Language · Computer Science 2025-04-17 Yumin Kim , Hwanhee Lee

Previous studies have established that language models manifest stereotyped biases. Existing debiasing strategies, such as retraining a model with counterfactual data, representation projection, and prompting often fail to efficiently…

Computation and Language · Computer Science 2025-03-12 Xin Xu , Wei Xu , Ningyu Zhang , Julian McAuley

We report our ongoing work about a new deep architecture working in tandem with a statistical test procedure for jointly training texts and their label descriptions for multi-label and multi-class classification tasks. A statistical…

Computation and Language · Computer Science 2019-06-18 Ahmad Aghaebrahimian , Mark Cieliebak

Large language models (LM) generate remarkably fluent text and can be efficiently adapted across NLP tasks. Measuring and guaranteeing the quality of generated text in terms of safety is imperative for deploying LMs in the real world; to…

Dataset bias is a significant problem in training fair classifiers. When attributes unrelated to classification exhibit strong biases towards certain classes, classifiers trained on such dataset may overfit to these bias attributes,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-06 Zaiying Zhao , Soichiro Kumano , Toshihiko Yamasaki

Recent deep neural networks (DNNs) can easily overfit to biased training data with noisy labels. Label correction strategy is commonly used to alleviate this issue by designing a method to identity suspected noisy labels and then correct…

Computer Vision and Pattern Recognition · Computer Science 2021-09-03 Yichen Wu , Jun Shu , Qi Xie , Qian Zhao , Deyu Meng

Automated hate speech detection is an important tool in combating the spread of hate speech, particularly in social media. Numerous methods have been developed for the task, including a recent proliferation of deep-learning based…

Computation and Language · Computer Science 2023-12-08 Jitendra Singh Malik , Hezhe Qiao , Guansong Pang , Anton van den Hengel

Hate speech detection has become an important research topic within the past decade. More private corporations are needing to regulate user generated content on different platforms across the globe. In this paper, we introduce a study of…

Computation and Language · Computer Science 2022-01-28 Neha Deshpande , Nicholas Farris , Vidhur Kumar

Recent advances in weakly supervised text classification mostly focus on designing sophisticated methods to turn high-level human heuristics into quality pseudo-labels. In this paper, we revisit the seed matching-based method, which is…

Computation and Language · Computer Science 2023-10-24 Chengyu Dong , Zihan Wang , Jingbo Shang