中文
相关论文

相关论文: Mitigating Biases in Toxic Language Detection thro…

200 篇论文

Dialects introduce syntactic and lexical variations in language that occur in regional or social groups. Most NLP methods are not sensitive to such variations. This may lead to unfair behavior of the methods, conveying negative bias towards…

计算与语言 · 计算机科学 2024-06-17 Maximilian Spliethöver , Sai Nikhil Menon , Henning Wachsmuth

Abusive language detection models tend to have a problem of being biased toward identity words of a certain group of people because of imbalanced training datasets. For example, "You are a good woman" was considered "sexist" when trained on…

计算与语言 · 计算机科学 2018-08-23 Ji Ho Park , Jamin Shin , Pascale Fung

This work investigates the potential of undermining both fairness and detection performance in abusive language detection. In a dynamic and complex digital world, it is crucial to investigate the vulnerabilities of these detection models to…

计算与语言 · 计算机科学 2023-12-07 Yueqing Liang , Lu Cheng , Ali Payani , Kai Shu

Approaches for mitigating bias in supervised models are designed to reduce models' dependence on specific sensitive features of the input data, e.g., mentioned social groups. However, in the case of hate speech detection, it is not always…

计算与语言 · 计算机科学 2020-10-27 Aida Mostafazadeh Davani , Ali Omrani , Brendan Kennedy , Mohammad Atari , Xiang Ren , Morteza Dehghani

Recent research has demonstrated how racial biases against users who write African American English exists in popular toxic language datasets. While previous work has focused on a single fairness criteria, we propose to use additional…

计算与语言 · 计算机科学 2021-09-28 Matan Halevy , Camille Harris , Amy Bruckman , Diyi Yang , Ayanna Howard

This paper focuses on detecting clickbait posts on the Web. These posts often use eye-catching disinformation in mixed modalities to mislead users to click for profit. That affects the user experience and thus would be blocked by content…

机器学习 · 计算机科学 2024-10-11 Jianxing Yu , Shiqi Wang , Han Yin , Zhenlong Sun , Ruobing Xie , Bo Zhang , Yanghui Rao

Hate speech detection on social media faces challenges in both accuracy and explainability, especially for underexplored Indic languages. We propose a novel explainability-guided training framework, X-MuTeST (eXplainable Multilingual haTe…

We present a general approach towards controllable societal biases in natural language generation (NLG). Building upon the idea of adversarial triggers, we develop a method to induce societal biases in generated text when input prompts…

计算与语言 · 计算机科学 2020-10-08 Emily Sheng , Kai-Wei Chang , Premkumar Natarajan , Nanyun Peng

Large pre-trained language models are successfully being used in a variety of tasks, across many languages. With this ever-increasing usage, the risk of harmful side effects also rises, for example by reproducing and reinforcing…

计算与语言 · 计算机科学 2022-09-19 Pieter Delobelle , Bettina Berendt

Counterfactual reasoning is an important paradigm applicable in many fields, such as healthcare, economics, and education. In this work, we propose a novel method to address the issue of \textit{selection bias}. We learn two groups of…

机器学习 · 计算机科学 2019-12-20 Zichen Zhang , Qingfeng Lan , Lei Ding , Yue Wang , Negar Hassanpour , Russell Greiner

Pretraining datasets are foundational to the development of multimodal models, yet they often have inherent biases and toxic content from the web-scale corpora they are sourced from. In this paper, we investigate the prevalence of toxicity…

计算机视觉与模式识别 · 计算机科学 2025-05-13 Karthik Reddy Kanjula , Surya Guthikonda , Nahid Alam , Shayekh Bin Islam

Biases in the dataset often enable the model to achieve high performance on in-distribution data, while poorly performing on out-of-distribution data. To mitigate the detrimental effect of the bias on the networks, previous works have…

计算与语言 · 计算机科学 2023-12-07 Eojin Jeon , Mingyu Lee , Juhyeong Park , Yeachan Kim , Wing-Lam Mok , SangKeun Lee

Language models (LMs) must be both safe and equitable to be responsibly deployed in practice. With safety in mind, numerous detoxification techniques (e.g., Dathathri et al. 2020; Krause et al. 2020) have been proposed to mitigate toxic LM…

计算与语言 · 计算机科学 2021-04-14 Albert Xu , Eshaan Pathak , Eric Wallace , Suchin Gururangan , Maarten Sap , Dan Klein

Large pre-trained vision-language models (VLMs) reduce the time for developing predictive models for various vision-grounded language downstream tasks by providing rich, adaptable image and text representations. However, these models suffer…

计算机视觉与模式识别 · 计算机科学 2023-03-21 Ashish Seth , Mayur Hemani , Chirag Agarwal

Uses of pejorative expressions can be benign or actively empowering. When models for abuse detection misclassify these expressions as derogatory, they inadvertently censor productive conversations held by marginalized groups. One way to…

计算与语言 · 计算机科学 2022-06-20 Jana Kurrek , Haji Mohammad Saleem , Derek Ruths

Toxic content detection aims to identify content that can offend or harm its recipients. Automated classifiers of toxic content need to be robust against adversaries who deliberately try to bypass filters. We propose a method of generating…

计算与语言 · 计算机科学 2019-12-17 Keita Kurita , Anna Belova , Antonios Anastasopoulos

The hate speech detection task is known to suffer from bias against African American English (AAE) dialect text, due to the annotation bias present in the underlying hate speech datasets used to train these models. This leads to a disparity…

计算与语言 · 计算机科学 2025-01-28 Diana Iftimie , Erik Zinn

Despite their high predictive accuracies, current machine learning systems often exhibit systematic biases stemming from annotation artifacts or insufficient support for certain classes in the dataset. Recent work proposes automatic methods…

计算与语言 · 计算机科学 2024-10-30 Rakesh R. Menon , Shashank Srivastava

Abusive language is a concerning problem in online social media. Past research on detecting abusive language covers different platforms, languages, demographies, etc. However, models trained using these datasets do not perform well in…

计算与语言 · 计算机科学 2023-07-31 Punyajoy Saha , Divyanshu Sheth , Kushal Kedia , Binny Mathew , Animesh Mukherjee

The rise of hate speech on online platforms has led to an urgent need for effective content moderation. However, the subjective and multi-faceted nature of hateful online content, including implicit hate speech, poses significant challenges…

计算与语言 · 计算机科学 2023-03-17 Uma Gunturi , Xiaohan Ding , Eugenia H. Rho