中文
相关论文

相关论文: Mitigating Biases in Toxic Language Detection thro…

200 篇论文

It is well known that textual data on the internet and other digital platforms contain significant levels of bias and stereotypes. Although many such texts contain stereotypes and biases that inherently exist in natural language for reasons…

计算与语言 · 计算机科学 2022-01-24 Ewoenam Kwaku Tokpo , Toon Calders

It is evident that deep text classification models trained on human data could be biased. In particular, they produce biased outcomes for texts that explicitly include identity terms of certain demographic groups. We refer to this type of…

计算与语言 · 计算机科学 2021-05-07 Haochen Liu , Wei Jin , Hamid Karimi , Zitao Liu , Jiliang Tang

We present a dataset and classifier for detecting the language of white supremacist extremism, a growing issue in online hate speech. Our weakly supervised classifier is trained on large datasets of text from explicitly white supremacist…

计算与语言 · 计算机科学 2023-06-29 Michael Miller Yoder , Ahmad Diab , David West Brown , Kathleen M. Carley

Collecting annotations from human raters often results in a trade-off between the quantity of labels one wishes to gather and the quality of these labels. As such, it is often only possible to gather a small amount of high-quality labels.…

机器学习 · 计算机科学 2021-10-05 Neel Nanda , Jonathan Uesato , Sven Gowal

Toxic content detection in online communication remains a significant challenge, with current solutions often inadvertently blocking valuable information, including medical terms and text related to minority groups. This paper presents a…

计算与语言 · 计算机科学 2026-04-03 Melania Berbatova , Tsvetoslav Vasev

Communicating in natural language is a powerful tool in multi-agent settings, as it enables independent agents to share information in partially observable settings and allows zero-shot coordination with humans. However, most prior works…

人工智能 · 计算机科学 2025-02-11 Bidipta Sarkar , Warren Xia , C. Karen Liu , Dorsa Sadigh

Spurious correlations can cause strong biases in deep neural networks, impairing generalization ability. While most existing debiasing methods require full supervision on either spurious attributes or target labels, training a debiased…

机器学习 · 计算机科学 2023-10-10 Geon Yeong Park , Chanyong Jung , Sangmin Lee , Jong Chul Ye , Sang Wan Lee

The deployment of Large Language Models (LLMs) in diverse applications necessitates an assurance of safety without compromising the contextual integrity of the generated content. Traditional approaches, including safety-specific fine-tuning…

计算与语言 · 计算机科学 2024-07-01 Shaina Raza , Ananya Raval , Veronica Chatrath

Sensitive attributes are legally protected characteristics that should not be used to discriminate. Careful steps have been taken to minimize the risk of human bias regarding these fields, such as race and age. Large language models (LLMs)…

计算机与社会 · 计算机科学 2026-04-14 Anay Agarwalla , Simeon Sayer

Detecting toxic language including sexism, harassment and abusive behaviour, remains a critical challenge, particularly in its subtle and context-dependent forms. Existing approaches largely focus on isolated message-level classification,…

With widening deployments of natural language processing (NLP) in daily life, inherited social biases from NLP models have become more severe and problematic. Previous studies have shown that word embeddings trained on human-generated…

计算与语言 · 计算机科学 2021-12-13 Lei Ding , Dengdeng Yu , Jinhan Xie , Wenxing Guo , Shenggang Hu , Meichen Liu , Linglong Kong , Hongsheng Dai , Yanchun Bao , Bei Jiang

In a hate speech detection model, we should consider two critical aspects in addition to detection performance-bias and explainability. Hate speech cannot be identified based solely on the presence of specific words: the model should be…

计算与语言 · 计算机科学 2022-11-02 Jiyun Kim , Byounghan Lee , Kyung-Ah Sohn

Multilingual toxicity detection remains a significant challenge due to the scarcity of training data and resources for many languages. While prior work has leveraged the translate-test paradigm to support cross-lingual transfer across a…

计算与语言 · 计算机科学 2025-09-19 Samuel J. Bell , Eduardo Sánchez , David Dale , Pontus Stenetorp , Mikel Artetxe , Marta R. Costa-jussà

In recent years, the availability of large-scale annotated datasets, such as the Stanford Natural Language Inference and the Multi-Genre Natural Language Inference, coupled with the advent of pre-trained language models, has significantly…

计算与语言 · 计算机科学 2023-12-15 Dat Thanh Nguyen

The global increase in mental illness requires innovative detection methods for early intervention. Social media provides a valuable platform to identify mental illness through user-generated content. This systematic review examines machine…

机器学习 · 计算机科学 2025-02-18 Yuchen Cao , Jianglai Dai , Zhongyan Wang , Yeyubei Zhang , Xiaorui Shen , Yunchong Liu , Yexin Tian

To date, toxicity mitigation in language models has almost entirely been focused on single-language settings. As language models embrace multilingual capabilities, it's crucial our safety measures keep pace. Recognizing this research gap,…

计算与语言 · 计算机科学 2024-05-31 Luiza Pozzobon , Patrick Lewis , Sara Hooker , Beyza Ermis

With the advent of Large Language Models (LLMs) possessing increasingly impressive capabilities, a number of Large Vision-Language Models (LVLMs) have been proposed to augment LLMs with visual inputs. Such models condition generated text on…

计算机视觉与模式识别 · 计算机科学 2025-05-01 Phillip Howard , Kathleen C. Fraser , Anahita Bhiwandiwalla , Svetlana Kiritchenko

With recent advances in natural language processing, rationalization becomes an essential self-explaining diagram to disentangle the black box by selecting a subset of input texts to account for the major variation in prediction. Yet,…

机器学习 · 计算机科学 2023-09-12 Wenbo Zhang , Tong Wu , Yunlong Wang , Yong Cai , Hengrui Cai

Most research on hate speech detection has focused on English where a sizeable amount of labeled training data is available. However, to expand hate speech detection into more languages, approaches that require minimal training data are…

计算与语言 · 计算机科学 2023-06-13 Janis Goldzycher , Moritz Preisig , Chantal Amrhein , Gerold Schneider

Natural language understanding (NLU) models often rely on dataset biases rather than intended task-relevant features to achieve high performance on specific datasets. As a result, these models perform poorly on datasets outside the training…

计算与语言 · 计算机科学 2023-01-05 Yougang Lyu , Piji Li , Yechang Yang , Maarten de Rijke , Pengjie Ren , Yukun Zhao , Dawei Yin , Zhaochun Ren