中文
相关论文

相关论文: Mitigating Biases in Toxic Language Detection thro…

200 篇论文

Unbiased data collection is essential to guaranteeing fairness in artificial intelligence models. Implicit bias, a form of behavioral conditioning that leads us to attribute predetermined characteristics to members of certain groups and…

人工智能 · 计算机科学 2020-03-03 Rupam Acharyya , Shouman Das , Ankani Chattoraj , Oishani Sengupta , Md Iftekar Tanveer

Previous works on the fairness of toxic language classifiers compare the output of models with different identity terms as input features but do not consider the impact of other important concepts present in the context. Here, besides…

计算与语言 · 计算机科学 2022-10-20 Isar Nejadgholi , Esma Balkır , Kathleen C. Fraser , Svetlana Kiritchenko

Technologies for abusive language detection are being developed and applied with little consideration of their potential biases. We examine racial bias in five different sets of Twitter data annotated for hate speech and abusive language.…

计算与语言 · 计算机科学 2019-05-30 Thomas Davidson , Debasmita Bhattacharya , Ingmar Weber

Large Language Models have demonstrated impressive fluency across diverse tasks, yet their tendency to produce toxic content remains a critical challenge for AI safety and public trust. Existing toxicity mitigation approaches primarily…

计算与语言 · 计算机科学 2025-09-23 Zuhair Hasan Shaik , Abdullah Mazhar , Aseem Srivastava , Md Shad Akhtar

Language models frequently inherit societal biases from their training data. Numerous techniques have been proposed to mitigate these biases during both the pre-training and fine-tuning stages. However, fine-tuning a pre-trained debiased…

计算与语言 · 计算机科学 2024-10-03 Shahed Masoudian , Markus Frohmann , Navid Rekabsaz , Markus Schedl

Natural Language Processing (NLP) models have been found discriminative against groups of different social identities such as gender and race. With the negative consequences of these undesired biases, researchers have responded with…

计算与语言 · 计算机科学 2022-05-26 Lu Cheng , Suyu Ge , Huan Liu

The perceived toxicity of language can vary based on someone's identity and beliefs, but this variation is often ignored when collecting toxic language datasets, resulting in dataset and model biases. We seek to understand the who, why, and…

计算与语言 · 计算机科学 2022-05-11 Maarten Sap , Swabha Swayamdipta , Laura Vianna , Xuhui Zhou , Yejin Choi , Noah A. Smith

Digital dehumanization, although a critical issue, remains largely overlooked within the field of computational linguistics and Natural Language Processing. The prevailing approach in current research concentrating primarily on a single…

计算与语言 · 计算机科学 2025-10-22 Dennis Assenmacher , Paloma Piot , Katarina Laken , David Jurgens , Claudia Wagner

Toxicity is a prevalent social behavior that involves the use of hate speech, offensive language, bullying, and abusive speech. While text-based approaches for toxicity detection are common, there is limited research on processing speech…

声音 · 计算机科学 2023-04-25 Ahlam Husni Abu Nada , Siddique Latif , Junaid Qadir

Textual data used to train large language models (LLMs) exhibits multifaceted bias manifestations encompassing harmful language and skewed demographic distributions. Regulations such as the European AI Act require identifying and mitigating…

Debiasing methods that seek to mitigate the tendency of Language Models (LMs) to occasionally output toxic or inappropriate text have recently gained traction. In this paper, we propose a standardized protocol which distinguishes methods…

计算与语言 · 计算机科学 2023-05-24 Robert Morabito , Jad Kabbara , Ali Emami

We study attribute control in language models through the method of Causal Average Treatment Effect (Causal ATE). Existing methods for the attribute control task in Language Models (LMs) check for the co-occurrence of words in a sentence…

计算与语言 · 计算机科学 2024-02-19 Rahul Madhavan , Kahini Wadhawan

Understanding toxicity in user conversations is undoubtedly an important problem. Addressing "covert" or implicit cases of toxicity is particularly hard and requires context. Very few previous studies have analysed the influence of…

计算与语言 · 计算机科学 2022-10-19 Atijit Anuchitanukul , Julia Ive , Lucia Specia

Disparate biases associated with datasets and trained classifiers in hateful and abusive content identification tasks have raised many concerns recently. Although the problem of biased datasets on abusive language detection has been…

社会与信息网络 · 计算机科学 2021-01-27 Marzieh Mozafari , Reza Farahbakhsh , Noel Crespi

Recent generative large language models (LLMs) show remarkable performance in non-English languages, but when prompted in those languages they tend to express higher harmful social biases and toxicity levels. Prior work has shown that…

计算与语言 · 计算机科学 2025-06-03 Vera Neplenbroek , Arianna Bisazza , Raquel Fernández

Texts like news, encyclopedias, and some social media strive for objectivity. Yet bias in the form of inappropriate subjectivity - introducing attitudes via framing, presupposing truth, and casting doubt - remains ubiquitous. This kind of…

计算与语言 · 计算机科学 2019-12-13 Reid Pryzant , Richard Diehl Martinez , Nathan Dass , Sadao Kurohashi , Dan Jurafsky , Diyi Yang

Existing studies have investigated the tendency of autoregressive language models to generate contexts that exhibit undesired biases and toxicity. Various debiasing approaches have been proposed, which are primarily categorized into…

计算与语言 · 计算机科学 2022-05-03 Yoon A Park , Frank Rudzicz

Bias in textual data can lead to skewed interpretations and outcomes when the data is used. These biases could perpetuate stereotypes, discrimination, or other forms of unfair treatment. An algorithm trained on biased data may end up making…

计算与语言 · 计算机科学 2023-08-30 Shaina Raza , Muskan Garg , Deepak John Reji , Syed Raza Bashir , Chen Ding

In current hate speech datasets, there exists a high correlation between annotators' perceptions of toxicity and signals of African American English (AAE). This bias in annotated training data and the tendency of machine learning models to…

计算与语言 · 计算机科学 2020-05-26 Mengzhou Xia , Anjalie Field , Yulia Tsvetkov

Bias mitigation approaches reduce models' dependence on sensitive features of data, such as social group tokens (SGTs), resulting in equal predictions across the sensitive features. In hate speech detection, however, equalizing model…

计算与语言 · 计算机科学 2021-08-05 Aida Mostafazadeh Davani , Ali Omrani , Brendan Kennedy , Mohammad Atari , Xiang Ren , Morteza Dehghani