English
Related papers

Related papers: Mitigating Biases in Toxic Language Detection thro…

200 papers

Unbiased data collection is essential to guaranteeing fairness in artificial intelligence models. Implicit bias, a form of behavioral conditioning that leads us to attribute predetermined characteristics to members of certain groups and…

Artificial Intelligence · Computer Science 2020-03-03 Rupam Acharyya , Shouman Das , Ankani Chattoraj , Oishani Sengupta , Md Iftekar Tanveer

Previous works on the fairness of toxic language classifiers compare the output of models with different identity terms as input features but do not consider the impact of other important concepts present in the context. Here, besides…

Computation and Language · Computer Science 2022-10-20 Isar Nejadgholi , Esma Balkır , Kathleen C. Fraser , Svetlana Kiritchenko

Technologies for abusive language detection are being developed and applied with little consideration of their potential biases. We examine racial bias in five different sets of Twitter data annotated for hate speech and abusive language.…

Computation and Language · Computer Science 2019-05-30 Thomas Davidson , Debasmita Bhattacharya , Ingmar Weber

Large Language Models have demonstrated impressive fluency across diverse tasks, yet their tendency to produce toxic content remains a critical challenge for AI safety and public trust. Existing toxicity mitigation approaches primarily…

Computation and Language · Computer Science 2025-09-23 Zuhair Hasan Shaik , Abdullah Mazhar , Aseem Srivastava , Md Shad Akhtar

Language models frequently inherit societal biases from their training data. Numerous techniques have been proposed to mitigate these biases during both the pre-training and fine-tuning stages. However, fine-tuning a pre-trained debiased…

Computation and Language · Computer Science 2024-10-03 Shahed Masoudian , Markus Frohmann , Navid Rekabsaz , Markus Schedl

Natural Language Processing (NLP) models have been found discriminative against groups of different social identities such as gender and race. With the negative consequences of these undesired biases, researchers have responded with…

Computation and Language · Computer Science 2022-05-26 Lu Cheng , Suyu Ge , Huan Liu

The perceived toxicity of language can vary based on someone's identity and beliefs, but this variation is often ignored when collecting toxic language datasets, resulting in dataset and model biases. We seek to understand the who, why, and…

Computation and Language · Computer Science 2022-05-11 Maarten Sap , Swabha Swayamdipta , Laura Vianna , Xuhui Zhou , Yejin Choi , Noah A. Smith

Digital dehumanization, although a critical issue, remains largely overlooked within the field of computational linguistics and Natural Language Processing. The prevailing approach in current research concentrating primarily on a single…

Computation and Language · Computer Science 2025-10-22 Dennis Assenmacher , Paloma Piot , Katarina Laken , David Jurgens , Claudia Wagner

Toxicity is a prevalent social behavior that involves the use of hate speech, offensive language, bullying, and abusive speech. While text-based approaches for toxicity detection are common, there is limited research on processing speech…

Sound · Computer Science 2023-04-25 Ahlam Husni Abu Nada , Siddique Latif , Junaid Qadir

Textual data used to train large language models (LLMs) exhibits multifaceted bias manifestations encompassing harmful language and skewed demographic distributions. Regulations such as the European AI Act require identifying and mitigating…

Debiasing methods that seek to mitigate the tendency of Language Models (LMs) to occasionally output toxic or inappropriate text have recently gained traction. In this paper, we propose a standardized protocol which distinguishes methods…

Computation and Language · Computer Science 2023-05-24 Robert Morabito , Jad Kabbara , Ali Emami

We study attribute control in language models through the method of Causal Average Treatment Effect (Causal ATE). Existing methods for the attribute control task in Language Models (LMs) check for the co-occurrence of words in a sentence…

Computation and Language · Computer Science 2024-02-19 Rahul Madhavan , Kahini Wadhawan

Understanding toxicity in user conversations is undoubtedly an important problem. Addressing "covert" or implicit cases of toxicity is particularly hard and requires context. Very few previous studies have analysed the influence of…

Computation and Language · Computer Science 2022-10-19 Atijit Anuchitanukul , Julia Ive , Lucia Specia

Disparate biases associated with datasets and trained classifiers in hateful and abusive content identification tasks have raised many concerns recently. Although the problem of biased datasets on abusive language detection has been…

Social and Information Networks · Computer Science 2021-01-27 Marzieh Mozafari , Reza Farahbakhsh , Noel Crespi

Recent generative large language models (LLMs) show remarkable performance in non-English languages, but when prompted in those languages they tend to express higher harmful social biases and toxicity levels. Prior work has shown that…

Computation and Language · Computer Science 2025-06-03 Vera Neplenbroek , Arianna Bisazza , Raquel Fernández

Texts like news, encyclopedias, and some social media strive for objectivity. Yet bias in the form of inappropriate subjectivity - introducing attitudes via framing, presupposing truth, and casting doubt - remains ubiquitous. This kind of…

Computation and Language · Computer Science 2019-12-13 Reid Pryzant , Richard Diehl Martinez , Nathan Dass , Sadao Kurohashi , Dan Jurafsky , Diyi Yang

Existing studies have investigated the tendency of autoregressive language models to generate contexts that exhibit undesired biases and toxicity. Various debiasing approaches have been proposed, which are primarily categorized into…

Computation and Language · Computer Science 2022-05-03 Yoon A Park , Frank Rudzicz

Bias in textual data can lead to skewed interpretations and outcomes when the data is used. These biases could perpetuate stereotypes, discrimination, or other forms of unfair treatment. An algorithm trained on biased data may end up making…

Computation and Language · Computer Science 2023-08-30 Shaina Raza , Muskan Garg , Deepak John Reji , Syed Raza Bashir , Chen Ding

In current hate speech datasets, there exists a high correlation between annotators' perceptions of toxicity and signals of African American English (AAE). This bias in annotated training data and the tendency of machine learning models to…

Computation and Language · Computer Science 2020-05-26 Mengzhou Xia , Anjalie Field , Yulia Tsvetkov

Bias mitigation approaches reduce models' dependence on sensitive features of data, such as social group tokens (SGTs), resulting in equal predictions across the sensitive features. In hate speech detection, however, equalizing model…

Computation and Language · Computer Science 2021-08-05 Aida Mostafazadeh Davani , Ali Omrani , Brendan Kennedy , Mohammad Atari , Xiang Ren , Morteza Dehghani