English
Related papers

Related papers: Debiasing Algorithm through Model Adaptation

200 papers

Gender, race and social biases have recently been detected as evident examples of unfairness in applications of Natural Language Processing. A key path towards fairness is to understand, analyse and interpret our data and algorithms. Recent…

Computation and Language · Computer Science 2021-05-06 Christine Basta , Marta R. Costa-jussà

Language models (LMs) exhibit and amplify many types of undesirable biases learned from the training data, including gender bias. However, we lack tools for effectively and efficiently changing this behavior without hurting general language…

Computation and Language · Computer Science 2023-10-20 Abhijith Chintam , Rahel Beloch , Willem Zuidema , Michael Hanna , Oskar van der Wal

Pre-trained large language models (LLMs) have been reliably integrated with visual input for multimodal tasks. The widespread adoption of instruction-tuned image-to-text vision-language assistants (VLAs) like LLaVA and InternVL necessitates…

Computers and Society · Computer Science 2025-03-14 Leander Girrbach , Stephan Alaniz , Yiran Huang , Trevor Darrell , Zeynep Akata

Large language models (LLMs) have demonstrated impressive capabilities across a wide range of natural language processing tasks. However, their outputs often exhibit social biases, raising fairness concerns. Existing debiasing methods, such…

Computation and Language · Computer Science 2026-02-05 Yujie Lin , Kunquan Li , Yixuan Liao , Xiaoxin Chen , Jinsong Su

Abusive language detection models tend to have a problem of being biased toward identity words of a certain group of people because of imbalanced training datasets. For example, "You are a good woman" was considered "sexist" when trained on…

Computation and Language · Computer Science 2018-08-23 Ji Ho Park , Jamin Shin , Pascale Fung

We examine whether neural natural language processing (NLP) systems reflect historical biases in training data. We define a general benchmark to quantify gender bias in a variety of neural NLP tasks. Our empirical evaluation with…

Computation and Language · Computer Science 2019-06-03 Kaiji Lu , Piotr Mardziel , Fangjing Wu , Preetam Amancharla , Anupam Datta

The increasingly large size of modern pretrained language models not only makes them inherit more human-like biases from the training corpora, but also makes it computationally expensive to mitigate such biases. In this paper, we…

Computation and Language · Computer Science 2023-06-08 Zhongbin Xie , Thomas Lukasiewicz

Large language models (LLMs) trained on vast corpora suffer from inevitable stereotype biases. Mitigating these biases with fine-tuning could be both costly and data-hungry. Model editing methods, which focus on modifying LLMs in a post-hoc…

Computation and Language · Computer Science 2024-02-22 Jianhao Yan , Futing Wang , Yafu Li , Yue Zhang

The presence of social biases in large language models (LLMs) has become a significant concern in AI research. These biases, often embedded in training data, can perpetuate harmful stereotypes and distort decision-making processes. When…

Information Retrieval · Computer Science 2025-11-04 Amirabbas Afzali , Amirreza Velae , Iman Ahmadi , Mohammad Aliannejadi

Societal biases present in pre-trained large language models are a critical issue as these models have been shown to propagate biases in countless downstream applications, rendering them unfair towards specific groups of people. Since…

Computation and Language · Computer Science 2023-06-08 Himanshu Thakur , Atishay Jain , Praneetha Vaddamanu , Paul Pu Liang , Louis-Philippe Morency

Recent advancements in Large Language Models (LLMs) have positioned them as powerful tools for clinical decision-making, with rapidly expanding applications in healthcare. However, concerns about bias remain a significant challenge in the…

Artificial Intelligence · Computer Science 2024-10-23 Kenza Benkirane , Jackie Kay , Maria Perez-Ortiz

We explore the internal mechanisms of how bias emerges in large language models (LLMs) when provided with ambiguous comparative prompts: inputs that compare or enforce choosing between two or more entities without providing clear context…

Computation and Language · Computer Science 2024-10-31 Rishabh Adiga , Besmira Nushi , Varun Chandrasekaran

Gender bias in vision-language models (VLMs) can reinforce harmful stereotypes and discrimination. In this paper, we focus on mitigating gender bias towards vision-language tasks. We identify object hallucination as the essence of gender…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Yunqi Zhang , Songda Li , Chunyuan Deng , Luyi Wang , Hui Zhao

Many studies have shown various biases targeting different demographic groups in language models, amplifying discrimination and harming fairness. Recent parameter modification debiasing approaches significantly degrade core capabilities…

Computation and Language · Computer Science 2025-10-01 Dianqing Liu , Yi Liu , Guoqing Jin , Zhendong Mao

Although much work in NLP has focused on measuring and mitigating stereotypical bias in semantic spaces, research addressing bias in computational argumentation is still in its infancy. In this paper, we address this research gap and…

Computation and Language · Computer Science 2022-04-11 Carolin Holtermann , Anne Lauscher , Simone Paolo Ponzetto

Natural language processing (NLP) has seen remarkable advancements with the development of large language models (LLMs). Despite these advancements, LLMs often produce socially biased outputs. Recent studies have mainly addressed this…

Computation and Language · Computer Science 2025-02-13 Zhenjie Xu , Wenqing Chen , Yi Tang , Xuanying Li , Cheng Hu , Zhixuan Chu , Kui Ren , Zibin Zheng , Zhichao Lu

Large Language Models (LLMs) can generate biased responses. Yet previous direct probing techniques contain either gender mentions or predefined gender stereotypes, which are challenging to comprehensively collect. Hence, we propose an…

Computation and Language · Computer Science 2024-02-20 Xiangjue Dong , Yibo Wang , Philip S. Yu , James Caverlee

Vision Language Models achieve impressive multi-modal performance but often inherit gender biases from their training data. This bias might be coming from both the vision and text modalities. In this work, we dissect the contributions of…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Vivek Hruday Kavuri , Vysishtya Karanam , Venkata Jahnavi Venkamsetty , Kriti Madumadukala , Lakshmipathi Balaji Darur , Ponnurangam Kumaraguru

The black-box nature of large language models (LLMs) poses challenges in interpreting results, impacting issues such as data intellectual property protection and hallucination tracing. Training data attribution (TDA) methods are considered…

Computation and Language · Computer Science 2024-11-20 Kangxi Wu , Liang Pang , Huawei Shen , Xueqi Cheng

With the rapid development of large language models (LLMs), they have significantly improved efficiency across a wide range of domains. However, recent studies have revealed that LLMs often exhibit gender bias, leading to serious social…

Computation and Language · Computer Science 2025-06-17 Xiaoqing Cheng , Hongying Zan , Lulu Kong , Jinwang Song , Min Peng