English
Related papers

Related papers: Toward Understanding Bias Correlations for Mitigat…

200 papers

Motivations for methods in explainable artificial intelligence (XAI) often include detecting, quantifying and mitigating bias, and contributing to making machine learning models fairer. However, exactly how an XAI method can help in…

Computation and Language · Computer Science 2022-06-09 Esma Balkir , Svetlana Kiritchenko , Isar Nejadgholi , Kathleen C. Fraser

Social biases inherent in large language models (LLMs) raise significant fairness concerns. Retrieval-Augmented Generation (RAG) architectures, which retrieve external knowledge sources to enhance the generative capabilities of LLMs, remain…

Computation and Language · Computer Science 2026-02-11 Shweta Parihar , Lu Cheng

Machine learning techniques have been widely used in natural language processing (NLP). However, as revealed by many recent studies, machine learning models often inherit and amplify the societal biases in data. Various metrics have been…

Computation and Language · Computer Science 2020-10-07 Jieyu Zhao , Kai-Wei Chang

Multilingual Pre-trained Language Models (MPLMs) have become essential tools for natural language processing. However, they often exhibit biases related to sensitive attributes such as gender, race, and religion. In this paper, we introduce…

Computation and Language · Computer Science 2026-04-06 Haoyu Liang , Peijian Zeng , Wentao Huang , Aimin Yang , Dong Zhou

Class imbalance is a common challenge in many NLP tasks, and has clear connections to bias, in that bias in training data often leads to higher accuracy for majority groups at the expense of minority groups. However there has traditionally…

Computation and Language · Computer Science 2021-09-23 Shivashankar Subramanian , Afshin Rahimi , Timothy Baldwin , Trevor Cohn , Lea Frermann

With the widespread adoption of machine learning in the real world, the impact of the discriminatory bias has attracted attention. In recent years, various methods to mitigate the bias have been proposed. However, most of them have not…

Machine Learning · Computer Science 2025-03-26 Kenji Kobayashi , Yuri Nakao

Growing concerns regarding algorithmic fairness have led to a surge in methodologies to mitigate algorithmic bias. However, such methodologies largely assume that observed labels in training data are correct. This is problematic because…

Machine Learning · Computer Science 2023-10-02 Yunyi Li , Maria De-Arteaga , Maytal Saar-Tsechansky

As modern Large Language Models (LLMs) shatter many state-of-the-art benchmarks in a variety of domains, this paper investigates their behavior in the domains of ethics and fairness, focusing on protected group bias. We conduct a two-part…

Computers and Society · Computer Science 2024-03-25 Hadas Kotek , David Q. Sun , Zidi Xiu , Margit Bowler , Christopher Klein

Reasoning in humans is prone to biases due to underlying motivations like identity protection, that undermine rational decision-making and judgment. This \textit{motivated reasoning} at a collective level can be detrimental to society when…

Artificial Intelligence · Computer Science 2026-04-20 Saloni Dash , Amélie Reymond , Emma S. Spiro , Aylin Caliskan

Recent advances in large language models (LLMs) have substantially improved natural language processing (NLP) applications. However, these models often inherit and amplify biases present in their training data. Although several datasets…

Computation and Language · Computer Science 2026-02-20 Shaina Raza , Mizanur Rahman , Michael R. Zhang

Large language models (LLMs) trained on vast corpora suffer from inevitable stereotype biases. Mitigating these biases with fine-tuning could be both costly and data-hungry. Model editing methods, which focus on modifying LLMs in a post-hoc…

Computation and Language · Computer Science 2024-02-22 Jianhao Yan , Futing Wang , Yafu Li , Yue Zhang

The manifestation and effect of bias in news reporting have been central topics in the social sciences for decades, and have received increasing attention in the NLP community recently. While NLP can help to scale up analyses or contribute…

Computation and Language · Computer Science 2024-06-21 Gisela Vallejo , Timothy Baldwin , Lea Frermann

With the growing deployment of large language models (LLMs) across various applications, assessing the influence of gender biases embedded in LLMs becomes crucial. The topic of gender bias within the realm of natural language processing…

Computation and Language · Computer Science 2024-03-04 Jinman Zhao , Yitian Ding , Chen Jia , Yining Wang , Zifan Qian

Transgender and non-binary (TGNB) individuals disproportionately experience discrimination and exclusion from daily life. Given the recent popularity and adoption of language generation technologies, the potential to further marginalize…

Computation and Language · Computer Science 2023-06-05 Anaelia Ovalle , Palash Goyal , Jwala Dhamala , Zachary Jaggers , Kai-Wei Chang , Aram Galstyan , Richard Zemel , Rahul Gupta

Word embeddings have recently been shown to reflect many of the pronounced societal biases (e.g., gender bias or racial bias). Existing studies are, however, limited in scope and do not investigate the consistency of biases across relevant…

Computation and Language · Computer Science 2019-04-30 Anne Lauscher , Goran Glavaš

Recently, researchers have made considerable improvements in dialogue systems with the progress of large language models (LLMs) such as ChatGPT and GPT-4. These LLM-based chatbots encode the potential biases while retaining disparities that…

Computation and Language · Computer Science 2023-10-18 Hsuan Su , Cheng-Chu Cheng , Hua Farn , Shachi H Kumar , Saurav Sahay , Shang-Tse Chen , Hung-yi Lee

This paper investigates algorithmic bias in language-based models for automated depression detection, focusing on socio-demographic disparities related to gender and race/ethnicity. Models trained using deep neural networks (DNN) based…

Computation and Language · Computer Science 2026-01-28 Obed Junias , Prajakta Kini , Theodora Chaspari

There have been growing concerns around high-stake applications that rely on models trained with biased data, which consequently produce biased predictions, often harming the most vulnerable. In particular, biased medical data could cause…

Computation and Language · Computer Science 2024-09-12 Gavin Butts , Pegah Emdad , Jethro Lee , Shannon Song , Chiman Salavati , Willmar Sosa Diaz , Shiri Dori-Hacohen , Fabricio Murai

Pre-trained language models encode undesirable social biases, which are further exacerbated in downstream use. To this end, we propose MABEL (a Method for Attenuating Gender Bias using Entailment Labels), an intermediate pre-training…

Computation and Language · Computer Science 2022-10-28 Jacqueline He , Mengzhou Xia , Christiane Fellbaum , Danqi Chen

Approaches for mitigating bias in supervised models are designed to reduce models' dependence on specific sensitive features of the input data, e.g., mentioned social groups. However, in the case of hate speech detection, it is not always…

Computation and Language · Computer Science 2020-10-27 Aida Mostafazadeh Davani , Ali Omrani , Brendan Kennedy , Mohammad Atari , Xiang Ren , Morteza Dehghani