中文
相关论文

相关论文: Does Debiasing Inevitably Degrade the Model Perfor…

200 篇论文

Large Language Models (LLMs) have been shown to be biased in prior work, as they generate text that is in line with stereotypical views of the world or that is not representative of the viewpoints and values of historically marginalized…

计算与语言 · 计算机科学 2025-02-07 Laura Biester

To reduce human error and prejudice, many high-stakes decisions have been turned over to machine algorithms. However, recent research suggests that this does not remove discrimination, and can perpetuate harmful stereotypes. While…

计算机与社会 · 计算机科学 2019-12-18 Yuzi He , Keith Burghardt , Kristina Lerman

Large language models (LLMs) have shown remarkable advances in language generation and understanding but are also prone to exhibiting harmful social biases. While recognition of these behaviors has generated an abundance of bias mitigation…

Recent studies have shown that word embeddings exhibit gender bias inherited from the training corpora. However, most studies to date have focused on quantifying and mitigating such bias only in English. These analyses cannot be directly…

计算与语言 · 计算机科学 2019-09-11 Pei Zhou , Weijia Shi , Jieyu Zhao , Kuan-Hao Huang , Muhao Chen , Ryan Cotterell , Kai-Wei Chang

Language model-based instruction-following systems have lately shown increasing performance on many benchmark tasks, demonstrating the capability of adapting to a broad variety of instructions. However, such systems are often not designed…

计算与语言 · 计算机科学 2024-03-20 Rahul Nadkarni , Yizhong Wang , Noah A. Smith

As large language models (LLMs) are increasingly deployed in real-world applications, ensuring their fair responses across demographics has become crucial. Despite many efforts, an ongoing challenge is hidden bias: LLMs appear fair under…

计算与语言 · 计算机科学 2026-02-05 Kahee Lim , Soyeon Kim , Steven Euijong Whang

As the use of natural language processing increases in our day-to-day life, the need to address gender bias inherent in these systems also amplifies. This is because the inherent bias interferes with the semantic structure of the output of…

计算与语言 · 计算机科学 2022-05-13 Neeraja Kirtane , Tanvi Anand

When trained on large, unfiltered crawls from the internet, language models pick up and reproduce all kinds of undesirable biases that can be found in the data: they often generate racist, sexist, violent or otherwise toxic language. As…

计算与语言 · 计算机科学 2021-09-10 Timo Schick , Sahana Udupa , Hinrich Schütze

Software built on top of machine learning algorithms is becoming increasingly prevalent in a variety of fields, including college admissions, healthcare, insurance, and justice. The effectiveness and efficiency of these systems heavily…

机器学习 · 计算机科学 2023-05-25 Ying Xiao , Shangwen Wang , Sicen Liu , Dingyuan Xue , Xian Zhan , Yepang Liu

Word embeddings derived from human-generated corpora inherit strong gender bias which can be further amplified by downstream models. Some commonly adopted debiasing approaches, including the seminal Hard Debias algorithm, apply…

计算与语言 · 计算机科学 2020-05-05 Tianlu Wang , Xi Victoria Lin , Nazneen Fatema Rajani , Bryan McCann , Vicente Ordonez , Caiming Xiong

Advancements in Large Language Models (LLMs) have increased the performance of different natural language understanding as well as generation tasks. Although LLMs have breached the state-of-the-art performance in various tasks, they often…

Language models are prone to dataset biases, known as shortcuts and spurious correlations in data, which often result in performance drop on new data. We present a new debiasing framework called ``FairFlow'' that mitigates dataset biases by…

机器学习 · 计算机科学 2025-03-25 Jiali Cheng , Hadi Amiri

While Large Language Models achieve state-of-the-art results across a wide range of NLP tasks, they remain prone to systematic biases. Among these, gender bias is particularly salient in MT, due to systematic differences across languages in…

计算与语言 · 计算机科学 2026-03-19 Chiara Manna , Hosein Mohebbi , Afra Alishahi , Frédéric Blain , Eva Vanmassenhove

Word embeddings are widely used in NLP for a vast range of tasks. It was shown that word embeddings derived from text corpora reflect gender biases in society. This phenomenon is pervasive and consistent across different word embedding…

计算与语言 · 计算机科学 2019-09-25 Hila Gonen , Yoav Goldberg

Technology for language generation has advanced rapidly, spurred by advancements in pre-training large models on massive amounts of data and the need for intelligent agents to communicate in a natural manner. While techniques can…

计算与语言 · 计算机科学 2021-06-24 Emily Sheng , Kai-Wei Chang , Premkumar Natarajan , Nanyun Peng

With the growing deployment of large language models (LLMs) across various applications, assessing the influence of gender biases embedded in LLMs becomes crucial. The topic of gender bias within the realm of natural language processing…

计算与语言 · 计算机科学 2024-03-04 Jinman Zhao , Yitian Ding , Chen Jia , Yining Wang , Zifan Qian

While reasoning-based large language models excel at complex tasks through an internal, structured thinking process, a concerning phenomenon has emerged that such a thinking process can aggregate social stereotypes, leading to biased…

计算与语言 · 计算机科学 2026-05-13 Guoqing Luo , Iffat Maab , Lili Mou , Junichi Yamagishi

Audio-based depression detection models have demonstrated promising performance but often suffer from gender bias due to imbalanced training data. Epidemiological statistics show a higher prevalence of depression in females, leading models…

机器学习 · 计算机科学 2026-02-04 Mingxuan Hu , Hongbo Ma , Xinlan Wu , Ziqi Liu , Jiaqi Liu , Yangbin Chen

The increasingly large size of modern pretrained language models not only makes them inherit more human-like biases from the training corpora, but also makes it computationally expensive to mitigate such biases. In this paper, we…

计算与语言 · 计算机科学 2023-06-08 Zhongbin Xie , Thomas Lukasiewicz

Large Language Models (LLMs) have made substantial progress in the past several months, shattering state-of-the-art benchmarks in many domains. This paper investigates LLMs' behavior with respect to gender stereotypes, a known issue for…

计算与语言 · 计算机科学 2023-08-30 Hadas Kotek , Rikker Dockum , David Q. Sun