中文
相关论文

相关论文: BiasGym: A Simple and Generalizable Framework for …

200 篇论文

Large language models (LLMs) offer significant potential as tools to support an expanding range of decision-making tasks. Given their training on human (created) data, LLMs have been shown to inherit societal biases against protected…

人工智能 · 计算机科学 2024-10-07 Jessica Echterhoff , Yao Liu , Abeer Alessa , Julian McAuley , Zexue He

Large language models (LLMs) trained on vast corpora suffer from inevitable stereotype biases. Mitigating these biases with fine-tuning could be both costly and data-hungry. Model editing methods, which focus on modifying LLMs in a post-hoc…

计算与语言 · 计算机科学 2024-02-22 Jianhao Yan , Futing Wang , Yafu Li , Yue Zhang

Large language models (LLMs) often exhibit gender bias, posing challenges for their safe deployment. Existing methods to mitigate bias lack a comprehensive understanding of its mechanisms or compromise the model's core capabilities. To…

计算与语言 · 计算机科学 2025-01-27 Zeping Yu , Sophia Ananiadou

Large Language models (LLMs), while powerful, exhibit harmful social biases. Debiasing is often challenging due to computational costs, data constraints, and potential degradation of multi-task language capabilities. This work introduces a…

计算与语言 · 计算机科学 2024-09-17 Pengrui Han , Rafal Kocielnik , Adhithya Saravanan , Roy Jiang , Or Sharir , Anima Anandkumar

Large language models (LLMs) are increasingly applied to clinical decision-making. However, their potential to exhibit bias poses significant risks to clinical equity. Currently, there is a lack of benchmarks that systematically evaluate…

计算与语言 · 计算机科学 2024-11-18 Yubo Zhang , Shudi Hou , Mingyu Derek Ma , Wei Wang , Muhao Chen , Jieyu Zhao

Large Language Models (LLMs) are increasingly deployed in high-stakes decision-making contexts. While prior work has shown that LLMs exhibit cognitive biases behaviorally, whether these biases correspond to identifiable internal…

人工智能 · 计算机科学 2026-04-03 Fan Huang , Songheng Zhang , Haewoon Kwak , Jisun An

Large Language Models (LLMs) have revolutionized natural language processing, but their susceptibility to biases poses significant challenges. This comprehensive review examines the landscape of bias in LLMs, from its origins to current…

计算与语言 · 计算机科学 2026-05-04 Yufei Guo , Muzhe Guo , Juntao Su , Zhou Yang , Mengqiu Zhu , Hongfei Li , Mengyang Qiu , Shuo Shuo Liu

Large language models are becoming the go-to solution for the ever-growing number of tasks. However, with growing capacity, models are prone to rely on spurious correlations stemming from biases and stereotypes present in the training data.…

计算与语言 · 计算机科学 2024-05-30 Tomasz Limisiewicz , David Mareček , Tomáš Musil

Identifying bias in LLM-generated content is a crucial prerequisite for ensuring fairness in LLMs. Existing methods, such as fairness classifiers and LLM-based judges, face limitations related to difficulties in understanding underlying…

计算与语言 · 计算机科学 2025-06-11 Zhiting Fan , Ruizhe Chen , Zuozhu Liu

Large Language Models (LLMs) inherit societal biases from their training data, potentially leading to harmful or unfair outputs. While various techniques aim to mitigate these biases, their effects are often evaluated only along the…

计算与语言 · 计算机科学 2025-11-25 Shireen Chand , Faith Baca , Emilio Ferrara

Large language models (LLMs) are prone to capturing biases from training corpus, leading to potential negative social impacts. Existing prompt-based debiasing methods exhibit instability due to their sensitivity to prompt changes, while…

计算与语言 · 计算机科学 2025-07-08 Yichen Li , Zhiting Fan , Ruizhe Chen , Xiaotang Gai , Luqi Gong , Yan Zhang , Zuozhu Liu

Previous studies have established that language models manifest stereotyped biases. Existing debiasing strategies, such as retraining a model with counterfactual data, representation projection, and prompting often fail to efficiently…

计算与语言 · 计算机科学 2025-03-12 Xin Xu , Wei Xu , Ningyu Zhang , Julian McAuley

Bias in Large Language Models (LLMs) significantly undermines their reliability and fairness. We focus on a common form of bias: when two reference concepts in the model's concept space, such as sentiment polarities (e.g., "positive" and…

计算与语言 · 计算机科学 2025-05-22 Lang Gao , Kaiyang Wan , Wei Liu , Chenxi Wang , Zirui Song , Zixiang Xu , Yanbo Wang , Veselin Stoyanov , Xiuying Chen

Large language models (LLMs) have garnered significant attention for their remarkable performance in a continuously expanding set of natural language processing tasks. However, these models have been shown to harbor inherent societal…

计算与语言 · 计算机科学 2023-10-16 Abel Salinas , Louis Penafiel , Robert McCormack , Fred Morstatter

Large language models (LLMs) have demonstrated impressive capabilities in various tasks using the in-context learning (ICL) paradigm. However, their effectiveness is often compromised by inherent bias, leading to prompt brittleness, i.e.,…

计算与语言 · 计算机科学 2024-12-13 Hanzhang Zhou , Zijian Feng , Zixiao Zhu , Junlang Qian , Kezhi Mao

Vision-language model (VLM) embeddings have been shown to encode biases present in their training data, such as societal biases that prescribe negative characteristics to members of various racial and gender identities. VLMs are being…

计算机视觉与模式识别 · 计算机科学 2024-11-08 Walter Gerych , Haoran Zhang , Kimia Hamidieh , Eileen Pan , Maanas Sharma , Thomas Hartvigsen , Marzyeh Ghassemi

Evaluating the bias in Large Language Models (LLMs) becomes increasingly crucial with their rapid development. However, existing evaluation methods rely on fixed-form outputs and cannot adapt to the flexible open-text generation scenarios…

计算与语言 · 计算机科学 2024-07-23 Zhiting Fan , Ruizhe Chen , Ruiling Xu , Zuozhu Liu

Large Language Models (LLMs) have been shown to exhibit various biases and stereotypes in their generated content. While extensive research has investigated biases in LLMs, prior work has predominantly focused on explicit bias, with minimal…

计算与语言 · 计算机科学 2025-06-04 Yachao Zhao , Bo Wang , Yan Wang , Dongming Zhao , Ruifang He , Yuexian Hou

Confirmation bias, the tendency to seek evidence that supports rather than challenges one's belief, hinders one's reasoning ability. We examine whether large language models (LLMs) exhibit confirmation bias by adapting the rule-discovery…

计算与语言 · 计算机科学 2026-04-06 Ayush Rajesh Jhaveri , Anthony GX-Chen , Ilia Sucholutsky , Eunsol Choi

Pre-trained language models (PLMs) are trained on data that inherently contains gender biases, leading to undesirable impacts. Traditional debiasing methods often rely on external corpora, which may lack quality, diversity, or demographic…

计算与语言 · 计算机科学 2025-03-13 Liu Yu , Ludie Guo , Ping Kuang , Fan Zhou