中文
相关论文

相关论文: DIF: A Framework for Benchmarking and Verifying Im…

200 篇论文

Large Language Models (LLMs) have revolutionized natural language processing, but their susceptibility to biases poses significant challenges. This comprehensive review examines the landscape of bias in LLMs, from its origins to current…

计算与语言 · 计算机科学 2026-05-04 Yufei Guo , Muzhe Guo , Juntao Su , Zhou Yang , Mengqiu Zhu , Hongfei Li , Mengyang Qiu , Shuo Shuo Liu

Detecting stereotypes and biases in Large Language Models (LLMs) is crucial for enhancing fairness and reducing adverse impacts on individuals or groups when these models are applied. Traditional methods, which rely on embedding spaces or…

计算与语言 · 计算机科学 2024-05-07 Yanhong Bai , Jiabao Zhao , Jinxin Shi , Zhentao Xie , Xingjiao Wu , Liang He

Large Language Models (LLMs) have made significant strides in Natural Language Processing but remain vulnerable to fairness-related issues, often reflecting biases inherent in their training data. These biases pose risks, particularly when…

计算与语言 · 计算机科学 2025-04-14 Harishwar Reddy , Madhusudan Srinivasan , Upulee Kanewala

Large language models (LLMs) are increasingly applied to clinical decision-making. However, their potential to exhibit bias poses significant risks to clinical equity. Currently, there is a lack of benchmarks that systematically evaluate…

计算与语言 · 计算机科学 2024-11-18 Yubo Zhang , Shudi Hou , Mingyu Derek Ma , Wei Wang , Muhao Chen , Jieyu Zhao

We present a comprehensive evaluation of gender fairness in large language models (LLMs), focusing on their ability to handle both binary and non-binary genders. While previous studies primarily focus on binary gender distinctions, we…

计算与语言 · 计算机科学 2025-06-19 Zhengyang Shan , Emily Ruth Diana , Jiawei Zhou

Large Language Models (LLMs) are being increasingly integrated into software systems, offering powerful capabilities but also raising concerns about fairness. Existing fairness benchmarks, however, focus on stereotype-specific associations,…

软件工程 · 计算机科学 2026-04-08 Gianmario Voria , Martina De Lucia , Alessandra Raia , Andrea De Lucia , Gemma Catolino , Fabio Palomba

Nowadays, Large Language Models (LLMs) are foundational components of modern software systems. As their influence grows, concerns about fairness have become increasingly pressing. Prior work has proposed metamorphic testing to detect…

With the increasing adoption of large language models (LLMs) in education, concerns about inherent biases in these models have gained prominence. We evaluate LLMs for bias in the personalized educational setting, specifically focusing on…

计算与语言 · 计算机科学 2025-02-11 Iain Weissburg , Sathvika Anand , Sharon Levy , Haewon Jeong

Large Language Models (LLMs) often generate responses with inherent biases, undermining their reliability in real-world applications. Existing evaluation methods often overlook biases in long-form responses and the intrinsic variability of…

计算与语言 · 计算机科学 2025-10-13 Weijie Xu , Yiwen Wang , Chi Xue , Xiangkun Hu , Xi Fang , Guimin Dong , Chandan K. Reddy

Large Language Model (LLM)-based recommendation systems excel in delivering comprehensive suggestions by deeply analyzing content and user behavior. However, they often inherit biases from skewed training data, favoring mainstream content…

信息检索 · 计算机科学 2026-02-02 Anindya Bijoy Das , Shahnewaz Karim Sakib

Large Language Models (LLMs) have revolutionized natural language processing, yet concerns persist regarding their tendency to reflect or amplify social biases. This study introduces a novel evaluation framework to uncover gender biases in…

计算与语言 · 计算机科学 2026-03-10 Evan Chen , Run-Jun Zhan , Yan-Bai Lin , Hung-Hsuan Chen

Generative AI technologies, particularly Large Language Models (LLMs), have transformed information management systems but introduced substantial biases that can compromise their effectiveness in informing business decision-making. This…

计算机与社会 · 计算机科学 2025-02-18 Xiahua Wei , Naveen Kumar , Han Zhang

Large Language Models(LLMs) have revolutionized various applications in natural language processing (NLP) by providing unprecedented text generation, translation, and comprehension capabilities. However, their widespread deployment has…

计算与语言 · 计算机科学 2024-09-26 Rajesh Ranjan , Shailja Gupta , Surya Narayan Singh

Large language models (LLMs) are increasingly deployed in high-stakes hiring applications, making decisions that directly impact people's careers and livelihoods. While prior studies suggest simple anti-bias prompts can eliminate…

机器学习 · 计算机科学 2025-06-13 Adam Karvonen , Samuel Marks

Large language models (LLMs) are widely applied across diverse domains, raising concerns about their limitations and potential risks. In this study, we investigate two types of bias that LLMs may display: stereotype bias and deviation bias.…

计算与语言 · 计算机科学 2026-05-20 Daniel Wang , Eli Brignac , Minjia Mao , Xiao Fang

Existing fairness benchmarks for large language models (LLMs) primarily focus on simple tasks, such as multiple-choice questions, overlooking biases that may arise in more complex scenarios like long-text generation. To address this gap, we…

计算与语言 · 计算机科学 2025-08-08 Wonje Jeung , Dongjae Jeon , Ashkan Yousefpour , Jonghyun Choi

Multimodal Large Language Models (MLLMs) have recently been explored as face verification systems that determine whether two face images are of the same person. Unlike dedicated face recognition systems, MLLMs approach this task through…

计算机视觉与模式识别 · 计算机科学 2026-03-27 Ünsal Öztürk , Hatef Otroshi Shahreza , Sébastien Marcel

With the advent of Large Language Models (LLMs) possessing increasingly impressive capabilities, a number of Large Vision-Language Models (LVLMs) have been proposed to augment LLMs with visual inputs. Such models condition generated text on…

计算机视觉与模式识别 · 计算机科学 2025-05-01 Phillip Howard , Kathleen C. Fraser , Anahita Bhiwandiwalla , Svetlana Kiritchenko

Large Language Model-enhanced Recommender Systems (LLM-enhanced RSs) have emerged as a powerful approach to improving recommendation quality by leveraging LLMs to generate item representations. Despite these advancements, the integration of…

信息检索 · 计算机科学 2025-07-08 Jiaming Zhang , Yuyuan Li , Yiqun Xu , Li Zhang , Xiaohua Feng , Zhifei Ren , Chaochao Chen

Large-scale web-scraped text corpora used to train general-purpose AI models often contain harmful demographic-targeted social biases, creating a regulatory need for data auditing and developing scalable bias-detection methods. Although…

计算与语言 · 计算机科学 2026-04-10 Ayan Majumdar , Feihao Chen , Jinghui Li , Xiaozhen Wang