中文
相关论文

相关论文: Evaluating Social Bias in RAG Systems: When Extern…

200 篇论文

The paradigm of retrieval-augmented generated (RAG) helps mitigate hallucinations of large language models (LLMs). However, RAG also introduces biases contained within the retrieved documents. These biases can be amplified in scenarios…

Large Language Models (LLMs) have emerged as powerful candidates to inform clinical decision-making processes. While these models play an increasingly prominent role in shaping the digital landscape, two growing concerns emerge in…

计算与语言 · 计算机科学 2024-04-24 Raphael Poulain , Hamed Fayyaz , Rahmatollah Beheshti

RAG systems have transformed how LLMs access external knowledge, but we find that current implementations exhibit a bias toward factual, objective content, as evidenced by existing benchmarks and datasets that prioritize objective…

人工智能 · 计算机科学 2026-04-15 Aditya Agrawal , Alwarappan Nakkiran , Darshan Fofadiya , Alex Karlsson , Harsha Aduri

Retrieval-Augmented Generation (RAG) has been shown to enhance the factual accuracy of Large Language Models (LLMs), but existing methods often suffer from limited reasoning capabilities in effectively using the retrieved evidence,…

计算与语言 · 计算机科学 2024-10-03 Shayekh Bin Islam , Md Asib Rahman , K S M Tozammel Hossain , Enamul Hoque , Shafiq Joty , Md Rizwan Parvez

Retrieval-Augmented Generation (RAG) lifts the factuality of Large Language Models (LLMs) by injecting external knowledge, yet it falls short on problems that demand multi-step inference; conversely, purely reasoning-oriented approaches…

Large Language models (LLMs), such as ChatGPT, have gained popularity in recent years with the advancement of Natural Language Processing (NLP), with use cases spanning many disciplines and daily lives as well. LLMs inherit explicit and…

计算与语言 · 计算机科学 2025-12-01 Fatima Kazi

Financial institutions increasingly rely on large language models (LLMs) for high-stakes decision-making. However, these models risk perpetuating harmful biases if deployed without careful oversight. This paper investigates racial bias in…

综合经济学 · 经济学 2025-06-24 Thomas R. Cook , Sophia Kazinnik

Recent studies have demonstrated that some Large Language Models exhibit choice-supportive bias (CSB) when performing evaluations, systematically favoring their chosen options and potentially compromising the objectivity of AI-assisted…

计算与语言 · 计算机科学 2025-12-04 Nan Zhuang , Wenshuo Wang , Lekai Qian , Yuxiao Wang , Boyu Cao , Qi Liu

Gender bias in artificial intelligence (AI) and natural language processing has garnered significant attention due to its potential impact on societal perceptions and biases. This research paper aims to analyze gender bias in Large Language…

计算与语言 · 计算机科学 2023-09-04 Vishesh Thakur

Retrieval-Augmented Generation (RAG) systems have recently shown remarkable advancements by integrating retrieval mechanisms into language models, enhancing their ability to produce more accurate and contextually relevant responses.…

计算与语言 · 计算机科学 2025-01-14 Siran Li , Linus Stenzel , Carsten Eickhoff , Seyed Ali Bahrainian

Large language models (LLMs) have significantly advanced the field of automated code generation. However, a notable research gap exists in evaluating social biases that may be present in the code produced by LLMs. To solve this issue, we…

软件工程 · 计算机科学 2025-03-10 Lin Ling , Fazle Rabbi , Song Wang , Jinqiu Yang

Retrieval-Augmented Generation (RAG) mitigates hallucination in large language models (LLMs) by incorporating external knowledge during generation. However, the effectiveness of RAG depends not only on the design of the retriever and the…

计算与语言 · 计算机科学 2026-04-15 Xudong Wang , Chaoning Zhang , Qigan Sun , Zhenzhen Huang , Chang Lu , Sheng Zheng , Zeyu Ma , Caiyan Qin , Yang Yang , Hengtao Shen

Large language models (LLMs) are trained on vast, uncurated datasets that contain various forms of biases and language reinforcing harmful stereotypes that may be subsequently inherited by the models themselves. Therefore, it is essential…

计算与语言 · 计算机科学 2024-10-01 Jacob-Junqi Tian , Omkar Dige , D. B. Emerson , Faiza Khan Khattak

Large Language Models (LLMs) are being adopted across a wide range of tasks, including decision-making processes in industries where bias in AI systems is a significant concern. Recent research indicates that LLMs can harbor implicit biases…

计算与语言 · 计算机科学 2024-10-18 Divyanshu Kumar , Umang Jain , Sahil Agarwal , Prashanth Harshangi

Large Language Models (LLMs) routinely infer users demographic traits from phrasing alone, which can result in biased responses, even when no explicit demographic information is provided. The role of disability cues in shaping these…

计算与语言 · 计算机科学 2025-10-23 Vishnu Hari , Kalpana Panda , Srikant Panda , Amit Agarwal , Hitesh Laxmichand Patel

Retrieval-Augmented Generation (RAG) is widely adopted for its effectiveness and cost-efficiency in mitigating hallucinations and enhancing the domain-specific generation capabilities of large language models (LLMs). However, is this…

信息检索 · 计算机科学 2024-10-11 Mengxuan Hu , Hongyi Wu , Zihan Guan , Ronghang Zhu , Dongliang Guo , Daiqing Qi , Sheng Li

Retrieval-Augmented Generation (RAG) has gained significant attention in recent years for its potential to enhance natural language understanding and generation by combining large-scale retrieval systems with generative models. RAG…

计算与语言 · 计算机科学 2025-03-18 Mingyue Cheng , Yucong Luo , Jie Ouyang , Qi Liu , Huijie Liu , Li Li , Shuo Yu , Bohou Zhang , Jiawei Cao , Jie Ma , Daoyu Wang , Enhong Chen

Efforts to ensure the safety of large language models (LLMs) include safety fine-tuning, evaluation, and red teaming. However, despite the widespread use of the Retrieval-Augmented Generation (RAG) framework, AI safety work focuses on…

计算与语言 · 计算机科学 2025-04-28 Bang An , Shiyue Zhang , Mark Dredze

Extending context windows (i.e., Long Context, LC) and using retrievers to selectively access relevant information (i.e., Retrieval-Augmented Generation, RAG) are the two main strategies to enable LLMs to incorporate extremely long external…

计算与语言 · 计算机科学 2025-01-06 Xinze Li , Yixin Cao , Yubo Ma , Aixin Sun

Large Language Models (LLMs) have significantly advanced natural language processing applications, yet their widespread use raises concerns regarding inherent biases that may reduce utility or harm for particular social groups. Despite the…

计算机与社会 · 计算机科学 2025-02-05 Bo Pang , Tingrui Qiao , Caroline Walker , Chris Cunningham , Yun Sing Koh