中文
相关论文

相关论文: Beyond Factual Accuracy: Evaluating Global Reasoni…

200 篇论文

Retrieval-Augmented Generation (RAG) has emerged as a widely adopted approach for enhancing LLMs in scenarios that demand extensive factual knowledge. However, current RAG evaluations concentrate primarily on correctness, which may not…

计算与语言 · 计算机科学 2026-03-23 Vinh Nguyen , Cuong Dang , Jiahao Zhang , Hoa Tran , Minh Tran , Trinh Chau , Thai Le , Lu Cheng , Suhang Wang

Retrieval-augmented generation (RAG) has become a widely adopted paradigm for enabling knowledge-grounded large language models (LLMs). However, standard RAG pipelines often fail to ensure that model reasoning remains consistent with the…

人工智能 · 计算机科学 2025-10-14 Jiaqi Wei , Hao Zhou , Xiang Zhang , Di Zhang , Zijie Qiu , Wei Wei , Jinzhe Li , Wanli Ouyang , Siqi Sun

Retrieval-Augmented Generation (RAG) enables large language models (LLMs) to access broader knowledge sources, yet factual inconsistencies persist due to noise in retrieved documents-even with advanced retrieval methods. We demonstrate that…

计算与语言 · 计算机科学 2025-06-04 Yongjian Li , HaoCheng Chu , Yukun Yan , Zhenghao Liu , Shi Yu , Zheni Zeng , Ruobing Wang , Sen Song , Zhiyuan Liu , Maosong Sun

Although the Retrieval-Augmented Generation (RAG) paradigms can use external knowledge to enhance and ground the outputs of Large Language Models (LLMs) to mitigate generative hallucinations and static knowledge base problems, they still…

计算与语言 · 计算机科学 2024-05-24 Diji Yang , Jinmeng Rao , Kezhen Chen , Xiaoyuan Guo , Yawen Zhang , Jie Yang , Yi Zhang

Access to the right evidence does not guarantee that large language models (LLMs) will reason with it correctly. This gap between retrieval and reasoning is especially concerning in clinical settings, where outputs must align with…

Large Language Models (LLMs) exhibit high reasoning capacity in medical question-answering, but their tendency to produce hallucinations and outdated knowledge poses critical risks in healthcare fields. While Retrieval-Augmented Generation…

计算与语言 · 计算机科学 2026-03-25 Wenhao Wu , Zhentao Tang , Yafu Li , Shixiong Kai , Mingxuan Yuan , Chunlin Chen , Zhi Wang

Retrieval-Augmented Generation (RAG) enhances Large Language Models (LLMs) by integrating them with an external knowledge base to improve the answer relevance and accuracy. In real-world scenarios, beyond pure text, a substantial amount of…

计算与语言 · 计算机科学 2025-10-07 Jiaru Zou , Dongqi Fu , Sirui Chen , Xinrui He , Zihao Li , Yada Zhu , Jiawei Han , Jingrui He

Retrieval-Augmented Generation (RAG) helps large language models (LLMs) answer knowledge-intensive and time-sensitive questions by conditioning generation on external evidence. However, most RAG systems still retrieve unstructured chunks…

计算与语言 · 计算机科学 2026-03-11 Jiashuo Sun , Yixuan Xie , Jimeng Shi , Shaowen Wang , Jiawei Han

Retrieval Augmented Generation (RAG) has become the standard approach for equipping Large Language Models (LLMs) with up-to-date knowledge. However, standard RAG, relying on independent passage retrieval, often fails to capture the…

计算与语言 · 计算机科学 2025-11-20 Jingjin Wang , Jiawei Han

Performance evaluation of Retrieval-Augmented Generation (RAG) systems within enterprise environments is governed by multi-dimensional and composite factors extending far beyond simple final accuracy checks. These factors include reasoning…

计算与语言 · 计算机科学 2026-04-06 Kenichirou Narita , Siqi Peng , Taku Fukui , Moyuru Yamada , Satoshi Munakata , Satoru Takahashi

As reasoning LLMs increasingly trade tokens for accuracy through deliberation, search, and self-correction, a single accuracy score can no longer tell whether those tokens buy useful reasoning, recovery from hard instances, or unnecessary…

计算与语言 · 计算机科学 2026-05-19 Daniel Kaiser , Arnoldo Frigessi , Ali Ramezani-Kebrya , Benjamin Ricaud

Retrieval Augmented Generation (RAG) has emerged as a powerful application of Large Language Models (LLMs), revolutionizing information search and consumption. RAG systems combine traditional search capabilities with LLMs to generate…

信息检索 · 计算机科学 2025-06-12 Harsh Maheshwari , Srikanth Tenneti , Alwarappan Nakkiran

Despite the impressive performance of Retrieval-augmented Generation (RAG) systems across various NLP benchmarks, their robustness in handling real-world user-LLM interaction queries remains largely underexplored. This presents a critical…

计算与语言 · 计算机科学 2026-01-28 Tianyu Cao , Neel Bhandari , Akhila Yerukola , Akari Asai , Maarten Sap

This paper examines how to make large language models reliable for high-stakes legal work by reducing hallucinations. It distinguishes three AI paradigms: (1) standalone generative models ("creative oracle"), (2) basic retrieval-augmented…

人工智能 · 计算机科学 2026-01-23 Alex Dantart

Retrieval-Augmented Generation (RAG) is a critical technique for grounding Large Language Models (LLMs) in factual evidence, yet evaluating RAG systems in specialized, safety-critical domains remains a significant challenge. Existing…

计算与语言 · 计算机科学 2025-11-07 Joshua Gao , Quoc Huy Pham , Subin Varghese , Silwal Saurav , Vedhus Hoskere

Large language models (LLMs) often hallucinate in long-form generation. Existing approaches mainly improve factuality through post-hoc revision or reinforcement learning (RL) with correctness-based rewards, but they do not teach the model…

计算与语言 · 计算机科学 2026-04-15 Xin Liu , Lu Wang

Retrieval-Augmented Generation (RAG) has been proposed to mitigate hallucinations in large language models (LLMs), where generated outputs may be factually incorrect. However, existing RAG approaches predominantly rely on vector similarity…

信息检索 · 计算机科学 2026-04-28 Miao Xie , Xiao Zhang , Yi Li , Chunli Lv

Retrieval-Augmented Generation (RAG) enriches Large Language Models (LLMs) by combining their internal, parametric knowledge with external, non-parametric sources, with the goal of improving factual correctness and minimizing…

信息检索 · 计算机科学 2025-08-13 Tim Cofala , Oleh Astappiev , William Xion , Hailay Teklehaymanot

This paper describes an investigation of the robustness of large language models (LLMs) for retrieval augmented generation (RAG)-based summarization tasks. While LLMs provide summarization capabilities, their performance in complex,…

计算与语言 · 计算机科学 2024-04-01 Shengjie Liu , Jing Wu , Jingyuan Bao , Wenyi Wang , Naira Hovakimyan , Christopher G Healey

Large Reasoning Models (LRMs) have shown impressive capabilities in multi-step reasoning tasks. However, alongside these successes, a more deceptive form of model error has emerged--Reasoning Hallucination--where logically coherent but…

人工智能 · 计算机科学 2025-05-20 Zhongxiang Sun , Qipeng Wang , Haoyu Wang , Xiao Zhang , Jun Xu