中文
相关论文

相关论文: Retromorphic Testing with Hierarchical Verificatio…

200 篇论文

Retrieval augmented generation (RAG) systems provide a method for factually grounding the responses of a Large Language Model (LLM) by providing retrieved evidence, or context, as support. Guided by this context, RAG systems can reduce…

信息检索 · 计算机科学 2025-09-05 Shakiba Amirshahi , Amin Bigdeli , Charles L. A. Clarke , Amira Ghenai

Large language models (LLMs) are increasingly used to generate scientific reports, but they can produce references that appear plausible while containing corrupted metadata or pointing to papers that do not exist. We introduce CiteCheck, a…

数字图书馆 · 计算机科学 2026-05-28 Khashayar Khajavi , Shaghayegh Sadeghi , Rise Adhikari , Alexander Tessier

This article surveys Evaluation models to automatically detect hallucinations in Retrieval-Augmented Generation (RAG), and presents a comprehensive benchmark of their performance across six RAG applications. Methods included in our study…

机器学习 · 计算机科学 2025-04-08 Ashish Sardana

Retrieval-augmented generation (RAG) enhances large language models (LLMs) by incorporating external knowledge to generate a response within a context with improved accuracy and reduced hallucinations. However, multi-modal RAG systems face…

机器学习 · 计算机科学 2025-01-09 Matin Mortaheb , Mohammad A. Amir Khojastepour , Srimat T. Chakradhar , Sennur Ulukus

Large language models (LLMs) have transformed the landscape of language processing, yet struggle with significant challenges in terms of security, privacy, and the generation of seemingly coherent but factually inaccurate outputs, commonly…

软件工程 · 计算机科学 2024-09-04 Ningke Li , Yuekang Li , Yi Liu , Ling Shi , Kailong Wang , Haoyu Wang

This paper introduces a comprehensive system for detecting hallucinations in large language model (LLM) outputs in enterprise settings. We present a novel taxonomy of LLM responses specific to hallucination in enterprise applications,…

计算与语言 · 计算机科学 2025-04-10 Bibek Paudel , Alexander Lyzhov , Preetam Joshi , Puneet Anand

Detecting hallucinations in large language models (LLMs) remains a fundamental challenge for their trustworthy deployment. Going beyond basic uncertainty-driven hallucination detection frameworks, we propose a simple yet powerful method…

人工智能 · 计算机科学 2025-10-10 Rui Wang , Zeming Wei , Guanzhang Yue , Meng Sun

Retrieval-Augmented Generation (RAG) is widely used to augment the input to Large Language Models (LLMs) with external information, such as recent or domain-specific knowledge. Nonetheless, current models still produce closed-domain…

计算与语言 · 计算机科学 2026-04-20 Fabian Ridder , Laurin Lessel , Malte Schilling

Retrieval-Augmented Generation (RAG) is a promising approach for mitigating the hallucination of large language models (LLMs). However, existing research lacks rigorous evaluation of the impact of retrieval-augmented generation on different…

计算与语言 · 计算机科学 2023-12-21 Jiawei Chen , Hongyu Lin , Xianpei Han , Le Sun

Large language models (LLMs) have shown promise in medical question answering but often struggle with hallucinations and shallow reasoning, particularly in tasks requiring nuanced clinical understanding. Retrieval-augmented generation (RAG)…

计算与语言 · 计算机科学 2025-08-25 Ziyu Wang , Elahe Khatibi , Amir M. Rahmani

Detecting hallucinations in large language models (LLMs) is critical for enhancing their reliability and trustworthiness. Most research focuses on hallucinations as deviations from information seen during training. However, the opaque…

计算与语言 · 计算机科学 2025-03-26 Fabian Ridder , Malte Schilling

Despite the impressive capabilities of large language models (LLMs) across diverse applications, they still suffer from trustworthiness issues, such as hallucinations and misalignments. Retrieval-augmented language models (RAG) have been…

人工智能 · 计算机科学 2024-07-31 Mintong Kang , Nezihe Merve Gürel , Ning Yu , Dawn Song , Bo Li

Retrieval-Augmented Generation (RAG) models frequently encounter hallucination phenomena when integrating external information with internal parametric knowledge. Empirical studies demonstrate that the disequilibrium between external…

计算与语言 · 计算机科学 2025-05-13 Lei Wang

Retrieval-Augmented Generation (RAG) has emerged as a widely adopted approach for enhancing LLMs in scenarios that demand extensive factual knowledge. However, current RAG evaluations concentrate primarily on correctness, which may not…

计算与语言 · 计算机科学 2026-03-23 Vinh Nguyen , Cuong Dang , Jiahao Zhang , Hoa Tran , Minh Tran , Trinh Chau , Thai Le , Lu Cheng , Suhang Wang

We introduce FaithScore (Faithfulness to Atomic Image Facts Score), a reference-free and fine-grained evaluation metric that measures the faithfulness of the generated free-form answers from large vision-language models (LVLMs). The…

计算机视觉与模式识别 · 计算机科学 2024-09-30 Liqiang Jing , Ruosen Li , Yunmo Chen , Xinya Du

The rapid advancement of large language models (LLMs) has significantly impacted various domains, including healthcare and biomedicine. However, the phenomenon of hallucination, where LLMs generate outputs that deviate from factual accuracy…

计算与语言 · 计算机科学 2024-08-27 Duy Khoa Pham , Bao Quoc Vo

Retrieval-Augmented Generation (RAG) enhances Large Language Models (LLMs) by integrating them with an external knowledge base to improve the answer relevance and accuracy. In real-world scenarios, beyond pure text, a substantial amount of…

计算与语言 · 计算机科学 2025-10-07 Jiaru Zou , Dongqi Fu , Sirui Chen , Xinrui He , Zihao Li , Yada Zhu , Jiawei Han , Jingrui He

Large language models (LLMs), despite their remarkable text generation capabilities, often hallucinate and generate text that is factually incorrect and not grounded in real-world knowledge. This poses serious risks in domains like…

计算与语言 · 计算机科学 2025-11-18 Raavi Gupta , Pranav Hari Panicker , Sumit Bhatia , Ganesh Ramakrishnan

Retrieval-Augmented Generation (RAG) grounds large language models (LLMs) in external evidence, but fails when retrieved sources conflict or contain outdated or subjective information. Prior work address these issues independently but lack…

计算与语言 · 计算机科学 2025-12-19 Shubham Mishra , Samyek Jain , Gorang Mehrishi , Shiv Tiwari , Harsh Sharma , Pratik Narang , Dhruv Kumar

With the widespread adoption of large language models (LLMs) in numerous applications, the challenge of factuality and the propensity for hallucinations has emerged as a significant concern. To address this issue, particularly in…

人工智能 · 计算机科学 2024-07-03 Yihao Fang , Stephen W. Thomas , Xiaodan Zhu