English
Related papers

Related papers: ConfRAG: Confidence-Guided Retrieval-Augmenting Ge…

200 papers

Retrieval-augmented generation (RAG) frameworks enable large language models (LLMs) to retrieve relevant information from a knowledge base and incorporate it into the context for generating responses. This mitigates hallucinations and…

Computation and Language · Computer Science 2024-04-09 Pouria Rouzrokh , Shahriar Faghani , Cooper U. Gamble , Moein Shariatnia , Bradley J. Erickson

The increasing use of large language models (LLMs) in causal discovery as a substitute for human domain experts highlights the need for optimal model selection. This paper presents the first hallucination survey of popular LLMs for causal…

Computation and Language · Computer Science 2024-11-21 Grace Sng , Yanming Zhang , Klaus Mueller

Hallucination is a key roadblock for applications of Large Language Models (LLMs), particularly for enterprise applications that are sensitive to information accuracy. To address this issue, two general approaches have been explored:…

Computation and Language · Computer Science 2024-10-15 Xinxi Chen , Li Wang , Wei Wu , Qi Tang , Yiyao Liu

Retrieval-Augmented Generation (RAG) significantly improves the factuality of Large Language Models (LLMs), yet standard pipelines often lack mechanisms to verify inter- mediate reasoning, leaving them vulnerable to hallucinations in…

Computation and Language · Computer Science 2026-03-12 Eeham Khan , Luis Rodriguez , Marc Queudot

Large language models (LLMs) frequently generate confident yet factually incorrect content when used for language generation (a phenomenon often known as hallucination). Retrieval augmented generation (RAG) tries to reduce factual errors by…

Information Retrieval · Computer Science 2026-04-01 Dobrik Georgiev , Kheeran Naidu , Alberto Cattaneo , Federico Monti , Carlo Luschi , Daniel Justus

The rapid advancement of large language models (LLMs) has significantly impacted various domains, including healthcare and biomedicine. However, the phenomenon of hallucination, where LLMs generate outputs that deviate from factual accuracy…

Computation and Language · Computer Science 2024-08-27 Duy Khoa Pham , Bao Quoc Vo

Retrieval-augmented generation (RAG) improves large language models (LLMs) by using external knowledge to guide response generation, reducing hallucinations. However, RAG, particularly multi-modal RAG, can introduce new hallucination…

Machine Learning · Computer Science 2025-01-08 Matin Mortaheb , Mohammad A. Amir Khojastepour , Srimat T. Chakradhar , Sennur Ulukus

When applied to open-domain question answering, large language models (LLMs) frequently generate incorrect responses based on made-up facts, which are called $\textit{hallucinations}$. Retrieval augmented generation (RAG) is a promising…

Computation and Language · Computer Science 2024-04-09 Shuo Li , Sangdon Park , Insup Lee , Osbert Bastani

Biomedical question answering (QA) requires accurate interpretation of complex medical knowledge. Large language models (LLMs) have shown promising capabilities in this domain, with retrieval-augmented generation (RAG) systems enhancing…

Computation and Language · Computer Science 2025-10-21 Yingpeng Ning , Yuanyuan Sun , Ling Luo , Yanhua Wang , Yuchen Pan , Hongfei Lin

Despite the impressive capabilities of large language models (LLMs) across diverse applications, they still suffer from trustworthiness issues, such as hallucinations and misalignments. Retrieval-augmented language models (RAG) have been…

Artificial Intelligence · Computer Science 2024-07-31 Mintong Kang , Nezihe Merve Gürel , Ning Yu , Dawn Song , Bo Li

Dynamic Retrieval-Augmented Generation adaptively determines when to retrieve during generation to mitigate hallucinations in large language models (LLMs). However, existing methods rely on model-internal signals (e.g., logits, entropy),…

Computation and Language · Computer Science 2026-05-19 Dehai Min , Kailin Zhang , Tongtong Wu , Lu Cheng

Large Language Models (LLMs) generalize well across language tasks, but suffer from hallucinations and uninterpretability, making it difficult to assess their accuracy without ground-truth. Retrieval-Augmented Generation (RAG) models have…

Computation and Language · Computer Science 2023-12-18 Jakub Lála , Odhran O'Donoghue , Aleksandar Shtedritski , Sam Cox , Samuel G. Rodriques , Andrew D. White

Hallucination, where large language models (LLMs) generate confident but incorrect or irrelevant information, remains a key limitation in their application to complex, open-ended tasks. Chain-of-thought (CoT) prompting has emerged as a…

Artificial Intelligence · Computer Science 2025-05-15 Adarsh Kumar , Hwiyoon Kim , Jawahar Sai Nathani , Neil Roy

Large language models (LLMs) exhibit remarkable generative capabilities but often suffer from hallucinations. Retrieval-augmented generation (RAG) offers an effective solution by incorporating external knowledge, but existing methods still…

Computation and Language · Computer Science 2024-12-17 Xiaoxi Li , Jiajie Jin , Yujia Zhou , Yongkang Wu , Zhonghua Li , Qi Ye , Zhicheng Dou

Retrieval-augmented generation (RAG) has emerged as a promising solution for mitigating hallucinations of large language models (LLMs) with retrieved external knowledge. Adaptive RAG enhances this approach by enabling dynamic retrieval…

Computation and Language · Computer Science 2024-10-07 Huanshuo Liu , Hao Zhang , Zhijiang Guo , Jing Wang , Kuicai Dong , Xiangyang Li , Yi Quan Lee , Cong Zhang , Yong Liu

The Retrieval-augmented generation (RAG) system based on Large language model (LLM) has made significant progress. It can effectively reduce factuality hallucinations, but faithfulness hallucinations still exist. Previous methods for…

Computation and Language · Computer Science 2026-01-07 Jianpeng Hu , Yanzeng Li , Jialun Zhong , Wenfa Qi , Lei Zou

Retrieval-augmented generation (RAG) aims to reduce hallucinations by grounding responses in external context, yet large language models (LLMs) still frequently introduce unsupported information or contradictions even when provided with…

Computation and Language · Computer Science 2025-11-07 Manveer Singh Tamber , Forrest Sheng Bao , Chenyu Xu , Ge Luo , Suleman Kazi , Minseok Bae , Miaoran Li , Ofer Mendelevitch , Renyi Qu , Jimmy Lin

Retrieval-Augmented Generation (RAG) systems offer a powerful approach to enhancing large language model (LLM) outputs by incorporating fact-checked, contextually relevant information. However, fairness and reliability concerns persist, as…

Human-Computer Interaction · Computer Science 2025-04-24 Xuyang Zhu , Sejoon Chang , Andrew Kuik

A common and fundamental limitation of Generative AI (GenAI) is its propensity to hallucinate. While large language models (LLM) have taken the world by storm, without eliminating or at least reducing hallucinations, real-world GenAI…

Machine Learning · Computer Science 2024-12-03 Patrice Béchard , Orlando Marquez Ayala

Retrieval Augmented Generation (RAG) has emerged as a promising solution to address hallucination issues in Large Language Models (LLMs). However, the integration of multiple retrieval sources, while potentially more informative, introduces…

Information Retrieval · Computer Science 2025-08-12 Wenlong Wu , Haofen Wang , Bohan Li , Peixuan Huang , Xinzhe Zhao , Lei Liang