English
Related papers

Related papers: Speculative RAG: Enhancing Retrieval Augmented Gen…

200 papers

Recent studies have demonstrated that large language models (LLMs) exhibit significant biases in evaluation tasks, particularly in preferentially rating and favoring self-generated content. However, the extent to which this bias manifests…

Computation and Language · Computer Science 2025-12-09 Yen-Shan Chen , Jing Jin , Peng-Ting Kuo , Chao-Wei Huang , Yun-Nung Chen

Retrieval-Augmented Generation (RAG) has proven its effectiveness in mitigating hallucinations in Large Language Models (LLMs) by retrieving knowledge from external resources. To adapt LLMs for the RAG systems, current approaches use…

Computation and Language · Computer Science 2025-03-05 Xinze Li , Sen Mei , Zhenghao Liu , Yukun Yan , Shuo Wang , Shi Yu , Zheni Zeng , Hao Chen , Ge Yu , Zhiyuan Liu , Maosong Sun , Chenyan Xiong

In this study, we explore the fine-tuning of Large Language Models (LLMs) to better support policymakers in their crucial work of understanding, analyzing, and crafting legal regulations. To equip the model with a deep understanding of…

Computation and Language · Computer Science 2025-11-06 One Octadion , Bondan Sapta Prakoso , Nanang Yudi Setiawan , Novanto Yudistira

Retrieval-Augmented Generation (RAG) mitigates hallucination in large language models (LLMs) by incorporating external knowledge during generation. However, the effectiveness of RAG depends not only on the design of the retriever and the…

Computation and Language · Computer Science 2026-04-15 Xudong Wang , Chaoning Zhang , Qigan Sun , Zhenzhen Huang , Chang Lu , Sheng Zheng , Zeyu Ma , Caiyan Qin , Yang Yang , Hengtao Shen

A common and fundamental limitation of Generative AI (GenAI) is its propensity to hallucinate. While large language models (LLM) have taken the world by storm, without eliminating or at least reducing hallucinations, real-world GenAI…

Machine Learning · Computer Science 2024-12-03 Patrice Béchard , Orlando Marquez Ayala

Graph-based Retrieval-Augmented Generation (RAG) has proven effective in integrating external knowledge into large language models (LLMs), improving their factual accuracy, adaptability, interpretability, and trustworthiness. A number of…

Information Retrieval · Computer Science 2026-04-28 Yingli Zhou , Yaodong Su , Youran Sun , Shu Wang , Taotao Wang , Runyuan He , Yongwei Zhang , Sicong Liang , Xilin Liu , Yuchi Ma , Yixiang Fang

Retrieval-Augmented Generation (RAG) mitigates key limitations of Large Language Models (LLMs)-such as factual errors, outdated knowledge, and hallucinations-by dynamically retrieving external information. Recent work extends this paradigm…

Computation and Language · Computer Science 2026-05-22 Jingru Lin , Chen Zhang , Stephen Y. Liu , Haizhou Li

Retrieval augmented generation (RAG) systems provide a method for factually grounding the responses of a Large Language Model (LLM) by providing retrieved evidence, or context, as support. Guided by this context, RAG systems can reduce…

Information Retrieval · Computer Science 2025-09-05 Shakiba Amirshahi , Amin Bigdeli , Charles L. A. Clarke , Amira Ghenai

Retrieval-augmented generation (RAG) enhances large language models (LLMs) by integrating external knowledge retrieved from a knowledge base. However, its effectiveness is fundamentally constrained by the reliability of both the retriever…

Computation and Language · Computer Science 2025-01-31 Yiteng Tu , Weihang Su , Yujia Zhou , Yiqun Liu , Qingyao Ai

While Retrieval-Augmented Generation (RAG) has been swiftly adopted in scientific and clinical QA systems, a comprehensive evaluation benchmark in the medical domain is lacking. To address this gap, we introduce the Medical…

Computation and Language · Computer Science 2026-02-12 Liz Li , Wei Zhu

Retrieval-Augmented Generation (RAG) significantly improves the factuality of Large Language Models (LLMs), yet standard pipelines often lack mechanisms to verify inter- mediate reasoning, leaving them vulnerable to hallucinations in…

Computation and Language · Computer Science 2026-03-12 Eeham Khan , Luis Rodriguez , Marc Queudot

Medical question answering (QA) is a reasoning-intensive task that remains challenging for large language models (LLMs) due to hallucinations and outdated domain knowledge. Retrieval-Augmented Generation (RAG) provides a promising…

Computation and Language · Computer Science 2025-05-01 Xuanzhao Dong , Wenhui Zhu , Hao Wang , Xiwen Chen , Peijie Qiu , Rui Yin , Yi Su , Yalin Wang

Advancements in model algorithms, the growth of foundational models, and access to high-quality datasets have propelled the evolution of Artificial Intelligence Generated Content (AIGC). Despite its notable successes, AIGC still faces…

Computer Vision and Pattern Recognition · Computer Science 2024-06-24 Penghao Zhao , Hailin Zhang , Qinhan Yu , Zhengren Wang , Yunteng Geng , Fangcheng Fu , Ling Yang , Wentao Zhang , Jie Jiang , Bin Cui

Retrieval Augmented Generation (RAG) has emerged as a powerful application of Large Language Models (LLMs), revolutionizing information search and consumption. RAG systems combine traditional search capabilities with LLMs to generate…

Information Retrieval · Computer Science 2025-06-12 Harsh Maheshwari , Srikanth Tenneti , Alwarappan Nakkiran

Large language models (LLMs) have demonstrated strong capabilities in medical question answering; however, purely parametric models often suffer from knowledge gaps and limited factual grounding. Retrieval-augmented generation (RAG)…

Computation and Language · Computer Science 2026-04-09 Nusrat Sultana , Abdullah Muhammad Moosa , Kazi Afzalur Rahman , Sajal Chandra Banik

Large Language Models are increasingly being used for various tasks including content generation and as chatbots. Despite their impressive performances in general tasks, LLMs need to be aligned when applying for domain specific tasks to…

Computation and Language · Computer Science 2023-08-02 S. S. Manathunga , Y. A. Illangasekara

Retrieval-Augmented Generation (RAG) is an effective method to enhance the capabilities of large language models (LLMs). Existing methods typically optimize the retriever or the generator in a RAG system by directly using the top-k…

Computation and Language · Computer Science 2025-10-07 Shaohan Wang , Licheng Zhang , Zheren Fu , Zhendong Mao , Yongdong Zhang

Retrieval-Augmented Generation (RAG) encounters efficiency challenges when scaling to massive knowledge bases while preserving contextual relevance. We propose Hash-RAG, a framework that integrates deep hashing techniques with systematic…

Information Retrieval · Computer Science 2025-06-04 Jinyu Guo , Xunlei Chen , Qiyang Xia , Zhaokun Wang , Jie Ou , Libo Qin , Shunyu Yao , Wenhong Tian

Large Language Models (LLMs), despite their remarkable capabilities, are prone to generating hallucinated or outdated content due to their static internal knowledge. While Retrieval-Augmented Generation (RAG) integrated with Reinforcement…

Computation and Language · Computer Science 2026-01-14 Zhiwen Tan , Jiaming Huang , Qintong Wu , Hongxuan Zhang , Chenyi Zhuang , Jinjie Gu

Retrieval-Augmented Generation (RAG) has shown promise in enhancing recommendation systems by incorporating external context into large language model prompts. However, existing RAG-based approaches often rely on static retrieval heuristics…