English
Related papers

Related papers: SEER: Self-Aligned Evidence Extraction for Retriev…

200 papers

Retrieval-Augmented Generation (RAG) has been proposed to mitigate hallucinations in large language models (LLMs), where generated outputs may be factually incorrect. However, existing RAG approaches predominantly rely on vector similarity…

Information Retrieval · Computer Science 2026-04-28 Miao Xie , Xiao Zhang , Yi Li , Chunli Lv

Bearing in mind the limited parametric knowledge of Large Language Models (LLMs), retrieval-augmented generation (RAG) which supplies them with the relevant external knowledge has served as an approach to mitigate the issue of…

Computation and Language · Computer Science 2025-01-10 Hanna Zubkova , Ji-Hoon Park , Seong-Whan Lee

While Retrieval-Augmented Generation (RAG) systems enhance Large Language Models (LLMs) by incorporating external knowledge, they still face persistent challenges in retrieval inefficiency and the inability of LLMs to filter out irrelevant…

Computation and Language · Computer Science 2025-02-13 Ruobing Yao , Yifei Zhang , Shuang Song , Yuhua Liu , Neng Gao , Chenyang Tu

Retrieval-Augmented Generation (RAG) enables large language models (LLMs) to access broader knowledge sources, yet factual inconsistencies persist due to noise in retrieved documents-even with advanced retrieval methods. We demonstrate that…

Computation and Language · Computer Science 2025-06-04 Yongjian Li , HaoCheng Chu , Yukun Yan , Zhenghao Liu , Shi Yu , Zheni Zeng , Ruobing Wang , Sen Song , Zhiyuan Liu , Maosong Sun

Retrieval-Augmented Generation (RAG) enhances factual grounding in large language models (LLMs) by incorporating retrieved evidence, but LLM accuracy declines when long or noisy contexts exceed the model's effective attention span. Existing…

Computation and Language · Computer Science 2026-03-25 Debashish Chakraborty , Eugene Yang , Daniel Khashabi , Dawn Lawrie , Kevin Duh

Retrieval augmented generation (RAG) has become the standard in long context question answering (QA) systems. However, typical implementations of RAG rely on a rather naive retrieval mechanism, in which texts whose embeddings are most…

Computation and Language · Computer Science 2024-10-08 Keyush Shah , Abhishek Goyal , Isaac Wasserman

Large language models with long context windows can answer complex questions directly from full-length academic, technical, and policy documents, but passing entire documents is often costly, slow, and can degrade answer quality while…

Document Visual Question Answering (Document VQA) must cope with documents that span dozens of pages, yet leading systems still concatenate every page or rely on very large vision-language models, both of which are memory-hungry.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Eric López , Artemis Llabrés , Ernest Valveny

Retrieval-augmented generation (RAG) offers an effective approach for addressing question answering (QA) tasks. However, the imperfections of the retrievers in RAG models often result in the retrieval of irrelevant information, which could…

Computation and Language · Computer Science 2024-06-18 Jinyuan Fang , Zaiqiao Meng , Craig Macdonald

A Comparison of Independent and Joint Fine-tuning Strategies for Retrieval-Augmented Generation Download PDF Neal Gregory Lawton, Alfy Samuel, Anoop Kumar, Daben Liu Published: 20 Aug 2025, Retrieval augmented generation (RAG) is a popular…

Computation and Language · Computer Science 2025-10-21 Neal Gregory Lawton , Alfy Samuel , Anoop Kumar , Daben Liu

Recent reinforcement learning (RL) approaches have advanced radiology report generation (RRG), yet two core limitations persist: (1) report-level rewards offer limited evidence-grounded guidance for clinical faithfulness; and (2) current…

Machine Learning · Computer Science 2026-04-16 Qin Zhou , Guoyan Liang , Qianyi Yang , Jingyuan Chen , Sai Wu , Chang Yao , Zhe Wang

Large language models (LLMs) often struggle with context fidelity, producing inconsistent answers when responding to questions based on provided information. Existing approaches either rely on expensive supervised fine-tuning to generate…

Computation and Language · Computer Science 2025-09-18 Suyuchen Wang , Jinlin Wang , Xinyu Wang , Shiqi Li , Xiangru Tang , Sirui Hong , Xiao-Wen Chang , Chenglin Wu , Bang Liu

Retrieval-Augmented Generation (RAG) has emerged as a promising paradigm for improving the timeliness of knowledge updates and the factual accuracy of large language models. However, incorporating a large volume of retrieved documents…

Computation and Language · Computer Science 2026-05-29 Ziqiang Cui , Yunpeng Weng , Xing Tang , Peiyang Liu , Shiwei Li , Bowei He , Jiamin Chen , Yansen Zhang , Xiuqiang He , Chen Ma

Retrieval-Augmented Generation (RAG) merges retrieval methods with deep learning advancements to address the static limitations of large language models (LLMs) by enabling the dynamic integration of up-to-date external information. This…

Information Retrieval · Computer Science 2026-05-19 Yizheng Huang , Jimmy Huang

Retrieval-Augmented Generation (RAG) has emerged as a powerful technique for enhancing the quality of responses in Question-Answering (QA) tasks. However, existing approaches often struggle with retrieving contextually relevant information,…

Computation and Language · Computer Science 2026-01-27 Tianyi Yang , Nashrah Haque , Vaishnave Jonnalagadda , Yuya Jeremy Ong , Zhehui Chen , Yanzhao Wu , Lei Yu , Divyesh Jadav , Wenqi Wei

Retrieval-Augmented Generation (RAG) is a framework for grounding Large Language Models (LLMs) in external, up-to-date information. However, recent advancements in context window size allow LLMs to process inputs of up to 128K tokens or…

Machine Learning · Computer Science 2026-02-26 Seongwoong Shim , Myunsoo Kim , Jae Hyeon Cho , Byung-Jun Lee

In-context learning has recently been linked to implicit gradient descent in linear self-attention models, suggesting that context can induce a forward-pass update. Retrieval-augmented generation (RAG) also relies on context, but retrieved…

Computation and Language · Computer Science 2026-05-27 Mingchen Li , Jiatan Huang , Chuxu Zhang , Liang Zhao , Hong Yu

In reinforcement learning (RL), experience replay-based sampling techniques play a crucial role in promoting convergence by eliminating spurious correlations. However, widely used methods such as uniform experience replay (UER) and…

Machine Learning · Computer Science 2023-02-07 Ramnath Kumar , Dheeraj Nagaraj

Recent advances in Large Language Models (LLMs) have significantly improved complex reasoning capabilities. Retrieval-Augmented Generation (RAG) has further extended these capabilities by grounding generation in dynamically retrieved…

Computation and Language · Computer Science 2026-02-23 Jash Rajesh Parekh , Pengcheng Jiang , Jiawei Han

Personalized image generation is crucial for improving the user experience, as it renders reference images into preferred ones according to user visual preferences. Although effective, existing methods face two main issues. First, existing…