English
Related papers

Related papers: Scaling Test-Time Inference with Policy-Optimized,…

200 papers

Retrieval Augmented Generation (RAG) has proven to be highly effective in boosting the generative performance of language model in knowledge-intensive tasks. However, existing RAG framework either indiscriminately perform retrieval or rely…

Artificial Intelligence · Computer Science 2025-01-03 Xiaqiang Tang , Qiang Gao , Jian Li , Nan Du , Qi Li , Sihong Xie

Large language models (LLMs) augmented with retrieval exhibit robust performance and extensive versatility by incorporating external contexts. However, the input length grows linearly in the number of retrieved documents, causing a dramatic…

Computation and Language · Computer Science 2024-05-28 Yun Zhu , Jia-Chen Gu , Caitlin Sikora , Ho Ko , Yinxiao Liu , Chu-Cheng Lin , Lei Shu , Liangchen Luo , Lei Meng , Bang Liu , Jindong Chen

Large pre-trained language models have been shown to store factual knowledge in their parameters, and achieve state-of-the-art results when fine-tuned on downstream NLP tasks. However, their ability to access and precisely manipulate…

Retrieval-Augmented Generation (RAG) is a promising approach to mitigate hallucinations in Large Language Models (LLMs) for legal applications, but its reliability is critically dependent on the accuracy of the retrieval step. This is…

Computation and Language · Computer Science 2025-10-09 Markus Reuter , Tobias Lingenberg , Rūta Liepiņa , Francesca Lagioia , Marco Lippi , Giovanni Sartor , Andrea Passerini , Burcu Sayin

Current state-of-the-art large language models are effective in generating high-quality text and encapsulating a broad spectrum of world knowledge. These models, however, often hallucinate and lack locally relevant factual data.…

Software Engineering · Computer Science 2024-02-21 Anton Shapkin , Denis Litvinov , Yaroslav Zharov , Egor Bogomolov , Timur Galimzyanov , Timofey Bryksin

Large language models (LLMs) often struggle with knowledge-intensive tasks due to hallucinations and outdated parametric knowledge. While Retrieval-Augmented Generation (RAG) addresses this by integrating external corpora, its effectiveness…

Computation and Language · Computer Science 2026-02-04 Su Dong , Qinggang Zhang , Yilin Xiao , Shengyuan Chen , Chuang Zhou , Xiao Huang

In the rapidly evolving field of data science, efficiently navigating the expansive body of academic literature is crucial for informed decision-making and innovation. This paper presents an enhanced Retrieval-Augmented Generation (RAG)…

Information Retrieval · Computer Science 2025-05-15 Ahmet Yasin Aytar , Kemal Kilic , Kamer Kaya

Retrieval-Augmented Generation (RAG) augments Large Language Models (LLMs) with external knowledge to improve factuality. However, existing RAG systems frequently underutilize the retrieved documents, failing to extract and integrate the…

Computation and Language · Computer Science 2025-10-31 Hao Chen , Yukun Yan , Sen Mei , Wanxiang Che , Zhenghao Liu , Qi Shi , Xinze Li , Yuchun Fan , Pengcheng Huang , Qiushi Xiong , Zhiyuan Liu , Maosong Sun

Retrieval-Augmented Generation (RAG) enhances language models by retrieving and incorporating relevant external knowledge. However, traditional retrieve-and-generate processes may not be optimized for real-world scenarios, where queries…

Computation and Language · Computer Science 2025-02-28 Ingeol Baek , Hwan Chang , Byeongjeong Kim , Jimin Lee , Hwanhee Lee

Retrieval-Augmented Generation (RAG) offers a cost-effective approach to injecting real-time knowledge into large language models (LLMs). Nevertheless, constructing and validating high-quality knowledge repositories require considerable…

Computation and Language · Computer Science 2024-05-28 Xun Liang , Simin Niu , Zhiyu li , Sensen Zhang , Shichao Song , Hanyu Wang , Jiawei Yang , Feiyu Xiong , Bo Tang , Chenyang Xi

Retrieval-Augmented Generation (RAG) enhances Large Language Models (LLMs) by retrieving relevant memories from an external database. However, existing RAG methods typically organize all memories in a whole database, potentially limiting…

Computation and Language · Computer Science 2024-05-28 Zheng Wang , Shu Xian Teo , Jieer Ouyang , Yongjun Xu , Wei Shi

Retrieval-Augmented Generation (RAG) systems enhance the performance of large language models (LLMs) by incorporating supplementary retrieved documents, enabling more accurate and context-aware responses. However, integrating these external…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-25 Wenfeng Wang , Xiaofeng Hou , Peng Tang , Hengyi Zhou , Jing Wang , Xinkai Wang , Chao Li , Minyi Guo

Large Language Models (LLMs) have been increasingly adopted for health-related tasks, yet their performance in depression detection remains limited when relying solely on text input. While Retrieval-Augmented Generation (RAG) typically…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-26 Xiangyu Zhang , Hexin Liu , Qiquan Zhang , Beena Ahmed , Julien Epps

Reinforcement learning (RL) has become a promising paradigm for optimizing Retrieval-Augmented Generation (RAG) in complex reasoning tasks. However, traditional outcome-based RL approaches often suffer from reward sparsity and inefficient…

Artificial Intelligence · Computer Science 2026-01-30 Zhao Wang , Ziliang Zhao , Zhicheng Dou

Climate decision making is constrained by the complexity and inaccessibility of key information within lengthy, technical, and multi-lingual documents. Generative AI technologies offer a promising route for improving the accessibility of…

Computation and Language · Computer Science 2024-11-01 Matyas Juhasz , Kalyan Dutia , Henry Franks , Conor Delahunty , Patrick Fawbert Mills , Harrison Pim

Retrieval-Augmented Generation (RAG) systems offer a powerful approach to enhancing large language model (LLM) outputs by incorporating fact-checked, contextually relevant information. However, fairness and reliability concerns persist, as…

Human-Computer Interaction · Computer Science 2025-04-24 Xuyang Zhu , Sejoon Chang , Andrew Kuik

Effectively retrieving, reasoning, and understanding multimodal information remains a critical challenge for agentic systems. Traditional Retrieval-augmented Generation (RAG) methods rely on linear interaction histories, which struggle to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Qiuchen Wang , Shihang Wang , Yu Zeng , Qiang Zhang , Fanrui Zhang , Zhuoning Guo , Bosi Zhang , Wenxuan Huang , Lin Chen , Zehui Chen , Pengjun Xie , Ruixue Ding

Retrieval-Augmented Generation (RAG), by integrating non-parametric knowledge from external knowledge bases into models, has emerged as a promising approach to enhancing response accuracy while mitigating factual errors and hallucinations.…

Information Retrieval · Computer Science 2025-09-12 Qitao Qin , Yucong Luo , Yihang Lu , Zhibo Chu , Xiaoman Liu , Xianwei Meng

Retrieval-augmented generation (RAG) has emerged as a leading approach to reducing hallucinations in large language models (LLMs). Current RAG evaluation benchmarks primarily focus on what we call local RAG: retrieving relevant chunks from…

Computation and Language · Computer Science 2025-11-05 Qi Luo , Xiaonan Li , Tingshuo Fan , Xinchi Chen , Xipeng Qiu

Retrieval-augmented generation (RAG) systems have been shown to be effective in addressing many of the drawbacks of relying solely on the parametric memory of large language models. Recent work has demonstrated that RAG systems can be…