English
Related papers

Related papers: Robust Implementation of Retrieval-Augmented Gener…

200 papers

Retrieval augmented generation (RAG) combines the generative abilities of large language models (LLMs) with external knowledge sources to provide more accurate and up-to-date responses. Recent RAG advancements focus on improving retrieval…

Retrieval-Augmented Generation (RAG) is often used with Large Language Models (LLMs) to infuse domain knowledge or user-specific information. In RAG, given a user query, a retriever extracts chunks of relevant text from a knowledge base.…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-25 Shubham Agarwal , Sai Sundaresan , Subrata Mitra , Debabrata Mahapatra , Archit Gupta , Rounak Sharma , Nirmal Joshua Kapu , Tong Yu , Shiv Saini

Retrieval-Augmented Generation (RAG) encounters efficiency challenges when scaling to massive knowledge bases while preserving contextual relevance. We propose Hash-RAG, a framework that integrates deep hashing techniques with systematic…

Information Retrieval · Computer Science 2025-06-04 Jinyu Guo , Xunlei Chen , Qiyang Xia , Zhaokun Wang , Jie Ou , Libo Qin , Shunyu Yao , Wenhong Tian

Large Language Models (LLMs) have been integrated into recommendation systems to enhance user behavior comprehension. The Retrieval Augmented Generation (RAG) technique is further incorporated into these systems to retrieve more relevant…

Information Retrieval · Computer Science 2025-02-12 Jian Xu , Sichun Luo , Xiangyu Chen , Haoming Huang , Hanxu Hou , Linqi Song

The scaling of inference computation has unlocked the potential of long-context large language models (LLMs) across diverse settings. For knowledge-intensive tasks, the increased compute is often allocated to incorporate more external…

Computation and Language · Computer Science 2025-03-04 Zhenrui Yue , Honglei Zhuang , Aijun Bai , Kai Hui , Rolf Jagerman , Hansi Zeng , Zhen Qin , Dong Wang , Xuanhui Wang , Michael Bendersky

Retrieval-augmented generation (RAG) enhances the question-answering (QA) abilities of large language models (LLMs) by integrating external knowledge. However, adapting general-purpose RAG systems to specialized fields such as science and…

Computation and Language · Computer Science 2025-01-28 Ran Xu , Hui Liu , Sreyashi Nag , Zhenwei Dai , Yaochen Xie , Xianfeng Tang , Chen Luo , Yang Li , Joyce C. Ho , Carl Yang , Qi He

Large Language Models (LLMs) hold significant promise for mathematics education, yet they often struggle with complex mathematical reasoning. While Retrieval-Augmented Generation (RAG) mitigates these issues by grounding LLMs in external…

Computation and Language · Computer Science 2025-12-02 Shiting Chen , Zijian Zhao , Jinsong Chen

Large Language Models (LLMs), despite their remarkable capabilities, are prone to generating hallucinated or outdated content due to their static internal knowledge. While Retrieval-Augmented Generation (RAG) integrated with Reinforcement…

Computation and Language · Computer Science 2026-01-14 Zhiwen Tan , Jiaming Huang , Qintong Wu , Hongxuan Zhang , Chenyi Zhuang , Jinjie Gu

Large language models (LLMs) with retrieval augmented-generation (RAG) have been the optimal choice for scalable generative AI solutions in the recent past. Although RAG implemented with AI agents (agentic-RAG) has been recently…

Artificial Intelligence · Computer Science 2024-11-19 Sohini Roychowdhury , Marko Krema , Anvar Mahammad , Brian Moore , Arijit Mukherjee , Punit Prakashchandra

Retrieval-Augmented Generation (RAG) aims to augment the capabilities of Large Language Models (LLMs) by retrieving and incorporate external documents or chunks prior to generation. However, even improved retriever relevance can brings…

Computation and Language · Computer Science 2025-04-29 Sha Li , Naren Ramakrishnan

While retrieval augmented generation (RAG) has been swiftly adopted in industrial applications based on large language models (LLMs), there is no consensus on what are the best practices for building a RAG system in terms of what are the…

Computation and Language · Computer Science 2026-02-13 Liz Li , Wei Zhu

Purpose: Large Language Models (LLMs) hold significant promise for medical applications. Retrieval Augmented Generation (RAG) emerges as a promising approach for customizing domain knowledge in LLMs. This case study presents the development…

Retrieval-Augmented Generation (RAG) mitigates key limitations of Large Language Models (LLMs)-such as factual errors, outdated knowledge, and hallucinations-by dynamically retrieving external information. Recent work extends this paradigm…

Computation and Language · Computer Science 2026-05-22 Jingru Lin , Chen Zhang , Stephen Y. Liu , Haizhou Li

Retrieval-augmented generation (RAG) has emerged as a paradigm for grounding large language models in external knowledge, yet most existing RAG systems assume centralized knowledge access and ample computation. These assumptions break down…

Information Retrieval · Computer Science 2026-05-28 Tianhao Gao , Kai Yang , Yiyang Li

Retrieval-Augmented Generation (RAG) has established itself as the standard paradigm for grounding Large Language Models (LLMs) in domain-specific, up-to-date data. However, the prevailing architecture for RAG has evolved into a complex,…

Information Retrieval · Computer Science 2026-02-27 Ahmed Bin Khalid

Processing long contexts presents a significant challenge for large language models (LLMs). While recent advancements allow LLMs to handle much longer contexts than before (e.g., 32K or 128K tokens), it is computationally expensive and can…

Computation and Language · Computer Science 2025-04-10 Hongjin Qian , Zheng Liu , Peitian Zhang , Kelong Mao , Defu Lian , Zhicheng Dou , Tiejun Huang

Retrieval Augmented Generation (RAG) represents a significant advancement in artificial intelligence combining a retrieval phase with a generative phase, with the latter typically being powered by large language models (LLMs). The current…

Computation and Language · Computer Science 2024-06-24 Florin Cuconasu , Giovanni Trappolini , Nicola Tonellotto , Fabrizio Silvestri

Retrieval-augmented generation (RAG) is a promising way to improve large language models (LLMs) for generating more factual, accurate, and up-to-date content. Existing methods either optimize prompts to guide LLMs in leveraging retrieved…

Computation and Language · Computer Science 2024-12-12 Yutao Zhu , Zhaoheng Huang , Zhicheng Dou , Ji-Rong Wen

Large Language Models (LLMs) have shown remarkable performance on general Question Answering (QA), yet they often struggle in domain-specific scenarios where accurate and up-to-date information is required. Retrieval-Augmented Generation…

Computation and Language · Computer Science 2026-02-13 Haoyue Bai , Haoyu Wang , Shengyu Chen , Zhengzhang Chen , Lu-An Tang , Wei Cheng , Haifeng Chen , Yanjie Fu

Large language models (LLMs) achieve remarkable performance across domains but remain prone to hallucinations and inconsistencies. Retrieval-augmented generation (RAG) mitigates these issues by augmenting model inputs with relevant…

Machine Learning · Computer Science 2026-04-10 Akash Dhasade , Rachid Guerraoui , Anne-Marie Kermarrec , Diana Petrescu , Rafael Pires , Mathis Randl , Martijn de Vos