English
Related papers

Related papers: Tagging-Augmented Generation: Assisting Language M…

200 papers

Retrieval-augmented generation (RAG) methods can enhance the performance of LLMs by incorporating retrieved knowledge chunks into the generation process. In general, the retrieval and generation steps usually have different requirements for…

Information Retrieval · Computer Science 2025-04-16 Peiru Yang , Xintian Li , Zhiyang Hu , Jiapeng Wang , Jinhua Yin , Huili Wang , Lizhi He , Shuai Yang , Shangguang Wang , Yongfeng Huang , Tao Qi

Retrieval-Augmented Generation (RAG) enhances large language models (LLMs) by integrating external knowledge, where the LLM's ability to generate responses based on the combination of a given query and retrieved documents is crucial.…

Computation and Language · Computer Science 2025-08-01 Zhehao Tan , Yihan Jiao , Dan Yang , Lei Liu , Jie Feng , Duolin Sun , Yue Shen , Jian Wang , Peng Wei , Jinjie Gu

Retrieval-augmented generation (RAG) is a promising approach to address the limitations of fixed knowledge in large language models (LLMs). However, current benchmarks for evaluating RAG systems suffer from two key deficiencies: (1) they…

Computation and Language · Computer Science 2025-01-28 Zehan Qi , Rongwu Xu , Zhijiang Guo , Cunxiang Wang , Hao Zhang , Wei Xu

Large Language Models (LLMs) are becoming essential tools for various natural language processing tasks but often suffer from generating outdated or incorrect information. Retrieval-Augmented Generation (RAG) addresses this issue by…

Retrieval-Augmented Generation (RAG) offers a promising solution to address various limitations of Large Language Models (LLMs), such as hallucination and difficulties in keeping up with real-time updates. This approach is particularly…

Computation and Language · Computer Science 2024-06-18 Shuting Wang , Jiongnan Liu , Shiren Song , Jiehan Cheng , Yuqi Fu , Peidong Guo , Kun Fang , Yutao Zhu , Zhicheng Dou

Retrieval-Augmented Generation (RAG) systems using large language models (LLMs) often generate inaccurate responses due to the retrieval of irrelevant or loosely related information. Existing methods, which operate at the document level,…

Computation and Language · Computer Science 2025-04-24 Ishneet Sukhvinder Singh , Ritvik Aggarwal , Ibrahim Allahverdiyev , Muhammad Taha , Aslihan Akalin , Kevin Zhu , Sean O'Brien

Retrieval-augmented generation (RAG) is a popular technique for using large language models (LLMs) to build customer-support, question-answering solutions. In this paper, we share our team's practical experience building and maintaining…

Information Retrieval · Computer Science 2024-10-18 Sarah Packowski , Inge Halilovic , Jenifer Schlotfeldt , Trish Smith

The emergence of long-context large language models (LLMs) offers a promising alternative to traditional retrieval-augmented generation (RAG) for processing extensive documents. However, the computational overhead of long-context inference…

Computation and Language · Computer Science 2025-06-24 Guanzheng Chen , Qilong Feng , Jinjie Ni , Xin Li , Michael Qizhe Shieh

Large language models (LLMs) have made significant progress in general-purpose natural language processing tasks. However, LLMs are still facing challenges when applied to domain-specific areas like telecommunications, which demands…

Computation and Language · Computer Science 2025-05-22 Dun Yuan , Hao Zhou , Di Wu , Xue Liu , Hao Chen , Yan Xin , Jianzhong , Zhang

Retrieval-Augmented Generation (RAG) allows overcoming the limited knowledge of LLMs by extending the input with external information. As a consequence, the contextual inputs to the model become much longer which slows down decoding time…

Computation and Language · Computer Science 2024-10-30 David Rau , Shuai Wang , Hervé Déjean , Stéphane Clinchant

Large language models (LLMs) augmented with retrieval exhibit robust performance and extensive versatility by incorporating external contexts. However, the input length grows linearly in the number of retrieved documents, causing a dramatic…

Computation and Language · Computer Science 2024-05-28 Yun Zhu , Jia-Chen Gu , Caitlin Sikora , Ho Ko , Yinxiao Liu , Chu-Cheng Lin , Lei Shu , Liangchen Luo , Lei Meng , Bang Liu , Jindong Chen

Retrieval-Augmented Generation (RAG) has emerged as a crucial framework in natural language processing (NLP), improving factual consistency and reducing hallucinations by integrating external document retrieval with large language models…

Computation and Language · Computer Science 2026-04-29 Youngjoon Jang , Seongtae Hong , Junyoung Son , Sungjin Park , Chanjun Park , Heuiseok Lim

Retrieval-Augmented Generation (RAG) has gained significant attention in recent years for its potential to enhance natural language understanding and generation by combining large-scale retrieval systems with generative models. RAG…

Computation and Language · Computer Science 2025-03-18 Mingyue Cheng , Yucong Luo , Jie Ouyang , Qi Liu , Huijie Liu , Li Li , Shuo Yu , Bohou Zhang , Jiawei Cao , Jie Ma , Daoyu Wang , Enhong Chen

Retrieval Augmented Generation (RAG) is a widely used approach for leveraging external context in several natural language applications such as question answering and information retrieval. Yet, the exact nature in which a Language Model…

Retrieval-Augmented Generation (RAG) integrates non-parametric knowledge into Large Language Models (LLMs), typically from unstructured texts and structured graphs. While recent progress has advanced text-based RAG to multi-turn reasoning…

Computation and Language · Computer Science 2025-12-11 Yucan Guo , Miao Su , Saiping Guan , Zihao Sun , Xiaolong Jin , Jiafeng Guo , Xueqi Cheng

Retrieval-Augmented Generation (RAG) augments Large Language Models (LLMs) with external knowledge to improve factuality. However, existing RAG systems frequently underutilize the retrieved documents, failing to extract and integrate the…

Computation and Language · Computer Science 2025-10-31 Hao Chen , Yukun Yan , Sen Mei , Wanxiang Che , Zhenghao Liu , Qi Shi , Xinze Li , Yuchun Fan , Pengcheng Huang , Qiushi Xiong , Zhiyuan Liu , Maosong Sun

AI systems that serve natural language questions over databases promise to unlock tremendous value. Such systems would allow users to leverage the powerful reasoning and knowledge capabilities of language models (LMs) alongside the scalable…

Large language models (LLMs) frequently generate confident yet factually incorrect content when used for language generation (a phenomenon often known as hallucination). Retrieval augmented generation (RAG) tries to reduce factual errors by…

Information Retrieval · Computer Science 2026-04-01 Dobrik Georgiev , Kheeran Naidu , Alberto Cattaneo , Federico Monti , Carlo Luschi , Daniel Justus

Recent advancements in Large language models (LLMs) have demonstrated remarkable capabilities across diverse domains. While they exhibit strong zero-shot performance on various tasks, LLMs' effectiveness in music-related applications…

Computation and Language · Computer Science 2025-12-09 Daeyong Kwon , SeungHeon Doh , Juhan Nam

Modern Large Language Model (LLM) systems typically rely on Retrieval Augmented Generation (RAG) which aims to gather context that is useful for response generation. These RAG systems typically optimize strictly towards retrieving context…

Information Retrieval · Computer Science 2025-04-11 Will LeVine , Bijan Varjavand