English
Related papers

Related papers: GEM-RAG: Graphical Eigen Memories For Retrieval Au…

200 papers

Large Language Models (LLMs) are becoming essential tools for various natural language processing tasks but often suffer from generating outdated or incorrect information. Retrieval-Augmented Generation (RAG) addresses this issue by…

Despite the significant progress of large language models (LLMs) in various tasks, they often produce factual errors due to their limited internal knowledge. Retrieval-Augmented Generation (RAG), which enhances LLMs with external knowledge…

Computation and Language · Computer Science 2024-10-10 Yuanjie Lyu , Zihan Niu , Zheyong Xie , Chao Zhang , Tong Xu , Yang Wang , Enhong Chen

Processing long contexts presents a significant challenge for large language models (LLMs). While recent advancements allow LLMs to handle much longer contexts than before (e.g., 32K or 128K tokens), it is computationally expensive and can…

Computation and Language · Computer Science 2025-04-10 Hongjin Qian , Zheng Liu , Peitian Zhang , Kelong Mao , Defu Lian , Zhicheng Dou , Tiejun Huang

In recent years, large language models (LLMs) have made remarkable achievements in various domains. However, the untimeliness and cost of knowledge updates coupled with hallucination issues of LLMs have curtailed their applications in…

Machine Learning · Computer Science 2024-05-31 Chunjing Gan , Dan Yang , Binbin Hu , Hanxiao Zhang , Siyuan Li , Ziqi Liu , Yue Shen , Lin Ju , Zhiqiang Zhang , Jinjie Gu , Lei Liang , Jun Zhou

Real-world live retrieval-augmented generation (RAG) systems face significant challenges when processing user queries that are often noisy, ambiguous, and contain multiple intents. While RAG enhances large language models (LLMs) with…

Computation and Language · Computer Science 2025-06-27 Guanting Dong , Xiaoxi Li , Yuyao Zhang , Mengjie Deng

Given a graph with textual attributes, we enable users to `chat with their graph': that is, to ask questions about the graph using a conversational interface. In response to a user's questions, our method provides textual replies and…

Machine Learning · Computer Science 2024-05-28 Xiaoxin He , Yijun Tian , Yifei Sun , Nitesh V. Chawla , Thomas Laurent , Yann LeCun , Xavier Bresson , Bryan Hooi

This paper presents a comprehensive study of Retrieval-Augmented Generation (RAG), tracing its evolution from foundational concepts to the current state of the art. RAG combines retrieval mechanisms with generative language models to…

Computation and Language · Computer Science 2024-10-18 Shailja Gupta , Rajesh Ranjan , Surya Narayan Singh

Medical question answering (QA) requires extensive access to domain-specific knowledge. A promising direction is to enhance large language models (LLMs) with external knowledge retrieved from medical corpora or parametric knowledge stored…

Computation and Language · Computer Science 2025-10-22 Lei Li , Xiao Zhou , Yingying Zhang , Xian Wu

This paper presents OG-RAG, an Ontology-Grounded Retrieval Augmented Generation method designed to enhance LLM-generated responses by anchoring retrieval processes in domain-specific ontologies. While LLMs are widely used for tasks like…

Computation and Language · Computer Science 2024-12-23 Kartik Sharma , Peeyush Kumar , Yunqing Li

Retrieval-Augmented Generation (RAG) has gained significant popularity in modern Large Language Models (LLMs) due to its effectiveness in introducing new knowledge and reducing hallucinations. However, the deep understanding of RAG remains…

Computation and Language · Computer Science 2024-10-07 Jingyu Liu , Jiaen Lin , Yong Liu

Retrieval-augmented generation (RAG) systems have been widely adopted in contemporary large language models (LLMs) due to their ability to improve generation quality while reducing the required input context length. In this work, we focus…

Computation and Language · Computer Science 2026-04-07 Tianyi Zhang , Andreas Marfurt

The rapid development of next-generation networking technologies underscores their transformative role in revolutionizing modern communication systems, enabling faster, more reliable, and highly interconnected solutions. However, such…

Networking and Internet Architecture · Computer Science 2024-12-11 Yang Xiong , Ruichen Zhang , Yinqiu Liu , Dusit Niyato , Zehui Xiong , Ying-Chang Liang , Shiwen Mao

Retrieval-Augmented Generation (RAG) enhances Large Language Model (LLM) output by providing prior knowledge as context to input. This is beneficial for knowledge-intensive and expert reliant tasks, including legal question-answering, which…

Retrieval-Augmented Generation (RAG) improves large language models (LLMs) by retrieving relevant information from external sources and has been widely adopted for text-based tasks. For structured data, such as knowledge graphs, Graph…

Information Retrieval · Computer Science 2026-03-05 Haoyu Han , Li Ma , Yu Wang , Harry Shomer , Yongjia Lei , Zhisheng Qi , Kai Guo , Zhigang Hua , Bo Long , Hui Liu , Charu C. Aggarwal , Jiliang Tang

Memory, additional information beyond the training of large language models (LLMs), is crucial to various real-world applications, such as personal assistant. The two mainstream solutions to incorporate memory into the generation process…

Computation and Language · Computer Science 2025-03-21 Jiale Wei , Shuchi Wu , Ruochen Liu , Xiang Ying , Jingbo Shang , Fangbo Tao

Security applications are increasingly relying on large language models (LLMs) for cyber threat detection; however, their opaque reasoning often limits trust, particularly in decisions that require domain-specific cybersecurity knowledge.…

Cryptography and Security · Computer Science 2025-11-03 Arnabh Borah , Md Tanvirul Alam , Nidhi Rastogi

Retrieval-augmented generation (RAG) has shown promising potential in knowledge intensive question answering (QA). However, existing approaches only consider the query itself, neither specifying the retrieval preferences for the retrievers…

Information Retrieval · Computer Science 2025-02-18 Zhongwu Chen , Chengjin Xu , Dingmin Wang , Zhen Huang , Yong Dou , Xuhui Jiang , Jian Guo

Retrieval-augmented generation (RAG) has emerged as a pivotal method for expanding the knowledge of large language models. To handle complex queries more effectively, researchers developed Adaptive-RAG (A-RAG) to enhance the generated…

Artificial Intelligence · Computer Science 2025-05-27 Jie Ou , Jinyu Guo , Shuaihong Jiang , Zhaokun Wang , Libo Qin , Shunyu Yao , Wenhong Tian

Large language models like ChatGPT are increasingly used in classrooms, but they often provide outdated or fabricated information that can mislead students. Retrieval Augmented Generation (RAG) improves reliability of LLMs by grounding…

Artificial Intelligence · Computer Science 2025-09-10 Amay Jain , Liu Cui , Si Chen

While Retrieval-Augmented Generation (RAG) augments Large Language Models (LLMs) with external knowledge, conventional single-agent RAG remains fundamentally limited in resolving complex queries demanding coordinated reasoning across…

Computation and Language · Computer Science 2025-04-18 Pei Liu , Xin Liu , Ruoyu Yao , Junming Liu , Siyuan Meng , Ding Wang , Jun Ma