中文
相关论文

相关论文: Accelerating Retrieval-Augmented Generation

200 篇论文

Retrieval-Augmented Generation (RAG) systems combine vector similarity search with large language models (LLMs) to deliver accurate, context-aware responses. However, co-locating the vector retriever and the LLM on shared GPU infrastructure…

机器学习 · 计算机科学 2026-01-21 Junkyum Kim , Divya Mahajan

Retrieval-Augmented Generation (RAG) has emerged as a prominent method for incorporating domain knowledge into Large Language Models (LLMs). While RAG enhances response relevance by incorporating retrieved domain knowledge in the context,…

计算与语言 · 计算机科学 2025-03-28 Kushagra Bhushan , Yatin Nandwani , Dinesh Khandelwal , Sonam Gupta , Gaurav Pandey , Dinesh Raghu , Sachindra Joshi

Retrieval-augmented generation (RAG) is a popular technique for using large language models (LLMs) to build customer-support, question-answering solutions. In this paper, we share our team's practical experience building and maintaining…

信息检索 · 计算机科学 2024-10-18 Sarah Packowski , Inge Halilovic , Jenifer Schlotfeldt , Trish Smith

Retrieval-Augmented Generation (RAG) grounds large language models with external evidence, but many implementations rely on pre-built indices that remain static after construction. Related queries therefore repeat similar multi-hop…

人工智能 · 计算机科学 2026-03-03 Yifan Wang , Mingxuan Jiang , Zhihao Sun , Yixin Cao , Yicun Liu , Keyang Chen , Guangnan Ye , Hongfeng Chai

Integrating Large Language Models (LLMs) in Intelligent Tutoring Systems (ITS) presents transformative opportunities for personalized education. However, current implementations face two critical challenges: maintaining factual accuracy and…

计算与语言 · 计算机科学 2025-02-13 Chenxi Dong , Yimin Yuan , Kan Chen , Shupei Cheng , Chujie Wen

Retrieval-Augmented Generation (RAG) effectively enhances Large Language Models (LLMs) by incorporating retrieved external knowledge into the generation process. Reasoning models improve LLM performance in multi-hop QA tasks, which require…

计算与语言 · 计算机科学 2026-01-21 Guo Chen , Junjie Huang , Huaijin Xie , Fei Sun , Tao Jia

Large language models (LLM) hold significant potential for applications in biomedicine, but they struggle with hallucinations and outdated knowledge. While retrieval-augmented generation (RAG) is generally employed to address these issues,…

计算与语言 · 计算机科学 2025-09-23 Jiwoong Sohn , Yein Park , Chanwoong Yoon , Sihyeon Park , Hyeon Hwang , Mujeen Sung , Hyunjae Kim , Jaewoo Kang

Retrieval-Augmented Generation (RAG) was introduced to enhance the capabilities of Large Language Models (LLMs) beyond their encoded prior knowledge. This is achieved by providing LLMs with an external source of knowledge, which helps…

计算与语言 · 计算机科学 2026-03-11 Hazem Amamou , Stéphane Gagnon , Alan Davoust , Anderson R. Avila

Large language models (LLMs) have gained significant attention in various fields but prone to hallucination, especially in knowledge-intensive (KI) tasks. To address this, retrieval-augmented generation (RAG) has emerged as a popular…

计算与语言 · 计算机科学 2024-04-23 Xiaoxi Li , Zhicheng Dou , Yujia Zhou , Fangchao Liu

Despite their remarkable capabilities, large language models (LLMs) often produce responses containing factual inaccuracies due to their sole reliance on the parametric knowledge they encapsulate. Retrieval-Augmented Generation (RAG), an ad…

计算与语言 · 计算机科学 2023-10-19 Akari Asai , Zeqiu Wu , Yizhong Wang , Avirup Sil , Hannaneh Hajishirzi

Retrieval-Augmented Generation (RAG) has emerged as a powerful solution to mitigate the limitations of Large Language Models (LLMs), such as hallucinations and outdated knowledge. However, deploying RAG-based tools in Small and Medium…

计算与语言 · 计算机科学 2025-08-29 Mathieu Bourdin , Anas Neumann , Thomas Paviot , Robert Pellerin , Samir Lamouri

Large Language Models (LLM) hold immense promise for real-world applications, but their generic knowledge often falls short of domain-specific needs. Fine-tuning, a common approach, can suffer from catastrophic forgetting and hinder…

信息检索 · 计算机科学 2024-08-19 Emile Contal , Garrin McGoldrick

We designed a Retrieval-Augmented Generation (RAG) system to provide large language models with relevant documents for answering domain-specific questions about Pittsburgh and Carnegie Mellon University (CMU). We extracted over 1,800…

机器学习 · 计算机科学 2024-11-22 Haojia Sun , Yaqi Wang , Shuting Zhang

Retrieval-augmented generation (RAG) integrates large language models ( LLM s) with retrievers to access external knowledge, improving the factuality of LLM generation in knowledge-grounded tasks. To optimize the RAG performance, most…

Retrieval-augmented generation (RAG) enhances large language models (LLMs) by incorporating external knowledge to generate a response within a context with improved accuracy and reduced hallucinations. However, multi-modal RAG systems face…

机器学习 · 计算机科学 2025-01-09 Matin Mortaheb , Mohammad A. Amir Khojastepour , Srimat T. Chakradhar , Sennur Ulukus

The rapid increase in the number of parameters in large language models (LLMs) has significantly increased the cost involved in fine-tuning and retraining LLMs, a necessity for keeping models up to date and improving accuracy.…

硬件体系结构 · 计算机科学 2024-12-17 Michael Shen , Muhammad Umar , Kiwan Maeng , G. Edward Suh , Udit Gupta

Integrating multiple (sub-)systems is essential to create advanced Information Systems (ISs). Difficulties mainly arise when integrating dynamic environments across the IS lifecycle. A traditional approach is a registry that provides the…

软件工程 · 计算机科学 2025-07-29 Robin D. Pesl , Jerin G. Mathew , Massimo Mecella , Marco Aiello

Retrieval-Augmented Generation (RAG) systems face significant performance gaps when applied to technical domains requiring precise information extraction from complex documents. Current evaluation methodologies relying on document-level…

机器学习 · 计算机科学 2025-02-25 Aryan Jadon , Avinash Patil , Shashank Kumar

Large Language Models (LLMs) and Code-LLMs (CLLMs) have significantly improved code generation, but, they frequently face difficulties when dealing with challenging and complex problems. Retrieval-Augmented Generation (RAG) addresses this…

软件工程 · 计算机科学 2025-06-17 Iman Saberi , Fatemeh Fard

Recommender systems have become increasingly vital in our daily lives, helping to alleviate the problem of information overload across various user-oriented online services. The emergence of Large Language Models (LLMs) has yielded…

信息检索 · 计算机科学 2025-05-29 Shijie Wang , Wenqi Fan , Yue Feng , Shanru Lin , Xinyu Ma , Shuaiqiang Wang , Dawei Yin