English
Related papers

Related papers: Loops On Retrieval Augmented Generation (LoRAG)

200 papers

Existing retrieval-augmented code generation (RACG) methods typically use an external retrieval module to fetch semantically similar code snippets used for generating subsequent fragments. However, even for consecutive code fragments, the…

Information Retrieval · Computer Science 2025-10-10 Qian Dong , Jia Chen , Qingyao Ai , Hongning Wang , Haitao Li , Yi Wu , Yao Hu , Yiqun Liu , Shaoping Ma

A common way to extend the memory of large language models (LLMs) is by retrieval augmented generation (RAG), which inserts text retrieved from a larger memory into an LLM's context window. However, the context window is typically limited…

Computation and Language · Computer Science 2025-02-14 Marc Pickett , Jeremy Hartman , Ayan Kumar Bhowmick , Raquib-ul Alam , Aditya Vempaty

Retrieval-Augmented Generation (RAG) has demonstrated significant effectiveness in enhancing large language models (LLMs) for complex multi-hop question answering (QA). For multi-hop QA tasks, current iterative approaches predominantly rely…

Computation and Language · Computer Science 2026-01-19 Yuling Shi , Maolin Sun , Zijun Liu , Mo Yang , Yixiong Fang , Tianran Sun , Xiaodong Gu

Retrieval-Augmented Generation (RAG) compensates for the static knowledge limitations of Large Language Models (LLMs) by integrating external knowledge, producing responses with enhanced factual correctness and query-specific…

Computation and Language · Computer Science 2025-05-21 Ruobing Yao , Yifei Zhang , Shuang Song , Neng Gao , Chenyang Tu

Recent advancements in integrating speech information into large language models (LLMs) have significantly improved automatic speech recognition (ASR) accuracy. However, existing methods often constrained by the capabilities of the speech…

Sound · Computer Science 2024-09-16 Shaojun Li , Hengchao Shang , Daimeng Wei , Jiaxin Guo , Zongyao Li , Xianghui He , Min Zhang , Hao Yang

Retrieval-Augmented Generation (RAG) has recently demonstrated the performance of Large Language Models (LLMs) in the knowledge-intensive tasks such as Question-Answering (QA). RAG expands the query context by incorporating external…

Machine Learning · Computer Science 2024-06-18 Zijian Hei , Weiling Liu , Wenjie Ou , Juyi Qiao , Junming Jiao , Guowen Song , Ting Tian , Yi Lin

As an effective method to boost the performance of Large Language Models (LLMs) on the question answering (QA) task, Retrieval-Augmented Generation (RAG), which queries highly relevant information from external complex documents, has…

Information Retrieval · Computer Science 2025-12-04 Shu Wang , Yingli Zhou , Yixiang Fang

The effectiveness of Large Language Models (LLMs) in generating accurate responses relies heavily on the quality of input provided, particularly when employing Retrieval Augmented Generation (RAG) techniques. RAG enhances LLMs by sourcing…

Information Retrieval · Computer Science 2024-08-02 Spurthi Setty , Harsh Thakkar , Alyssa Lee , Eden Chung , Natan Vidra

The emergence of Large Language Models (LLMs) has significantly advanced natural language processing, but these models often generate factually incorrect information, known as "hallucination". Initial retrieval-augmented generation (RAG)…

Computation and Language · Computer Science 2024-11-12 Yujia Zhou , Zheng Liu , Zhicheng Dou

The existing Retrieval-Augmented Generation (RAG) systems face significant challenges in terms of cost and effectiveness. On one hand, they need to encode the lengthy retrieved contexts before responding to the input tasks, which imposes…

Computation and Language · Computer Science 2024-09-25 Zheng Liu , Chenyuan Wu , Ninglu Shao , Shitao Xiao , Chaozhuo Li , Defu Lian

Retrieval-Augmented Generation (RAG) is a crucial method for mitigating hallucinations in Large Language Models (LLMs) and integrating external knowledge into their responses. Existing RAG methods typically employ query rewriting to clarify…

Computation and Language · Computer Science 2025-02-26 Zhuocheng Zhang , Yang Feng , Min Zhang

Retrieval-Augmented Generation (RAG) based on Large Language Models (LLMs) is a powerful solution to understand and query the industry's closed-source documents. However, basic RAG often struggles with complex QA tasks in legal and…

Information Retrieval · Computer Science 2025-09-08 Huifeng Lin , Gang Su , Jintao Liang , You Wu , Rui Zhao , Ziyue Li

In the contemporary context of rapid advancements in information technology and the exponential growth of data volume, language models are confronted with significant challenges in effectively navigating the dynamic and ever-evolving…

Information Retrieval · Computer Science 2025-01-14 Yuxin Fan , Yuxiang Wang , Lipeng Liu , Xirui Tang , Na Sun , Zidong Yu

Retrieval Augmented Generation (RAG) is a technique used to augment Large Language Models (LLMs) with contextually relevant, time-critical, or domain-specific information without altering the underlying model parameters. However,…

Information Retrieval · Computer Science 2024-08-20 Laurent Mombaerts , Terry Ding , Adi Banerjee , Florian Felice , Jonathan Taws , Tarik Borogovac

Retrieval-augmented generation (RAG) enhances large language models (LLMs) by incorporating external knowledge. Current hybrid RAG system retrieves evidence from both knowledge graphs (KGs) and text documents to support LLM reasoning.…

Computation and Language · Computer Science 2025-09-22 Xingyu Tan , Xiaoyang Wang , Qing Liu , Xiwei Xu , Xin Yuan , Liming Zhu , Wenjie Zhang

Retrieval-augmented generation (RAG) is a popular technique for using large language models (LLMs) to build customer-support, question-answering solutions. In this paper, we share our team's practical experience building and maintaining…

Information Retrieval · Computer Science 2024-10-18 Sarah Packowski , Inge Halilovic , Jenifer Schlotfeldt , Trish Smith

Retrieval-Augmented Generation (RAG) integrates external knowledge with Large Language Models (LLMs) to enhance factual correctness and mitigate hallucination. However, dense retrievers often become the bottleneck of RAG systems due to…

Computation and Language · Computer Science 2025-10-27 Yuan Li , Qi Luo , Xiaonan Li , Bufan Li , Qinyuan Cheng , Bo Wang , Yining Zheng , Yuxin Wang , Zhangyue Yin , Xipeng Qiu

Large language models augmented with task-relevant documents have demonstrated impressive performance on knowledge-intensive tasks. However, regarding how to obtain effective documents, the existing methods are mainly divided into two…

Computation and Language · Computer Science 2023-10-10 Zhangyin Feng , Xiaocheng Feng , Dezhi Zhao , Maojin Yang , Bing Qin

Deploying Large Language Model (LLM) applications, particularly those relying on Retrieval-Augmented Generation (RAG), remains challenging due to high computational demands, outdated knowledge bases, and the need to manually select optimal…

In this chapter, we consider generative information retrieval evaluation from two distinct but interrelated perspectives. First, large language models (LLMs) themselves are rapidly becoming tools for evaluation, with current research…

Information Retrieval · Computer Science 2025-01-31 Marwah Alaofi , Negar Arabzadeh , Charles L. A. Clarke , Mark Sanderson