English
Related papers

Related papers: TreeHop: Generate and Filter Next Query Embeddings…

200 papers

Adaptive retrieval-augmented generation (ARAG) aims to dynamically determine the necessity of retrieval for queries instead of retrieving indiscriminately to enhance the efficiency and relevance of the sourced information. However, previous…

Computation and Language · Computer Science 2024-06-06 Zihan Zhang , Meng Fang , Ling Chen

Large Language Models (LLMs) have achieved impressive capabilities in language understanding and generation, yet they continue to underperform on knowledge-intensive reasoning tasks due to limited access to structured context and multi-hop…

Computation and Language · Computer Science 2025-06-26 Travis Thompson , Seung-Hwan Lim , Paul Liu , Ruoying He , Dongkuan Xu

The rapid evolution of Retrieval-Augmented Generation (RAG) toward multimodal, high-stakes enterprise applications has outpaced the development of domain specific evaluation benchmarks. Existing datasets often rely on general-domain corpora…

Artificial Intelligence · Computer Science 2026-01-23 Chandan Kumar Sahu , Premith Kumar Chilukuri , Matthew Hetrich

The existing Retrieval-Augmented Generation (RAG) systems face significant challenges in terms of cost and effectiveness. On one hand, they need to encode the lengthy retrieved contexts before responding to the input tasks, which imposes…

Computation and Language · Computer Science 2024-09-25 Zheng Liu , Chenyuan Wu , Ninglu Shao , Shitao Xiao , Chaozhuo Li , Defu Lian

In this work, we benchmark various graph-based retrieval-augmented generation (RAG) systems across a broad spectrum of query types, including OLTP-style (fact-based) and OLAP-style (thematic) queries, to address the complex demands of…

Information Retrieval · Computer Science 2025-03-06 Joyce Cahoon , Prerna Singh , Nick Litombe , Jonathan Larson , Ha Trinh , Yiwen Zhu , Andreas Mueller , Fotis Psallidas , Carlo Curino

Fine-tuning is an immensely resource-intensive process when retraining Large Language Models (LLMs) to incorporate a larger body of knowledge. Although many fine-tuning techniques have been developed to reduce the time and computational…

Computation and Language · Computer Science 2025-08-01 Hruday Markondapatnaikuni , Basem Suleiman , Abdelkarim Erradi , Shijing Chen

There emerges a promising trend of using large language models (LLMs) to generate code-like plans for complex inference tasks such as visual reasoning. This paradigm, known as LLM-based planning, provides flexibility in problem solving and…

Computation and Language · Computer Science 2023-08-22 Pengbo Hu , Ji Qi , Xingyu Li , Hong Li , Xinqi Wang , Bing Quan , Ruiyu Wang , Yi Zhou

Retrieval-augmented generation (RAG) enhances LLM reasoning in knowledge-intensive tasks, but existing RAG pipelines incur substantial retrieval and generation overhead when applied to large-scale entity matching. To address this…

Databases · Computer Science 2026-02-06 Chuangtao Ma , Zeyu Zhang , Arijit Khan , Sebastian Schelter , Paul Groth

Graph-based Retrieval-augmented generation (RAG) has become a widely studied approach for improving the reasoning, accuracy, and factuality of Large Language Models (LLMs). However, many existing graph-based RAG systems overlook the high…

Artificial Intelligence · Computer Science 2025-11-11 Qiao Xiao , Hong Ting Tsang , Jiaxin Bai

Large language models (LLMs) excel in question-answering (QA) tasks, and retrieval-augmented generation (RAG) enhances their precision by incorporating external evidence from diverse sources like web pages, databases, and knowledge graphs.…

Information Retrieval · Computer Science 2025-04-10 Yikuan Xia , Jiazun Chen , Yirui Zhan , Suifeng Zhao , Weipeng Jiang , Chaorui Zhang , Wei Han , Bo Bai , Jun Gao

While Retrieval-Augmented Generation (RAG) systems enhance Large Language Models (LLMs) by incorporating external knowledge, they still face persistent challenges in retrieval inefficiency and the inability of LLMs to filter out irrelevant…

Computation and Language · Computer Science 2025-02-13 Ruobing Yao , Yifei Zhang , Shuang Song , Yuhua Liu , Neng Gao , Chenyang Tu

Retrieval-augmented generation (RAG) systems have advanced large language models (LLMs) in complex deep search scenarios requiring multi-step reasoning and iterative information retrieval. However, existing approaches face critical…

Computation and Language · Computer Science 2025-10-09 Shuang Sun , Huatong Song , Yuhao Wang , Ruiyang Ren , Jinhao Jiang , Junjie Zhang , Fei Bai , Jia Deng , Wayne Xin Zhao , Zheng Liu , Lei Fang , Zhongyuan Wang , Ji-Rong Wen

Retrieval-augmented generation (RAG) systems have been widely adopted in contemporary large language models (LLMs) due to their ability to improve generation quality while reducing the required input context length. In this work, we focus…

Computation and Language · Computer Science 2026-04-07 Tianyi Zhang , Andreas Marfurt

Long-context large language models (LC LLMs) combined with retrieval-augmented generation (RAG) hold strong potential for complex multi-hop and large-document tasks. However, existing RAG systems often suffer from imprecise retrieval,…

Computation and Language · Computer Science 2025-05-22 Woosang Lim , Zekun Li , Gyuwan Kim , Sungyoung Ji , HyeonJung Kim , Kyuri Choi , Jin Hyuk Lim , Kyungpyo Park , William Yang Wang

Retrieval-augmented generation (RAG) has become a cornerstone of contemporary NLP, enhancing large language models (LLMs) by allowing them to access richer factual contexts through in-context retrieval. While effective in monolingual…

Computation and Language · Computer Science 2026-03-31 Leonardo Ranaldi , Barry Haddow , Alexandra Birch

Retrieval-augmented generation (RAG) systems have made significant progress in solving complex multi-hop question answering (QA) tasks in the English scenario. However, RAG systems inevitably face the application scenario of retrieving…

Computation and Language · Computer Science 2026-03-20 Yilin Wang , Yuchun Fan , Jiaoyang Li , Ziming Zhu , Yongyu Mu , Qiaozhi He , Tong Xiao , Jingbo Zhu

We present ReMatch, a framework that leverages the generative strength of MLLMs for multimodal retrieval. Previous approaches treated an MLLM as a simple encoder, ignoring its generative nature, and under-utilising its compositional…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Qianying Liu , Xiao Liang , Zhiqiang Zhang , Zhongfei Qing , Fengfan Zhou , Yibo Chen , Xu Tang , Yao Hu , Paul Henderson

Retrieval-Augmented Generation (RAG) couples a retriever with a large language model (LLM) to ground generated responses in external evidence. While this framework enhances factuality and domain adaptability, it faces a key bottleneck:…

Information Retrieval · Computer Science 2026-01-08 Sherine George

This paper presents the approach of our team called heiDS for the ArchEHR-QA 2025 shared task. A pipeline using a retrieval augmented generation (RAG) framework is designed to generate answers that are attributed to clinical evidence from…

Computation and Language · Computer Science 2025-06-25 Ashish Chouhan , Michael Gertz

Retrieval-augmented generation (RAG) can supplement large language models (LLMs) by integrating external knowledge. However, as the number of retrieved documents increases, the input length to LLMs grows linearly, causing a dramatic…

Computation and Language · Computer Science 2025-02-18 Yuankai Li , Jia-Chen Gu , Di Wu , Kai-Wei Chang , Nanyun Peng