English
Related papers

Related papers: ConTReGen: Context-driven Tree-structured Retrieva…

200 papers

Overcoming the limited context limitations in early-generation LLMs, retrieval-augmented generation (RAG) has been a reliable solution for context-based answer generation in the past. Recently, the emergence of long-context LLMs allows the…

Computation and Language · Computer Science 2024-09-04 Tan Yu , Anbang Xu , Rama Akkiraju

Large language models (LLMs) often need to incorporate external knowledge to solve theme-specific problems. Retrieval-augmented generation (RAG) has shown its high promise, empowering LLMs to generate more qualified responses with retrieved…

Machine Learning · Computer Science 2025-08-05 Jimeng Shi , Sizhe Zhou , Bowen Jin , Wei Hu , Runchu Tian , Shaowen Wang , Giri Narasimhan , Jiawei Han

Retrieval-Augmented Generation (RAG) systems have recently shown remarkable advancements by integrating retrieval mechanisms into language models, enhancing their ability to produce more accurate and contextually relevant responses.…

Computation and Language · Computer Science 2025-01-14 Siran Li , Linus Stenzel , Carsten Eickhoff , Seyed Ali Bahrainian

Retrieval-Augmented Generation (RAG) struggles on long, structured financial filings where relevant evidence is sparse and cross-referenced. This paper presents a systematic investigation of advanced metadata-driven Retrieval-Augmented…

Information Retrieval · Computer Science 2025-10-29 Michail Dadopoulos , Anestis Ladas , Stratos Moschidis , Ioannis Negkakis

Retrieval-Augmented Generation (RAG) plays a crucial role in grounding Large Language Models by leveraging external knowledge, whereas the effectiveness is often compromised by the retrieval of contextually flawed or incomplete information.…

Artificial Intelligence · Computer Science 2025-11-13 Yaoze Zhang , Rong Wu , Pinlong Cai , Xiaoman Wang , Guohang Yan , Song Mao , Ding Wang , Botian Shi

As an important paradigm for enhancing the generation quality of Large Language Models (LLMs), retrieval-augmented generation (RAG) faces the two challenges regarding retrieval accuracy and computational efficiency. This paper presents a…

Information Retrieval · Computer Science 2026-05-29 Zihang Li , Wenjun Liu , Yikun Zong , Jiawen Tao , Siying Dai , Songcheng Ren , Zirui Liu , Yuhang Wang , Yanbing Jiang , Tong Yang

Large Language Models (LLMs) are adept at generating responses based on information within their context. While this ability is useful for interacting with structured data like code files, another popular method, Retrieval-Augmented…

Computation and Language · Computer Science 2025-10-22 Mihir Gupte , Paolo Giusto , Ramesh S

Retrieval-Augmented Generation (RAG) systems commonly use chunking strategies for retrieval, which enhance large language models (LLMs) by enabling them to access external knowledge, ensuring that the retrieved information is up-to-date and…

Computation and Language · Computer Science 2025-07-15 Hai Toan Nguyen , Tien Dat Nguyen , Viet Ha Nguyen

Retrieval-Augmented Generation (RAG) has demonstrated significant effectiveness in enhancing large language models (LLMs) for complex multi-hop question answering (QA). For multi-hop QA tasks, current iterative approaches predominantly rely…

Computation and Language · Computer Science 2026-01-19 Yuling Shi , Maolin Sun , Zijun Liu , Mo Yang , Yixiong Fang , Tianran Sun , Xiaodong Gu

Recent advances in Retrieval-Augmented Generation (RAG) have revolutionized knowledge-intensive tasks, yet traditional RAG methods struggle when the search space is unknown or when documents are semi-structured or structured. We introduce a…

Information Retrieval · Computer Science 2026-03-25 Manie Tadayon , Mayank Gupta

Retrieval-augmented generation (RAG) systems have been widely adopted in contemporary large language models (LLMs) due to their ability to improve generation quality while reducing the required input context length. In this work, we focus…

Computation and Language · Computer Science 2026-04-07 Tianyi Zhang , Andreas Marfurt

Multimodal Retrieval-Augmented Generation (RAG) has emerged as an effective paradigm for enhancing Large Language Models (LLMs) with external knowledge. However, existing multimodal RAG systems predominantly rely on coarse-grained…

Information Retrieval · Computer Science 2026-05-25 Yifan Zhu , Yu Mi , Yue Lu , Yanchu Guan , Zhixuan Chu

Retrieval-augmented generation (RAG) empowers large language models to access external and private corpus, enabling factually consistent responses in specific domains. By exploiting the inherent structure of the corpus, graph-based RAG…

Artificial Intelligence · Computer Science 2025-04-17 Tianyang Xu , Haojie Zheng , Chengze Li , Haoxiang Chen , Yixin Liu , Ruoxi Chen , Lichao Sun

Transformers have a quadratic scaling of computational complexity with input size, which limits the input context window size of large language models (LLMs) in both training and inference. Meanwhile, retrieval-augmented generation (RAG)…

Computation and Language · Computer Science 2024-10-18 Yimin Tang , Yurong Xu , Ning Yan , Masood Mortazavi

Retrieval-augmented generation (RAG) has become a transformative approach for enhancing large language models (LLMs) by grounding their outputs in external knowledge sources. Yet, a critical question persists: how can vast volumes of…

Information Retrieval · Computer Science 2025-04-29 Carlo Merola , Jaspinder Singh

Document understanding is critical for applications from financial analysis to scientific discovery. Current approaches, whether OCR-based pipelines feeding Large Language Models (LLMs) or native Multimodal LLMs (MLLMs), face key…

Computation and Language · Computer Science 2026-04-21 Sensen Gao , Shanshan Zhao , Xu Jiang , Lunhao Duan , Yong Xien Chng , Qing-Guo Chen , Weihua Luo , Kaifu Zhang , Jia-Wang Bian , Mingming Gong

Long-context question answering over narrative tasks is challenging because correct answers often hinge on reconstructing a coherent timeline of events while preserving contextual f low in a limited context window. Retrievalaugmented…

Computation and Language · Computer Science 2025-10-14 Byeongjeong Kim , Jeonghyun Park , Joonho Yang , Hwanhee Lee

Large language models (LLMs) achieve optimal utility when their responses are grounded in external knowledge sources. However, real-world documents, such as annual reports, scientific papers, and clinical guidelines, frequently combine…

Information Retrieval · Computer Science 2025-12-17 Chi Zhang , Qiyang Chen , Mengqi Zhang

Retrieval-Augmented Generation (RAG) helps large language models (LLMs) answer knowledge-intensive and time-sensitive questions by conditioning generation on external evidence. However, most RAG systems still retrieve unstructured chunks…

Computation and Language · Computer Science 2026-03-11 Jiashuo Sun , Yixuan Xie , Jimeng Shi , Shaowen Wang , Jiawei Han

\Ac{RAG} has emerged as a crucial technique for enhancing large models with real-time and domain-specific knowledge. While numerous improvements and open-source tools have been proposed to refine the \ac{RAG} framework for accuracy,…

Information Retrieval · Computer Science 2025-02-20 Yixing Fan , Qiang Yan , Wenshan Wang , Jiafeng Guo , Ruqing Zhang , Xueqi Cheng