English
Related papers

Related papers: Reducing Redundancy in Retrieval-Augmented Generat…

200 papers

Chunking is a crucial preprocessing step in retrieval-augmented generation (RAG) systems, significantly impacting retrieval effectiveness across diverse datasets. In this study, we systematically evaluate fixed-size chunking strategies and…

Information Retrieval · Computer Science 2025-05-30 Sinchana Ramakanth Bhat , Max Rudat , Jannis Spiekermann , Nicolas Flores-Herr

Retrieval-Augmented Generation (RAG), while serving as a viable complement to large language models (LLMs), often overlooks the crucial aspect of text chunking within its pipeline. This paper initially introduces a dual-metric evaluation…

Computation and Language · Computer Science 2025-05-27 Jihao Zhao , Zhiyuan Ji , Zhaoxin Fan , Hanyu Wang , Simin Niu , Bo Tang , Feiyu Xiong , Zhiyu Li

Document chunking is a crucial component of Retrieval-Augmented Generation (RAG), as it directly affects the retrieval of relevant and precise context. Conventional fixed-length and recursive splitters often produce arbitrary, incoherent…

Information Retrieval · Computer Science 2025-12-02 Aparajitha Allamraju , Maitreya Prafulla Chitale , Hiranmai Sri Adibhatla , Rahul Mishra , Manish Shrivastava

We study how document chunking choices impact the reliability of Retrieval-Augmented Generation (RAG) systems in industry. While practice often relies on heuristics, our end-to-end evaluation on Natural Questions systematically varies…

Computation and Language · Computer Science 2026-01-21 Sofia Bennani , Charles Moslonka

The performance of Retrieval-Augmented Generation (RAG) systems in information retrieval is significantly influenced by the characteristics of the documents being processed. In this study, the structured nature of textbooks, the conciseness…

Information Retrieval · Computer Science 2024-09-23 Esmaeil Narimissa , David Raithel

The effectiveness of Retrieval-Augmented Generation (RAG) is highly dependent on how documents are chunked, that is, segmented into smaller units for indexing and retrieval. Yet, commonly used "one-size-fits-all" approaches often fail to…

Computation and Language · Computer Science 2026-03-27 Paulo Roberto de Moura Júnior , Jean Lelong , Annabelle Blangero

Retrieval-augmented generation (RAG) methods can enhance the performance of LLMs by incorporating retrieved knowledge chunks into the generation process. In general, the retrieval and generation steps usually have different requirements for…

Information Retrieval · Computer Science 2025-04-16 Peiru Yang , Xintian Li , Zhiyang Hu , Jiapeng Wang , Jinhua Yin , Huili Wang , Lizhi He , Shuai Yang , Shangguang Wang , Yongfeng Huang , Tao Qi

Retrieval-Augmented Generation (RAG) has proven effective in open-domain question answering. However, the chunking process, which is essential to this pipeline, often receives insufficient attention relative to retrieval and synthesis…

Computation and Language · Computer Science 2025-01-20 Zuhong Liu , Charles-Elie Simon , Fabien Caspani

Large language models (LLMs) are very costly and inefficient to update with new information. To address this limitation, retrieval-augmented generation (RAG) has been proposed as a solution that dynamically incorporates external knowledge…

Computation and Language · Computer Science 2025-07-10 Sezen Perçin , Xin Su , Qutub Sha Syed , Phillip Howard , Aleksei Kuvshinov , Leo Schwinn , Kay-Ulrich Scholl

Most conventional Retrieval-Augmented Generation (RAG) pipelines rely on relevance-based retrieval, which often misaligns with utility -- that is, whether the retrieved passages actually improve the quality of the generated text specific to…

Information Retrieval · Computer Science 2026-01-28 Manish Chandra , Debasis Ganguly , Iadh Ounis

Large language models achieve high task performance yet often hallucinate or rely on outdated knowledge. Retrieval-augmented generation (RAG) addresses these gaps by coupling generation with external search. We analyse how hyperparameters…

Machine Learning · Computer Science 2025-05-14 Adel Ammar , Anis Koubaa , Omer Nacar , Wadii Boulila

Organizations increasingly rely on proprietary enterprise data, including HR records, structured reports, and tabular documents, for critical decision-making. While Large Language Models (LLMs) have strong generative capabilities, they are…

Computation and Language · Computer Science 2025-07-17 Chandana Cheerla

Retrieval-Augmented Generation (RAG) systems often face limitations in specialized domains such as fintech, where domain-specific ontologies, dense terminology, and acronyms complicate effective retrieval and synthesis. This paper…

Artificial Intelligence · Computer Science 2025-10-30 Thomas Cook , Richard Osuagwu , Liman Tsatiashvili , Vrynsia Vrynsia , Koustav Ghosal , Maraim Masoud , Riccardo Mattivi

A Comparison of Independent and Joint Fine-tuning Strategies for Retrieval-Augmented Generation Download PDF Neal Gregory Lawton, Alfy Samuel, Anoop Kumar, Daben Liu Published: 20 Aug 2025, Retrieval augmented generation (RAG) is a popular…

Computation and Language · Computer Science 2025-10-21 Neal Gregory Lawton , Alfy Samuel , Anoop Kumar , Daben Liu

Retrieval-augmented generation (RAG) is a promising method for addressing some of the memory-related challenges associated with Large Language Models (LLMs). Two separate systems form the RAG pipeline, the retriever and the reader, and the…

Computation and Language · Computer Science 2024-11-13 Alexandria Leto , Cecilia Aguerrebere , Ishwar Bhati , Ted Willke , Mariano Tepper , Vy Ai Vo

Retrieval-augmented generation (RAG) pipelines for code completion rely on chunking to segment source files into retrievable units, yet chunking strategies are typically adopted without empirical justification, and practitioner…

Software Engineering · Computer Science 2026-05-07 Xinjian Wu , Jingzhi Gong , Gunel Jahangirova , Jie Zhang

Retrieval-Augmented Generation (RAG) based on Large Language Models (LLMs) is a powerful solution to understand and query the industry's closed-source documents. However, basic RAG often struggles with complex QA tasks in legal and…

Information Retrieval · Computer Science 2025-09-08 Huifeng Lin , Gang Su , Jintao Liang , You Wu , Rui Zhao , Ziyue Li

One of the key problems in Retrieval-augmented generation (RAG) systems is that chunk-based retrieval pipelines represent the source chunks as atomic objects, mixing the information contained within such a chunk into a single vector. These…

Retrieval-Augmented Generation (RAG) struggles on long, structured financial filings where relevant evidence is sparse and cross-referenced. This paper presents a systematic investigation of advanced metadata-driven Retrieval-Augmented…

Information Retrieval · Computer Science 2025-10-29 Michail Dadopoulos , Anestis Ladas , Stratos Moschidis , Ioannis Negkakis

Although retrieval-augmented generation(RAG) significantly improves generation quality by retrieving external knowledge bases and integrating generated content, it faces computational efficiency bottlenecks, particularly in knowledge…

Machine Learning · Computer Science 2026-02-03 Zihang Li , Yangdong Ruan , Wenjun Liu , Zhengyang Wang , Tong Yang