English
Related papers

Related papers: How Does Chunking Affect Retrieval-Augmented Code …

200 papers

Retrieval-Augmented Generation (RAG) enhances Large Language Models (LLMs) by integrating external knowledge bases, achieving state-of-the-art results in various coding tasks. The core of RAG is retrieving demonstration examples, which is…

Software Engineering · Computer Science 2025-02-25 Pengfei He , Shaowei Wang , Shaiful Chowdhury , Tse-Hsun Chen

Recent advances in large language models (LLMs) have significantly improved automated code generation. While existing approaches have achieved strong performance at the function and file levels, real-world software engineering requires…

Software Engineering · Computer Science 2026-05-21 Yicheng Tao , Yuante Li , Yao Qin , Yepang Liu

Retrieval-augmented generation (RAG) enhances language models by integrating external knowledge, but its effectiveness is highly dependent on system configuration. Improper retrieval settings can degrade performance, making RAG less…

Computation and Language · Computer Science 2025-07-17 Jennifer Hsia , Afreen Shaikh , Zhiruo Wang , Graham Neubig

Financial analysts face significant challenges extracting information from lengthy 10-K reports, which often exceed 100 pages. This paper presents a Retrieval-Augmented Generation (RAG) system designed to answer questions about S&P 500…

Computation and Language · Computer Science 2026-04-29 Zhiyuan Cheng , Longying Lai , Yue Liu , Kai Cheng , Xiaoxi Qi

The use of large language models (LLMs) is becoming increasingly widespread among software developers. However, privacy and computational requirements are problematic with commercial solutions and the use of LLMs. In this work, we focus on…

Software Engineering · Computer Science 2025-06-17 Marko Hostnik , Marko Robnik-Šikonja

Retrieval-Augmented Generation (RAG) systems have revolutionized information retrieval and question answering, but traditional text-based chunking methods struggle with complex document structures, multi-page tables, embedded figures, and…

Machine Learning · Computer Science 2025-07-15 Vishesh Tripathi , Tanmay Odapally , Indraneel Das , Uday Allu , Biddwan Ahmed

Retrieval-augmented generation (RAG) systems combine document retrieval with a generative model to address complex information seeking tasks like report generation. While the relationship between retrieval quality and generation…

Information Retrieval · Computer Science 2026-04-15 Saron Samuel , Alexander Martin , Eugene Yang , Andrew Yates , Dawn Lawrie , Laura Dietz , Benjamin Van Durme

Recent advancements in Retrieval-Augmented Generation (RAG) have enabled Large Language Models to answer financial questions using external knowledge bases of U.S. SEC filings, earnings reports, and regulatory documents. However, existing…

RAG-based QA has emerged as a powerful method for processing long industrial documents. However, conventional text chunking approaches often neglect complex and long industrial document structures, causing information loss and reduced…

Artificial Intelligence · Computer Science 2026-04-15 Joongmin Shin , Chanjun Park , Jeongbae Park , Jaehyung Seo , Heuiseok Lim

Retrieval-Augmented Generation (RAG) based on Large Language Models (LLMs) is a powerful solution to understand and query the industry's closed-source documents. However, basic RAG often struggles with complex QA tasks in legal and…

Information Retrieval · Computer Science 2025-09-08 Huifeng Lin , Gang Su , Jintao Liang , You Wu , Rui Zhao , Ziyue Li

Retrieval-Augmented Generation (RAG) systems combine dense retrievers and language models to ground LLM outputs in retrieved documents. However, the opacity of how these components interact creates challenges for deployment in high-stakes…

Computation and Language · Computer Science 2026-01-30 Korbinian Randl , Guido Rocchietti , Aron Henriksson , Ziawasch Abedjan , Tony Lindgren , John Pavlopoulos

Retrieval-Augmented Generation (RAG) systems using large language models (LLMs) often generate inaccurate responses due to the retrieval of irrelevant or loosely related information. Existing methods, which operate at the document level,…

Computation and Language · Computer Science 2025-04-24 Ishneet Sukhvinder Singh , Ritvik Aggarwal , Ibrahim Allahverdiyev , Muhammad Taha , Aslihan Akalin , Kevin Zhu , Sean O'Brien

Retrieval-Augmented Generation (RAG) struggles on long, structured financial filings where relevant evidence is sparse and cross-referenced. This paper presents a systematic investigation of advanced metadata-driven Retrieval-Augmented…

Information Retrieval · Computer Science 2025-10-29 Michail Dadopoulos , Anestis Ladas , Stratos Moschidis , Ioannis Negkakis

The integration of Large Language Models (LLMs) into the public health policy sector offers a transformative approach to navigating the vast repositories of regulatory guidance maintained by agencies such as the Centers for Disease Control…

Computation and Language · Computer Science 2026-01-23 Anuj Maharjan , Umesh Yadav

In this study, we compare the performance of four text chunking approaches: Recursive, Khmer-Aware, Sentence-Based, and LLM-Based within a Retrieval-Augmented Generation (RAG) framework applied to Khmer agricultural documents. The document…

Computation and Language · Computer Science 2026-05-22 Sovandara Chhoun , Pichdara Po , Sereiwathna Ros , Wan-Sup Cho , Saksonita Khoeurn

Document Visual Question Answering (Document VQA) must cope with documents that span dozens of pages, yet leading systems still concatenate every page or rely on very large vision-language models, both of which are memory-hungry.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Eric López , Artemis Llabrés , Ernest Valveny

Retrieval-augmented generation (RAG) is critical for reducing hallucinations and incorporating external knowledge into Large Language Models (LLMs). However, advanced RAG systems face a trade-off between performance and efficiency.…

Information Retrieval · Computer Science 2025-08-05 Shengbo Gong , Xianfeng Tang , Carl Yang , Wei jin

Organizations increasingly rely on proprietary enterprise data, including HR records, structured reports, and tabular documents, for critical decision-making. While Large Language Models (LLMs) have strong generative capabilities, they are…

Computation and Language · Computer Science 2025-07-17 Chandana Cheerla

Cross-lingual retrieval-augmented generation (RAG) is a critical capability for retrieving and generating answers across languages. Prior work in this context has mostly focused on generation and relied on benchmarks derived from…

Computation and Language · Computer Science 2025-10-28 Chen Amiraz , Yaroslav Fyodorov , Elad Haramaty , Zohar Karnin , Liane Lewin-Eytan

Retrieval-augmented generation (RAG) is a promising method for addressing some of the memory-related challenges associated with Large Language Models (LLMs). Two separate systems form the RAG pipeline, the retriever and the reader, and the…

Computation and Language · Computer Science 2024-11-13 Alexandria Leto , Cecilia Aguerrebere , Ishwar Bhati , Ted Willke , Mariano Tepper , Vy Ai Vo