English
Related papers

Related papers: QChunker: Learning Question-Aware Text Chunking fo…

200 papers

This technical report details a novel approach to combining reasoning and retrieval augmented generation (RAG) within a single, lean language model architecture. While existing RAG systems typically rely on large-scale models and external…

Retrieval-Augmented Generation (RAG) systems have recently shown remarkable advancements by integrating retrieval mechanisms into language models, enhancing their ability to produce more accurate and contextually relevant responses.…

Computation and Language · Computer Science 2025-01-14 Siran Li , Linus Stenzel , Carsten Eickhoff , Seyed Ali Bahrainian

Integrating Retrieval Augmented Generation (RAG) with Large Language Models (LLMs) has shown the potential to provide precise, contextually relevant responses in knowledge intensive domains. This study investigates the ap-plication of RAG…

Artificial Intelligence · Computer Science 2025-05-26 Salahuddin Alawadhi , Noorhan Abbas

Automated question-answering (QA) systems increasingly rely on retrieval-augmented generation (RAG) to ground large language models (LLMs) in authoritative medical knowledge, ensuring clinical accuracy and patient safety in Artificial…

Computation and Language · Computer Science 2026-03-05 Aswini Sivakumar , Vijayan Sugumaran , Yao Qiang

In Retrieval-Augmented Generation applications, the Information Retrieval part is central as it provides the contextual information that enables a Large Language Model to generate an appropriate and truthful response. High quality parsing…

Information Retrieval · Computer Science 2026-02-03 Mathieu Ciancone , Clovis Varangot-Reille , Marion Schaeffer

Enterprise retrieval augmented generation (RAG) offers a highly flexible framework for combining powerful large language models (LLMs) with internal, possibly temporally changing, documents. In RAG, documents are first chunked. Relevant…

Computation and Language · Computer Science 2024-09-02 Vatsal Raina , Mark Gales

Large Language Models (LLMs) have demonstrated impressive ability in generation and reasoning tasks but struggle with handling up-to-date knowledge, leading to inaccuracies or hallucinations. Retrieval-Augmented Generation (RAG) mitigates…

Databases · Computer Science 2026-03-13 Ziting Wang , Haitao Yuan , Wei Dong , Gao Cong , Feifei Li

Retrieval-Augmented Generation (RAG) based on Large Language Models (LLMs) is a powerful solution to understand and query the industry's closed-source documents. However, basic RAG often struggles with complex QA tasks in legal and…

Information Retrieval · Computer Science 2025-09-08 Huifeng Lin , Gang Su , Jintao Liang , You Wu , Rui Zhao , Ziyue Li

Chunking is a crucial preprocessing step in retrieval-augmented generation (RAG) systems, significantly impacting retrieval effectiveness across diverse datasets. In this study, we systematically evaluate fixed-size chunking strategies and…

Information Retrieval · Computer Science 2025-05-30 Sinchana Ramakanth Bhat , Max Rudat , Jannis Spiekermann , Nicolas Flores-Herr

Retrieval-Augmented Generation (RAG) merges retrieval methods with deep learning advancements to address the static limitations of large language models (LLMs) by enabling the dynamic integration of up-to-date external information. This…

Information Retrieval · Computer Science 2026-05-19 Yizheng Huang , Jimmy Huang

Retrieval-augmented generation (RAG) systems have been widely adopted in contemporary large language models (LLMs) due to their ability to improve generation quality while reducing the required input context length. In this work, we focus…

Computation and Language · Computer Science 2026-04-07 Tianyi Zhang , Andreas Marfurt

Large language models achieve high task performance yet often hallucinate or rely on outdated knowledge. Retrieval-augmented generation (RAG) addresses these gaps by coupling generation with external search. We analyse how hyperparameters…

Machine Learning · Computer Science 2025-05-14 Adel Ammar , Anis Koubaa , Omer Nacar , Wadii Boulila

Retrieval-augmented generation (RAG) is a key means to effectively enhance large language models (LLMs) in many knowledge-based tasks. However, existing RAG methods struggle with knowledge-intensive reasoning tasks, because useful…

Computation and Language · Computer Science 2024-10-28 Zhuoqun Li , Xuanang Chen , Haiyang Yu , Hongyu Lin , Yaojie Lu , Qiaoyu Tang , Fei Huang , Xianpei Han , Le Sun , Yongbin Li

The ability to form, retrieve, and reason about memories in response to stimuli serves as the cornerstone for general intelligence - shaping entities capable of learning, adaptation, and intuitive insight. Large Language Models (LLMs) have…

Computation and Language · Computer Science 2024-09-25 Brendan Hogan Rappazzo , Yingheng Wang , Aaron Ferber , Carla Gomes

Retrieval-Augmented Generation (RAG) enhances Large Language Models (LLMs) by integrating them with an external knowledge base to improve the answer relevance and accuracy. In real-world scenarios, beyond pure text, a substantial amount of…

Computation and Language · Computer Science 2025-10-07 Jiaru Zou , Dongqi Fu , Sirui Chen , Xinrui He , Zihao Li , Yada Zhu , Jiawei Han , Jingrui He

This work presents a novel architecture for building Retrieval-Augmented Generation (RAG) systems to improve Question Answering (QA) tasks from a target corpus. Large Language Models (LLMs) have revolutionized the analyzing and generation…

Computation and Language · Computer Science 2025-01-09 Binita Saha , Utsha Saha , Muhammad Zubair Malik

Integrating multiple (sub-)systems is essential to create advanced Information Systems. Difficulties mainly arise when integrating dynamic environments, e.g., the integration at design time of not yet existing services. This has been…

Software Engineering · Computer Science 2025-05-27 Robin D. Pesl , Jerin G. Mathew , Massimo Mecella , Marco Aiello

Short answer assessment is a vital component of science education, allowing evaluation of students' complex three-dimensional understanding. Large language models (LLMs) that possess human-like ability in linguistic tasks are increasingly…

Computation and Language · Computer Science 2025-06-05 Yucheng Chu , Peng He , Hang Li , Haoyu Han , Kaiqi Yang , Yu Xue , Tingting Li , Joseph Krajcik , Jiliang Tang

We propose a new method to measure the task-specific accuracy of Retrieval-Augmented Large Language Models (RAG). Evaluation is performed by scoring the RAG on an automatically-generated synthetic exam composed of multiple choice questions…

Computation and Language · Computer Science 2024-05-24 Gauthier Guinet , Behrooz Omidvar-Tehrani , Anoop Deoras , Laurent Callot

Retrieval-Augmented Generation (RAG) combines the language understanding and reasoning power of large language models (LLMs) with external retrieval to enable domain-grounded responses. Effectively adapting RAG systems to domain-specific…

Computation and Language · Computer Science 2026-04-14 Chris Xing Tian , Weihao Xie , Zhen Chen , Zhengyuan Yi , Hui Liu , Haoliang Li , Shiqi Wang , Siwei Ma