English
Related papers

Related papers: Distilling a Small Utility-Based Passage Selector …

200 papers

The conventional Retrieval-Augmented Generation (RAG) paradigm of injecting raw retrieved texts into the Large Language Model (LLM)'s context often results in suboptimal integration of retrieved information. This paper proposes to bridge…

Computation and Language · Computer Science 2026-05-05 Sangkwon Park , Donghun Kang , Jisoo Mok , Sungroh Yoon

In retrieval-augmented generation (RAG) question answering systems, generating citations for large language model (LLM) outputs enhances verifiability and helps users identify potential hallucinations. However, we observe two problems in…

Computation and Language · Computer Science 2025-10-21 Guo Chen , Qiuyuan Li , Qiuxian Li , Hongliang Dai , Xiang Chen , Piji Li

Retrieval-augmented generation (RAG) methods encounter difficulties when addressing complex questions like multi-hop queries. While iterative retrieval methods improve performance by gathering additional information, current approaches…

Computation and Language · Computer Science 2024-09-27 Ziyuan Zhuang , Zhiyang Zhang , Sitao Cheng , Fangkai Yang , Jia Liu , Shujian Huang , Qingwei Lin , Saravan Rajmohan , Dongmei Zhang , Qi Zhang

Large Language Models (LLMs) exhibit remarkable capabilities but are prone to generating inaccurate or hallucinatory responses. This limitation stems from their reliance on vast pretraining datasets, making them susceptible to errors in…

Computation and Language · Computer Science 2024-04-02 Chi-Min Chan , Chunpu Xu , Ruibin Yuan , Hongyin Luo , Wei Xue , Yike Guo , Jie Fu

Large Language Models (LLMs) are becoming essential tools for various natural language processing tasks but often suffer from generating outdated or incorrect information. Retrieval-Augmented Generation (RAG) addresses this issue by…

Large Language Models (LLMs) have shown remarkable capabilities across diverse tasks, yet they face inherent limitations such as constrained parametric knowledge and high retraining costs. Retrieval-Augmented Generation (RAG) augments the…

Information Retrieval · Computer Science 2025-08-26 Leqian Li , Dianxi Shi , Jialu Zhou , Xinyu Wei , Mingyue Yang , Songchang Jin , Shaowu Yang

Long text classification is challenging for Large Language Models (LLMs) due to token limits and high computational costs. This study explores whether a Retrieval Augmented Generation (RAG) approach using only the most relevant text…

A Retrieval-Augmented Generation (RAG) model powered by a large language model (LLM) provides a faster and more cost-effective solution for adapting to new data and knowledge. It also delivers more specialized responses compared to…

Computation and Language · Computer Science 2025-01-29 Zheng Zheng , Xinyi Ni , Pengyu Hong

Large language models (LLMs) demonstrate strong performance in natural language processing but often generate factual errors when relying solely on parametric knowledge. Retrieval-Augmented Generation (RAG) mitigates these errors by…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Zhifeng Wang , Jason Jingshi Li , Kaihao Zhang , Ramesh Sankaranarayana

Retrieval-augmented generation (RAG) enhances LLMs with external knowledge, yet generation remains vulnerable to retrieval-induced noise and uncertain placement of relevant chunks, often causing hallucinations. We present Ext2Gen, an…

Computation and Language · Computer Science 2025-11-18 Hwanjun Song , Jeonghwan Choi , Minseok Kim

Retrieval-augmented generation (RAG) systems address complex user requests by decomposing them into subqueries, retrieving potentially relevant documents for each, and then aggregating them to generate an answer. Efficiently selecting…

Artificial Intelligence · Computer Science 2025-10-22 Roxana Petcu , Kenton Murray , Daniel Khashabi , Evangelos Kanoulas , Maarten de Rijke , Dawn Lawrie , Kevin Duh

In recent years, large language models (LLMs) have made remarkable achievements in various domains. However, the untimeliness and cost of knowledge updates coupled with hallucination issues of LLMs have curtailed their applications in…

Machine Learning · Computer Science 2024-05-31 Chunjing Gan , Dan Yang , Binbin Hu , Hanxiao Zhang , Siyuan Li , Ziqi Liu , Yue Shen , Lin Ju , Zhiqiang Zhang , Jinjie Gu , Lei Liang , Jun Zhou

We designed a Retrieval-Augmented Generation (RAG) system to provide large language models with relevant documents for answering domain-specific questions about Pittsburgh and Carnegie Mellon University (CMU). We extracted over 1,800…

Machine Learning · Computer Science 2024-11-22 Haojia Sun , Yaqi Wang , Shuting Zhang

Retrieval-Augmented Generation allows to enhance Large Language Models with external knowledge. In response to the recent popularity of generative LLMs, many RAG approaches have been proposed, which involve an intricate number of different…

Computation and Language · Computer Science 2024-07-02 David Rau , Hervé Déjean , Nadezhda Chirkova , Thibault Formal , Shuai Wang , Vassilina Nikoulina , Stéphane Clinchant

The rapid evolution of mobile edge computing (MEC) has introduced significant challenges in optimizing resource allocation in highly dynamic wireless communication systems, in which task offloading decisions should be made in real-time.…

Signal Processing · Electrical Eng. & Systems 2024-12-31 Runtao Ren , Yinyu Wu , Xuhui Zhang , Jinke Ren , Yanyan Shen , Shuqiang Wang , Kim-Fung Tsang

Recent studies show that large language models (LLMs) struggle with technical standards in telecommunications. We propose a fine-tuned retrieval-augmented generation (RAG) system based on the Phi-2 small language model (SLM) to serve as an…

Computation and Language · Computer Science 2025-01-17 Omar Erak , Nouf Alabbasi , Omar Alhussein , Ismail Lotfi , Amr Hussein , Sami Muhaidat , Merouane Debbah

Retrieval-augmented generation (RAG) enhances large language models (LLMs) by integrating external knowledge sources to address their limitations in accessing up-to-date or specialized information. A natural strategy to increase the…

Computation and Language · Computer Science 2025-11-10 Song Wang , Zihan Chen , Peng Wang , Zhepei Wei , Zhen Tan , Yu Meng , Cong Shen , Jundong Li

The integration of large language models (LLMs) into education offers significant potential to enhance accessibility and engagement, yet their high computational demands limit usability in low-resource settings, exacerbating educational…

Computers and Society · Computer Science 2025-10-09 Juan Segundo Hevia , Facundo Arredondo , Vishesh Kumar

The rapid expansion of space activities has led to an unprecedented accumulation of technical documentation, operational guidelines, and scientific literature, creating challenges for timely decision-making in space operations. Effective…

Information Retrieval · Computer Science 2026-05-28 Ruben Belo , Marta Guimarães , Cláudia Soares

Large language models (LLMs) augmented with retrieval exhibit robust performance and extensive versatility by incorporating external contexts. However, the input length grows linearly in the number of retrieved documents, causing a dramatic…

Computation and Language · Computer Science 2024-05-28 Yun Zhu , Jia-Chen Gu , Caitlin Sikora , Ho Ko , Yinxiao Liu , Chu-Cheng Lin , Lei Shu , Liangchen Luo , Lei Meng , Bang Liu , Jindong Chen