English
Related papers

Related papers: Less Is More: Elevating RAG via Performance-Driven…

200 papers

Retrieval-Augmented Generation (RAG) is an effective approach to enhance the factual accuracy of large language models (LLMs) by retrieving information from external databases, which are typically composed of diverse sources, to supplement…

Machine Learning · Computer Science 2025-10-15 Jeongyeon Hwang , Junyoung Park , Hyejin Park , Dongwoo Kim , Sangdon Park , Jungseul Ok

Robust content moderation classifiers are essential for the safety of Generative AI systems. In this task, differences between safe and unsafe inputs are often extremely subtle, making it difficult for classifiers (and indeed, even humans)…

With the rapid advancement of large language models (LLMs), retrieval-augmented generation (RAG) has emerged as a critical approach to supplement the inherent knowledge limitations of LLMs. However, due to the typically large volume of…

Computation and Language · Computer Science 2025-11-11 Yuhao Wang , Ruiyang Ren , Yucheng Wang , Jing Liu , Wayne Xin Zhao , Hua Wu , Haifeng Wang

Context compression aims to shorten long context inputs with minimal information loss for LLM inference acceleration. While existing methods have shown promise, they typically rely on complex compression modules or compression-specific…

Artificial Intelligence · Computer Science 2026-05-28 Guoxin Ma , Yibing Liu , Chengzhengxu Li , Yu Liang , Yan Wang , Yueyang Zhang , Kecheng Chen , Zhaohan Zhang , Zhiyuan Sun , Daiting Shi

Effective knowledge management is critical for preserving institutional expertise and improving the efficiency of workforce training in state transportation agencies. Traditional approaches, such as static documentation, classroom-based…

Computation and Language · Computer Science 2026-03-05 Divija Amaram , Lu Gao , Gowtham Reddy Gudla , Tejaswini Sanjay Katale

Short answer assessment is a vital component of science education, allowing evaluation of students' complex three-dimensional understanding. Large language models (LLMs) that possess human-like ability in linguistic tasks are increasingly…

Computation and Language · Computer Science 2025-06-05 Yucheng Chu , Peng He , Hang Li , Haoyu Han , Kaiqi Yang , Yu Xue , Tingting Li , Joseph Krajcik , Jiliang Tang

Naive Retrieval-Augmented Generation (RAG) focuses on individual documents during retrieval and, as a result, falls short in handling networked documents which are very popular in many applications such as citation graphs, social media, and…

Machine Learning · Computer Science 2025-07-15 Yuntong Hu , Zhihan Lei , Zheng Zhang , Bo Pan , Chen Ling , Liang Zhao

Retrieval-Augmented Generation (RAG) methods enhance LLM performance by efficiently filtering relevant context for LLMs, reducing hallucinations and inference cost. However, most existing RAG methods focus on single-step retrieval, which is…

Retrieval-Augmented Generation (RAG) enhances the factual grounding of Large Language Models by conditioning their outputs on external documents. However, standard embedding-based retrievers treat naturally structured corpora, such as…

Information Retrieval · Computer Science 2026-05-11 Giorgia Bolognesi , Claudio Estatico , Ulderico Fugacci , Isabella Mastroianni , Claudio Muselli , Luca Oneto

As retrieval-augmented generation (RAG) tackles complex tasks, increasingly expanded contexts offer richer information, but at the cost of higher latency and increased cognitive load on the model. To mitigate this bottleneck, especially for…

Computation and Language · Computer Science 2026-04-28 Jia-Chen Gu , Junyi Zhang , Di Wu , Yuankai Li , Kai-Wei Chang , Nanyun Peng

Retrieval-augmented generation (RAG) is a framework enabling large language models (LLMs) to enhance their accuracy and reduce hallucinations by integrating external knowledge bases. In this paper, we introduce a hybrid RAG system enhanced…

Computation and Language · Computer Science 2024-09-04 Ye Yuan , Chengwu Liu , Jingyang Yuan , Gongbo Sun , Siqi Li , Ming Zhang

Large Language Models (LLMs) have demonstrated remarkable capabilities in leveraging extensive external knowledge to enhance responses in multi-turn and agentic applications, such as retrieval-augmented generation (RAG). However, processing…

Computation and Language · Computer Science 2025-10-14 Xiaoqiang Lin , Aritra Ghosh , Bryan Kian Hsiang Low , Anshumali Shrivastava , Vijai Mohan

Text embedding and generative tasks are usually trained separately based on large language models (LLMs) nowadays. This causes a large amount of training cost and deployment effort. Context compression is also a challenging and pressing…

Computation and Language · Computer Science 2026-05-13 Zhongtao Miao , Qiyu Wu , Yoshimasa Tsuruoka

Long Context Language Models (LCLMs) have emerged as a new paradigm to perform Information Retrieval (IR), which enables the direct ingestion and retrieval of information by processing an entire corpus in their single context, showcasing…

Information Retrieval · Computer Science 2025-05-29 Minju Seo , Jinheon Baek , Seongyun Lee , Sung Ju Hwang

Retrieval-Augmented Generation (RAG) struggles on long, structured financial filings where relevant evidence is sparse and cross-referenced. This paper presents a systematic investigation of advanced metadata-driven Retrieval-Augmented…

Information Retrieval · Computer Science 2025-10-29 Michail Dadopoulos , Anestis Ladas , Stratos Moschidis , Ioannis Negkakis

Retrieval-Augmented Generation (RAG) has emerged as a powerful approach to mitigate large language model (LLM) hallucinations by incorporating external knowledge retrieval. However, existing RAG frameworks often apply retrieval…

Information Retrieval · Computer Science 2025-07-29 Jinyan Su , Jennifer Healey , Preslav Nakov , Claire Cardie

Retrieval-Augmented Generation (RAG) improves generation quality by incorporating evidence retrieved from large external corpora. However, most existing methods rely on statically selecting top-k passages based on individual relevance,…

Artificial Intelligence · Computer Science 2026-01-09 Yi Jiang , Sendong Zhao , Jianbo Li , Bairui Hu , Yanrui Du , Haochun Wang , Bing Qin

The scaling of inference computation has unlocked the potential of long-context large language models (LLMs) across diverse settings. For knowledge-intensive tasks, the increased compute is often allocated to incorporate more external…

Computation and Language · Computer Science 2025-03-04 Zhenrui Yue , Honglei Zhuang , Aijun Bai , Kai Hui , Rolf Jagerman , Hansi Zeng , Zhen Qin , Dong Wang , Xuanhui Wang , Michael Bendersky

Most conventional Retrieval-Augmented Generation (RAG) pipelines rely on relevance-based retrieval, which often misaligns with utility -- that is, whether the retrieved passages actually improve the quality of the generated text specific to…

Information Retrieval · Computer Science 2026-01-28 Manish Chandra , Debasis Ganguly , Iadh Ounis

Retrieval-Augmented Generation (RAG) has emerged as an important means of enhancing the performance of large language models (LLMs) in knowledge-intensive tasks. However, most existing RAG strategies treat retrieved passages in a flat and…

Computation and Language · Computer Science 2026-04-20 Dongqi Liu , Hang Ding , Qiming Feng , Xurong Xie , Zhucun Xue , Chengjie Wang , Jian Li , Jiangning Zhang , Yabiao Wang