English
Related papers

Related papers: ARC: Active and Reflection-driven Context Manageme…

200 papers

Reinforcement Learning (RL) has emerged as a critical driver for enhancing the reasoning capabilities of Large Language Models (LLMs). While recent advancements have focused on reward engineering or data synthesis, few studies exploit the…

Machine Learning · Computer Science 2026-04-17 Bowen Ping , Zijun Chen , Tingfeng Hui , Qize Yu , Chenxuan Li , Junchi Yan , Baobao Chang

Robust content moderation requires classification systems that can quickly adapt to evolving policies without costly retraining. We present classification using Retrieval-Augmented Generation (RAG), which shifts traditional classification…

Computation and Language · Computer Science 2025-08-11 Richard Willats , Josh Pennington , Aravind Mohan , Bertie Vidgen

Despite the popularity of retrieval-augmented generation (RAG) as a solution for grounded QA in both academia and industry, current RAG methods struggle with questions where the necessary information is distributed across many documents or…

Computation and Language · Computer Science 2025-11-11 Nathan Scales , Nathanael Schärli , Olivier Bousquet

Designing high-performance system heuristics is a creative, iterative process requiring experts to form hypotheses and execute multi-step conceptual shifts. While Large Language Models (LLMs) show promise in automating this loop, they…

Artificial Intelligence · Computer Science 2026-03-24 Pantea Karimi , Kimia Noorbakhsh , Mohammad Alizadeh , Hari Balakrishnan

We present a new benchmark for evaluating Deep Search--a realistic and complex form of retrieval-augmented generation (RAG) that requires source-aware, multi-hop reasoning over diverse, sparsed, but related sources. These include documents,…

Computation and Language · Computer Science 2025-07-01 Prafulla Kumar Choubey , Xiangyu Peng , Shilpa Bhagavath , Kung-Hsiang Huang , Caiming Xiong , Chien-Sheng Wu

Autonomous LLM agents increasingly operate in long-horizon, interactive settings where success depends on reusing experience accumulated over extended histories. However, existing agent memory systems are fundamentally constrained by…

Computation and Language · Computer Science 2026-04-30 Jinze Li , Yang Zhang , Xin Yang , Jiayi Qu , Jinfeng Xu , Shuo Yang , Junhua Ding , Edith Cheuk-Han Ngai

Architecture Decision Records (ADRs) play a critical role in preserving the rationale behind system design, yet their creation and maintenance are often neglected due to the associated authoring overhead. This paper investigates whether…

Software Engineering · Computer Science 2026-04-16 Aviral Gupta , Rudra Dhar , Daniel Feitosa , Karthik Vaidhyanathan

Goal-oriented proactive dialogue systems are designed to guide user conversations seamlessly towards specific objectives by planning a goal-oriented path. However, previous research has focused predominantly on optimizing these paths while…

Computation and Language · Computer Science 2025-06-19 Didi Zhang , Yaxin Fan , Peifeng Li , Qiaoming Zhu

General-purpose automatic speech recognition (ASR) systems do not always perform well in goal-oriented dialogue. Existing ASR correction methods rely on prior user data or named entities. We extend correction to tasks that have no prior…

Computation and Language · Computer Science 2025-01-13 Yuya Asano , Sabit Hassan , Paras Sharma , Anthony Sicilia , Katherine Atwell , Diane Litman , Malihe Alikhani

Retrieval-Augmented Generation (RAG) grounds large language model outputs in external evidence, but remains challenged on multi-hop question answering that requires long reasoning. Recent works scale RAG at inference time along two…

Large language model agents rely on effective model context to obtain task-relevant information for decision-making. Many existing context engineering approaches primarily rely on the context generated from the past experience and retrieval…

Artificial Intelligence · Computer Science 2026-04-10 Linbo Liu , Guande Wu , Han Ding , Yawei Wang , Qiang Zhou , Yuzhe Lu , Zhichao Xu , Huan Song , Panpan Xu , Lin Lee Cheong

Reinforcement Learning (RL) techniques have drawn great attention in many challenging tasks, but their performance deteriorates dramatically when applied to real-world problems. Various methods, such as domain randomization, have been…

Machine Learning · Computer Science 2022-08-05 Wangyang Yue , Yuan Zhou , Xiaochuan Zhang , Yuchen Hua , Zhiyuan Wang , Guang Kou

Long-horizon enterprise agents make high-stakes decisions (loan underwriting, claims adjudication, clinical review, prior authorization) under lossy memory, multi-step reasoning, and binding regulatory constraints. Current evaluation…

Artificial Intelligence · Computer Science 2026-04-22 Vasundra Srininvasan

Retrieval-Augmented Generation (RAG) helps LLMs stay accurate, but feeding long documents into a prompt makes the model slow and expensive. This has motivated context compression, ranging from token pruning and summarization to…

Computation and Language · Computer Science 2026-01-09 Jianbo Li , Yi Jiang , Sendong Zhao , Bairui Hu , Haochun Wang , Bing Qin

Recent advances in Large Language Models (LLMs) and multimodal foundation models have significantly broadened their application in robotics and collaborative systems. However, effective multi-agent interaction necessitates robust…

Abstractive compression utilizes smaller langauge models to condense query-relevant context, reducing computational costs in retrieval-augmented generation (RAG). However,retrieved documents often include information that is either…

Computation and Language · Computer Science 2025-11-19 Singon Kim , Gunho Jung , Seong-Whan Lee

This paper focuses on the dynamic optimization of the Retrieval-Augmented Generation (RAG) architecture. It proposes a state-aware dynamic knowledge retrieval mechanism to enhance semantic understanding and knowledge scheduling efficiency…

Computation and Language · Computer Science 2025-04-29 Jacky He , Guiran Liu , Binrong Zhu , Hanlu Zhang , Hongye Zheng , Xiaokai Wang

Vision-language models (VLMs) have demonstrated remarkable capabilities in robotic planning, particularly for long-horizon tasks that require a holistic understanding of the environment for task decomposition. Existing methods typically…

Robotics · Computer Science 2025-03-31 Puzhen Yuan , Angyuan Ma , Yunchao Yao , Huaxiu Yao , Masayoshi Tomizuka , Mingyu Ding

Large Language Models (LLMs) suffer from significant performance degradation when processing long contexts due to proactive interference, where irrelevant information in earlier parts of the context disrupts reasoning and memory recall.…

Computation and Language · Computer Science 2025-09-30 Mo Li , L. H. Xu , Qitai Tan , Long Ma , Ting Cao , Yunxin Liu

Retrieval-Augmented Generation (RAG) systems commonly suffer from Knowledge Conflicts, where retrieved external knowledge contradicts the inherent, parametric knowledge of large language models (LLMs). It adversely affects performance on…

Computation and Language · Computer Science 2025-10-07 Nan Huo , Jinyang Li , Bowen Qin , Ge Qu , Xiaolong Li , Xiaodong Li , Chenhao Ma , Reynold Cheng
‹ Prev 1 3 4 5 6 7 10 Next ›