English
Related papers

Related papers: Ask Only When Needed: Proactive Retrieval from Mem…

200 papers

While passive agents merely follow instructions, proactive agents align with higher-level objectives, such as assistance and safety by continuously monitoring the environment to determine when and how to act. However, developing proactive…

Multimodal large language models (MLLMs) have made significant progress in mobile agent development, yet their capabilities are predominantly confined to a reactive paradigm, where they merely execute explicit user commands. The emerging…

Large Language Models (LLMs) often falter in complex reasoning tasks due to their static, parametric knowledge, leading to hallucinations and poor performance in specialized domains like mathematics. This work explores a fundamental…

Machine Learning · Computer Science 2026-02-10 Srijan Shakya , Anamaria-Roberta Hartl , Sepp Hochreiter , Korbinian Pöppel

Multi-agents has exhibited significant intelligence in real-word simulations with Large language models (LLMs) due to the capabilities of social cognition and knowledge retrieval. However, existing research on agents equipped with effective…

Artificial Intelligence · Computer Science 2025-04-23 Yajie Yu , Yue Feng

To tackle long-context reasoning tasks without the quadratic complexity of standard attention mechanisms, approaches based on agent memory have emerged, which typically maintain a dynamically updated memory when linearly processing document…

Computation and Language · Computer Science 2026-05-12 Baibei Ji , Xiaoyang Weng , Juntao Li , Zecheng Tang , Yihang Lou , Min Zhang

Retrieval-Augmented Generation (RAG) has significantly enhanced LLMs by incorporating external information. However, prevailing agentic RAG approaches are constrained by a critical limitation: they treat the retrieval process as a black-box…

Information Retrieval · Computer Science 2026-02-27 Yulong Hui , Chao Chen , Zhihang Fu , Yihao Liu , Jieping Ye , Huanchen Zhang

Understanding the behavior of deep reinforcement learning (DRL) agents -particularly as task and agent sophistication increase- requires more than simple comparison of reward curves, yet standard methods for behavioral analysis remain…

Artificial Intelligence · Computer Science 2025-12-02 Riley Simmons-Edler , Ryan P. Badman , Felix Baastad Berg , Raymond Chua , John J. Vastola , Joshua Lunger , William Qian , Kanaka Rajan

Large language model agents often fail to accumulate knowledge from experience, treating each task as an independent challenge. Recent methods extract experience as flattened textual knowledge, which cannot capture procedural logic of…

Artificial Intelligence · Computer Science 2026-02-02 Libin Qiu , Zhirong Gao , Junfu Chen , Yuhang Ye , Weizhi Huang , Xiaobo Xue , Wenkai Qiu , Shuo Tang

Large Language Model (LLM) Agents have recently garnered increasing interest yet they are limited in their ability to learn from trial and error, a key element of intelligent behavior. In this work, we argue that the capacity to learn new…

Artificial Intelligence · Computer Science 2024-08-09 Haiteng Zhao , Chang Ma , Guoyin Wang , Jing Su , Lingpeng Kong , Jingjing Xu , Zhi-Hong Deng , Hongxia Yang

Developing robotic agents that can perform well in diverse environments while showing a variety of behaviors is a key challenge in AI and robotics. Traditional reinforcement learning (RL) methods often create agents that specialize in…

Robotics · Computer Science 2025-03-25 Octi Zhang , Quanquan Peng , Rosario Scalise , Bryon Boots

There has recently been growing interest in conversational agents with long-term memory which has led to the rapid development of language models that use retrieval-augmented generation (RAG). Until recently, most work on RAG has focused on…

Computation and Language · Computer Science 2024-06-06 Nick Alonso , Tomás Figliolia , Anthony Ndirango , Beren Millidge

LLM-powered agents face a persistent challenge: learning from their execution experiences to improve future performance. While agents can successfully complete many tasks, they often repeat inefficient patterns, fail to recover from similar…

Artificial Intelligence · Computer Science 2026-03-12 Gaodan Fang , Vatche Isahagian , K. R. Jayaram , Ritesh Kumar , Vinod Muthusamy , Punleuk Oum , Gegi Thomas

Sample-efficient online reinforcement learning often uses replay buffers to store experience for reuse when updating the value function. However, uniform replay is inefficient, since certain classes of transitions can be more relevant to…

Machine Learning · Computer Science 2025-05-12 Renhao Wang , Kevin Frans , Pieter Abbeel , Sergey Levine , Alexei A. Efros

Agentic reinforcement learning (RL) holds great promise for the development of autonomous agents under complex GUI tasks, but its scalability remains severely hampered by the verification of task completion. Existing task verification is…

Computation and Language · Computer Science 2026-01-07 Shaofei Cai , Yulei Qin , Haojia Lin , Zihan Xu , Gang Li , Yuchen Shi , Zongyi Li , Yong Mao , Siqi Cai , Xiaoyu Tan , Yitao Liang , Ke Li , Xing Sun

While large language models (LLMs) have advanced the development of general-purpose agents, achieving robust generalization to unseen tasks remains a significant challenge. Current approaches typically rely on either fine-tuning or…

Artificial Intelligence · Computer Science 2026-03-20 Thomas Palmeira Ferraz , Romain Deffayet , Vassilina Nikoulina , Hervé Déjean , Stéphane Clinchant

Lifelong learning is a long-standing aim for artificial agents that act in dynamic environments, in which an agent needs to accumulate knowledge incrementally without forgetting previously learned representations. We investigate methods for…

Machine Learning · Computer Science 2021-11-17 Vadym Gryshchuk , Cornelius Weber , Chu Kiong Loo , Stefan Wermter

Current context augmentation methods, such as retrieval-augmented generation, are essential for solving knowledge-intensive reasoning tasks. However, they typically adhere to a rigid, brute-force strategy that executes retrieval at every…

Computation and Language · Computer Science 2026-01-15 Rubing Chen , Jian Wang , Wenjie Li , Xiao-Yong Wei , Qing Li

Reinforcement learning (RL) has achieved impressive performance in a variety of online settings in which an agent's ability to query the environment for transitions and rewards is effectively unlimited. However, in many practical…

Machine Learning · Computer Science 2021-05-06 Anurag Ajay , Aviral Kumar , Pulkit Agrawal , Sergey Levine , Ofir Nachum

Proactive large language model (LLM) agents aim to actively plan, query, and interact over multiple turns, enabling efficient task completion beyond passive instruction following and making them essential for real-world, user-centric…

Artificial Intelligence · Computer Science 2026-02-13 Yihang Yao , Zhepeng Cen , Haohong Lin , Shiqi Liu , Zuxin Liu , Jiacheng Zhu , Zhang-Wei Hong , Laixi Shi , Ding Zhao

Lifelong interactive agents are expected to assist users over months or years, which requires continually writing long term memories while retrieving the right evidence for each new query under fixed context and latency budgets. Existing…

Information Retrieval · Computer Science 2026-03-23 Can Lv , Heng Chang , Yuchen Guo , Shengyu Tao , Shiji Zhou