English
Related papers

Related papers: Ask Only When Needed: Proactive Retrieval from Mem…

200 papers

Modern analytics systems are fundamentally reactive, requiring users to define queries over increasingly complex and continuously evolving data. In real-time streaming environments, this paradigm breaks down, as the space of potential…

Artificial Intelligence · Computer Science 2026-05-28 Gaetano Rossiello , Dharmashankar Subramanian

Student simulation in online education is important to address dynamic learning behaviors of students with diverse backgrounds. Existing simulation models based on deep learning usually need massive training data, lacking prior knowledge in…

Computers and Society · Computer Science 2024-04-12 Songlin Xu , Xinyu Zhang , Lianhui Qin

To quickly solve new tasks in complex environments, intelligent agents need to build up reusable knowledge. For example, a learned world model captures knowledge about the environment that applies to new tasks. Similarly, skills capture…

Machine Learning · Computer Science 2021-05-04 Kevin Xie , Homanga Bharadhwaj , Danijar Hafner , Animesh Garg , Florian Shkurti

Model editing aims to correct outdated or erroneous knowledge in large language models (LLMs) without the need for costly retraining. Lifelong model editing is the most challenging task that caters to the continuous editing requirements of…

Computation and Language · Computer Science 2025-03-17 Qizhou Chen , Taolin Zhang , Xiaofeng He , Dongyang Li , Chengyu Wang , Longtao Huang , Hui Xue

Every agent interaction generates a next-state signal, namely the user reply, tool output, terminal or GUI state change that follows each action, yet no existing agentic RL system recovers it as a live, online learning source. We present…

Computation and Language · Computer Science 2026-05-12 Yinjie Wang , Xuyang Chen , Xiaolong Jin , Mengdi Wang , Ling Yang

Exploration efficiency is a challenging problem in multi-agent reinforcement learning (MARL), as the policy learned by confederate MARL depends on the collaborative approach among multiple agents. Another important problem is the less…

Machine Learning · Computer Science 2019-12-30 Qisheng Wang , Qichao Wang

LLM agents require retrieval to behave less like one-shot context fetching and more like reasoning: searching, reading, traversing, and deciding when evidence is sufficient. Yet current Retrieval-Augmented Generation (RAG) systems organize…

Computation and Language · Computer Science 2026-05-27 Haoliang Ming , Feifei Li , Xiaoqing Wu , Wenhui Que

Effective memory management is essential for large language model (LLM) agents handling long-term interactions. Current memory frameworks typically treat agents as passive "recorders" and retrieve information without understanding its…

Computation and Language · Computer Science 2026-03-03 Xiaohui Zhang , Zequn Sun , Chengyuan Yang , Yaqin Jin , Yazhong Zhang , Wei Hu

Developing autonomous agents that quickly explore an environment and adapt their behavior online is a canonical challenge in robotics and machine learning. While humans are able to achieve such fast online exploration and adaptation, often…

Machine Learning · Computer Science 2025-07-15 Andrew Wagenmaker , Zhiyuan Zhou , Sergey Levine

Reinforcement learning with verifiable rewards (RLVR) has proven effective in eliciting complex reasoning in large language models (LLMs). However, standard RLVR training often leads to excessively verbose processes (in reasoning tasks) and…

Artificial Intelligence · Computer Science 2025-10-01 Gang Li , Yulei Qin , Xiaoyu Tan , Dingkang Yang , Yuchen Shi , Zihan Xu , Xiang Li , Xing Sun , Ke Li

Large Language Models (LLMs) have shown remarkable advancements in tackling agent-oriented tasks. Despite their potential, existing work faces challenges when deploying LLMs in agent-based environments. The widely adopted agent paradigm…

Computation and Language · Computer Science 2026-01-08 Keer Lu , Chong Chen , Xili Wang , Bin Cui , Yunhuai Liu , Wentao Zhang

Search-augmented reasoning agents interleave multi-step reasoning with external information retrieval, but uncontrolled retrieval often leads to redundant evidence, context saturation, and unstable learning. Existing approaches rely on…

Computation and Language · Computer Science 2026-02-03 Siheng Xiong , Oguzhan Gungordu , Blair Johnson , James C. Kerce , Faramarz Fekri

Proactive dialogue has emerged as a critical and challenging research problem in advancing large language models (LLMs). Existing works predominantly focus on domain-specific or task-oriented scenarios, which leads to fragmented evaluations…

Computation and Language · Computer Science 2025-08-29 Tianjian Liu , Fanqi Wan , Jiajian Guo , Xiaojun Quan

A semantic gap separates how users describe tasks from how tools are documented. As API ecosystems scale to tens of thousands of endpoints, static retrieval from the initial query alone cannot bridge this gap: the agent's understanding of…

Artificial Intelligence · Computer Science 2026-05-05 Kyle Zheng , Han Zhang , Renliang Sun , Chenchen Ye , Wei Wang

Reinforcement Learning (RL) enables an intelligent agent to optimise its performance in a task by continuously taking action from an observed state and receiving a feedback from the environment in form of rewards. RL typically uses tables…

Artificial Intelligence · Computer Science 2025-01-28 Alberto Castagna

Multimodal Retrieval-Augmented Generation (mRAG) has emerged as a promising solution to address the temporal limitations of Multimodal Large Language Models (MLLMs) in real-world scenarios like news analysis and trending topics. However,…

Artificial Intelligence · Computer Science 2025-08-13 Yuechen Wang , Yuming Qiao , Dan Meng , Jun Yang , Haonan Lu , Zhenyu Yang , Xudong Zhang

Reinforcement learning is a powerful approach to learn behaviour through interactions with an environment. However, behaviours are usually learned in a purely reactive fashion, where an appropriate action is selected based on an…

Machine Learning · Computer Science 2021-06-10 André Biedenkapp , Raghu Rajan , Frank Hutter , Marius Lindauer

This paper proposes EvoAgent - an evolvable large language model (LLM) agent framework that integrates structured skill learning with a hierarchical sub-agent delegation mechanism. EvoAgent models skills as multi-file structured capability…

Artificial Intelligence · Computer Science 2026-04-27 Aimin Zhang , Jiajing Guo , Fuwei Jia , Chen Lv , Boyu Wang , Fangzheng Li

As large language models (LLMs) become increasingly integrated into daily life, there is growing demand for AI assistants that are not only reactive but also proactive and personalized. While recent advances have pushed forward proactivity…

Computation and Language · Computer Science 2026-02-24 Jiho Kim , Junseong Choi , Woosog Chay , Daeun Kyung , Yeonsu Kwon , Yohan Jo , Edward Choi

Large Language Models (LLMs) and other foundation models are increasingly used as the core of AI agents. In agentic workflows, these agents plan tasks, interact with humans and peers, and influence scientific outcomes across federated and…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-21 Renan Souza , Amal Gueroudji , Stephen DeWitt , Daniel Rosendo , Tirthankar Ghosal , Robert Ross , Prasanna Balaprakash , Rafael Ferreira da Silva