English
Related papers

Related papers: Experience-Evolving Multi-Turn Tool-Use Agent with…

200 papers

Reinforcement learning (RL) has substantially improved the ability of large language model (LLM) agents to interact with environments and solve multi-turn tasks. However, effective agentic RL remains challenging: sparse outcome-only rewards…

Many robotic applications require the agent to perform long-horizon tasks in partially observable environments. In such applications, decision making at any step can depend on observations received far in the past. Hence, being able to…

Machine Learning · Computer Science 2019-03-12 Kuan Fang , Alexander Toshev , Li Fei-Fei , Silvio Savarese

Clinical decision-making agents can benefit from reusing prior decision experience. However, many memory-augmented methods store experiences as independent records without explicit relational structure, which may introduce noisy retrieval,…

Artificial Intelligence · Computer Science 2026-03-24 Xiao Han , Yuzheng Fan , Sendong Zhao , Haochun Wang , Bing Qin

Test-time skill evolving is regarded as a new paradigm for enhancing deployed agentic systems. Existing works mainly focus on hard-coded skill evolving strategies or parametric learning that rely on expensive parameter updates in the…

Artificial Intelligence · Computer Science 2026-05-28 Xujun Li , Kehan Zheng , Mingyuan Zhao , Yize Geng , Jinfeng Zhou , Qi Zhu , Fei Mi , Lifeng Shang , Minlie Huang , Hongning Wang

We present a theoretical study of continual and experiential learning in large language model agents that combine episodic memory with reinforcement learning. We argue that the key mechanism for continual adaptation, without updating model…

Artificial Intelligence · Computer Science 2026-01-30 Jun Wang

Task completion in digital and physical environments increasingly involves complex temporal interaction, where actions and observations unfold over different time scales rather than align with fixed observation--action steps. To model such…

Artificial Intelligence · Computer Science 2026-05-13 Jialian Li , Yuchen Cao , Junhong Liu , Weiran Guo , Xutao Wang , Jiaming Song , Jiahao Zhang , Jie Chen

Multi-Agent Reinforcement Learning (MARL) based Multi-Agent Path Finding (MAPF) has recently gained attention due to its efficiency and scalability. Several MARL-MAPF methods choose to use communication to enrich the information one agent…

Multiagent Systems · Computer Science 2024-07-11 Huijie Tang , Federico Berto , Jinkyoo Park

Large language model (LLM)-based agents have shown strong potential in multi-task scenarios, owing to their ability to transfer knowledge across diverse tasks. However, existing approaches often treat prior experiences and knowledge as…

Artificial Intelligence · Computer Science 2025-09-17 Shicheng Ye , Chao Yu , Kaiqiang Ke , Chengdong Xu , Yinqi Wei

Enabling agentic AI systems to adapt their problem-solving approaches based on post-training interactions remains a fundamental challenge. While systems that update and maintain a memory at inference time have been proposed, existing…

Artificial Intelligence · Computer Science 2025-11-17 Adam Stein , Matthew Trager , Benjamin Bowman , Michael Kleinman , Aditya Chattopadhyay , Wei Xia , Stefano Soatto

The Hierarchical Reasoning Model (HRM) has impressive reasoning abilities given its small size, but has only been applied to supervised, static, fully-observable problems. One of HRM's strengths is its ability to adapt its computational…

Artificial Intelligence · Computer Science 2025-10-28 Long H Dang , David Rawlinson

In source memory studies, a decision-maker is concerned with identifying the context in which a given episodic experience occurred. A common paradigm for studying source memory is the `three-list' experimental paradigm, where a subject…

Quantum Physics · Physics 2018-08-24 Jan Broekaert , Jerome Busemeyer

Interactive multi-agent simulation algorithms are used to compute the trajectories and behaviors of different entities in virtual reality scenarios. However, current methods involve considerable parameter tweaking to generate plausible…

Graphics · Computer Science 2018-12-04 Jiaping Ren , Wei Xiang , Yangxi Xiao , Ruigang Yang , Dinesh Manocha , Xiaogang Jin

State of the art deep reinforcement learning algorithms are sample inefficient due to the large number of episodes they require to achieve asymptotic performance. Episodic Reinforcement Learning (ERL) algorithms, inspired by the mammalian…

Machine Learning · Computer Science 2024-06-07 Ismael T. Freire , Adrián F. Amil , Paul F. M. J. Verschure

Transformer-based large language models (LLM) have been widely used in language processing applications. However, due to the memory constraints of the devices, most of them restrict the context window. Even though recurrent models in…

Computation and Language · Computer Science 2025-02-07 Zifan He , Yingqi Cao , Zongyue Qin , Neha Prakriya , Yizhou Sun , Jason Cong

Multi-agents has exhibited significant intelligence in real-word simulations with Large language models (LLMs) due to the capabilities of social cognition and knowledge retrieval. However, existing research on agents equipped with effective…

Artificial Intelligence · Computer Science 2025-04-23 Yajie Yu , Yue Feng

Agents utilizing tools powered by large language models (LLMs) or vision-language models (VLMs) have demonstrated remarkable progress in diverse tasks across text and visual modalities. Unlike traditional tools such as calculators, which…

Computation and Language · Computer Science 2025-10-09 Yunzhong Xiao , Yangmin Li , Hewei Wang , Yunlong Tang , Zora Zhiruo Wang

Reinforcement learning (RL) studies how an agent comes to achieve reward in an environment through interactions over time. Recent advances in machine RL have surpassed human expertise at the world's oldest board games and many classic video…

Artificial Intelligence · Computer Science 2021-07-28 Pedro A. Tsividis , Joao Loula , Jake Burga , Nathan Foss , Andres Campero , Thomas Pouncy , Samuel J. Gershman , Joshua B. Tenenbaum

Understanding and predicting human actions has been a long-standing challenge and is a crucial measure of perception in robotics AI. While significant progress has been made in anticipating the future actions of individual agents, prior…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Zirui Wang , Xinran Zhao , Simon Stepputtis , Woojun Kim , Tongshuang Wu , Katia Sycara , Yaqi Xie

Recent advances in large language models (LLMs) have enabled the development of autonomous agents capable of complex reasoning and multi-step problem solving. However, these agents struggle to adapt to specialized environments and do not…

Machine Learning · Computer Science 2026-04-02 Marc-Antoine Allard , Arnaud Teinturier , Victor Xing , Gautier Viaud

Scientific research follows multi-turn, multi-step workflows that require proactively searching the literature, consulting figures and tables, and integrating evidence across papers to align experimental settings and support reproducible…

Computation and Language · Computer Science 2026-04-08 Xuan Dong , Huanyang Zheng , Tianhao Niu , Zhe Han , Pengzhan Li , Bofei Liu , Zhengyang Liu , Guancheng Li , Qingfu Zhu , Wanxiang Che