English
Related papers

Related papers: Memo: Training Memory-Efficient Embodied Agents wi…

200 papers

In this paper we take the first steps in studying a new approach to synthesis of efficient communication schemes in multi-agent systems, trained via reinforcement learning. We combine symbolic methods with machine learning, in what is…

Artificial Intelligence · Computer Science 2022-12-29 Erik Jergéus , Leo Karlsson Oinonen , Emil Carlsson , Moa Johansson

Equipping agents with memory is essential for solving real-world long-horizon problems. However, most existing agent memory mechanisms rely on static and hand-crafted workflows. This limits the performance and generalization ability of…

Artificial Intelligence · Computer Science 2026-03-30 Yupeng Huo , Yaxi Lu , Zhong Zhang , Haotian Chen , Yankai Lin

Large Language Model (LLM) agents have demonstrated remarkable proficiency in learned tasks, yet they often struggle to adapt to non-stationary environments with feedback. While In-Context Learning and external memory offer some…

Artificial Intelligence · Computer Science 2026-03-05 Lu Yang , Zelai Xu , Minyang Xie , Jiaxuan Gao , Zhao Shok , Yu Wang , Yi Wu

Computational agents support humans in many areas of life and are therefore found in heterogeneous contexts. This means they operate in rapidly changing environments and can be confronted with huge state and action spaces. In order to…

Artificial Intelligence · Computer Science 2023-08-31 Nicole Merkle , Ralf Mikut

The ability to simulate the effects of future actions on the world is a crucial ability of intelligent embodied agents, enabling agents to anticipate the effects of their actions and make plans accordingly. While a large body of existing…

Computer Vision and Pattern Recognition · Computer Science 2025-05-12 Siyuan Zhou , Yilun Du , Yuncong Yang , Lei Han , Peihao Chen , Dit-Yan Yeung , Chuang Gan

People have to remember an ever-expanding volume of information. Wearables that use information capture and retrieval for memory augmentation can help but can be disruptive and cumbersome in real-world tasks, such as in social settings. To…

Human-Computer Interaction · Computer Science 2024-03-05 Wazeer Zulfikar , Samantha Chan , Pattie Maes

While reinforcement learning has achieved considerable successes in recent years, state-of-the-art models are often still limited by the size of state and action spaces. Model-free reinforcement learning approaches use some form of state…

Machine Learning · Computer Science 2021-08-23 Paul J. Pritz , Liang Ma , Kin K. Leung

As robotics continues to advance, the need for adaptive and continuously-learning embodied agents increases, particularly in the realm of assistance robotics. Quick adaptability and long-term information retention are essential to operate…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Paolo Cudrano , Xiaoyu Luo , Matteo Matteucci

Recent studies have uncovered the potential of Large Language Models (LLMs) in addressing complex sequential decision-making tasks through the provision of high-level instructions. However, LLM-based agents lack specialization in tackling…

Artificial Intelligence · Computer Science 2024-05-28 Zihao Zhou , Bin Hu , Chenyang Zhao , Pu Zhang , Bin Liu

Memory is a central capability for LLM agents operating across long-horizon tasks. Existing memory benchmarks predominantly evaluate retention of personalized information in multi-turn chat scenarios, overlooking the dynamic memory…

Computation and Language · Computer Science 2026-05-21 Wujiang Xu , Yu Wang , Kai Mei , Kaiqu Liang , Zhenting Wang , Mingyu Jin , Han Zhang , Shi-Xiong Zhang , Wenyue Hua , Sambit Sahu , Dimitris N. Metaxas

Embodied agents, such as robots and virtual characters, must continuously select actions to execute tasks effectively, solving complex sequential decision-making problems. Given the difficulty of designing such controllers manually,…

Robotics · Computer Science 2026-05-18 Pedro Santana

Reinforcement learning (RL) agents often suffer from high sample complexity in sparse or delayed reward settings due to limited prior structure. Large language models (LLMs) can provide subgoal decompositions, plausible trajectories, and…

Machine Learning · Computer Science 2026-02-23 Narjes Nourzad , Carlee Joe-Wong

Current model-based reinforcement learning (MBRL) agents struggle with long-term dependencies. This limits their ability to effectively solve tasks involving extended time gaps between actions and outcomes, or tasks demanding the recalling…

Machine Learning · Computer Science 2024-03-08 Mohammad Reza Samsami , Artem Zholus , Janarthanan Rajendran , Sarath Chandar

Reinforcement learning is a machine learning approach based on behavioral psychology. It is focused on learning agents that can acquire knowledge and learn to carry out new tasks by interacting with the environment. However, a problem…

Artificial Intelligence · Computer Science 2022-12-15 Hugo Muñoz , Ernesto Portugal , Angel Ayala , Bruno Fernandes , Francisco Cruz

Large language models (LLMs) have recently emerged as promising tools for solving challenging robotic tasks, even in the presence of action and observation uncertainties. Recent LLM-based decision-making methods (also referred to as…

Artificial Intelligence · Computer Science 2024-09-20 Abhinav Jain , Chris Jermaine , Vaibhav Unhelkar

Reinforcement Learning (RL) has traditionally focused on training specialized agents to optimize predefined reward functions within narrowly defined environments. However, the advent of powerful Large Language Models (LLMs) and increasingly…

Artificial Intelligence · Computer Science 2026-05-18 Fangming Cui , Ruixiao Zhu , Cheng Fang , Sunan Li , Jiahong Li

Recent advances in large language models (LLMs) and autonomous agents have enabled systems capable of performing complex tasks across domains such as human-computer interaction, planning, and web navigation. However, many existing…

Artificial Intelligence · Computer Science 2025-07-22 Hongyi Yang , Yue Pan , Jiayi Xu , Kelsen Liu

Recent advances in embodied AI highlight the potential of vision language models (VLMs) as agents capable of perception, reasoning, and interaction in complex environments. However, top-performing systems rely on large-scale models that are…

Existing memory systems for embodied agents typically inject retrieved memory as static context at episode start, a paradigm we term Ahead-of-time Monolithic Memory Injection (AMMI). However, this static design quickly becomes misaligned…

Robotics · Computer Science 2026-05-15 Xin Ding , Xinrui Wang , Yifan Yang , Hao Wu , Shiqi Jiang , Qianxi Zhang , Liang Mi , Hanxin Zhu , Kun Li , Yunxin Liu , Zhibo Chen , Ting Cao

We present an embodied robotic system with an LLM-driven agent-orchestration architecture for autonomous household object management. The system integrates memory-augmented task planning, enabling robots to execute high-level user commands…

Robotics · Computer Science 2025-05-01 Marc Glocker , Peter Hönig , Matthias Hirschmanner , Markus Vincze