English
Related papers

Related papers: AtomMem : Learnable Dynamic Agentic Memory with At…

200 papers

Real-world artificial intelligence (AI) systems are increasingly required to operate autonomously in dynamic, uncertain, and continuously changing environments. However, most existing AI models rely on predefined objectives, static training…

Artificial Intelligence · Computer Science 2025-11-04 Hong Su

User behavior modeling lies at the heart of personalized applications like recommender systems. With LLM-based agents, user preference representation has evolved from latent embeddings to semantic memory. While existing memory mechanisms…

Information Retrieval · Computer Science 2026-01-27 Yuxin Liao , Le Wu , Min Hou , Yu Wang , Han Wu , Meng Wang

An ideal embodied agent should possess lifelong learning capabilities to handle long-horizon and complex tasks, enabling continuous operation in general environments. This not only requires the agent to accurately accomplish given tasks but…

Artificial Intelligence · Computer Science 2026-03-24 Sen Wang , Bangwei Liu , Zhenkun Gao , Lizhuang Ma , Xuhong Wang , Yuan Xie , Xin Tan

Memory has emerged, and will continue to remain, a core capability of foundation model-based agents. As research on agent memory rapidly expands and attracts unprecedented attention, the field has also become increasingly fragmented.…

Modern LLM-based agents and chat assistants rely on long-term memory frameworks to store reusable knowledge, recall user preferences, and augment reasoning. As researchers create more complex memory architectures, it becomes increasingly…

Machine Learning · Computer Science 2026-05-25 Alina Shutova , Alexandra Olenina , Ivan Vinogradov , Anton Sinitsin

When developing reinforcement learning agents, the standard approach is to train an agent to converge to a fixed policy that is as close to optimal as possible for a single fixed reward function. If different agent behaviour is required in…

Multiagent Systems · Computer Science 2021-01-29 David O'Callaghan , Patrick Mannion

LLM-based agents increasingly rely on long-term memory to support multi-session reasoning and interaction, yet current systems provide little control over what information is retained. In practice, agents either accumulate large volumes of…

Artificial Intelligence · Computer Science 2026-03-06 Guilin Zhang , Wei Jiang , Xiejiashan Wang , Aisha Behr , Kai Zhao , Jeffrey Friedman , Xu Chu , Amine Anoun

Continual learning is considered a promising step towards next-generation Artificial Intelligence (AI), where deep neural networks (DNNs) make decisions by continuously learning a sequence of different tasks akin to human learning…

Machine Learning · Computer Science 2021-05-06 Yuyang Gao , Giorgio A. Ascoli , Liang Zhao

The pursuit of long-term autonomy mandates that machine learning models must continuously adapt to their changing environments and learn to solve new tasks. Continual learning seeks to overcome the challenge of catastrophic forgetting,…

Machine Learning · Computer Science 2024-07-25 Jack Foster , Alexandra Brintrup

As data continues to grow in scale and complexity, preparing, transforming, and analyzing it remains labor-intensive, repetitive, and difficult to scale. Since data contains knowledge and AI learns knowledge from it, the alignment between…

Artificial Intelligence · Computer Science 2025-10-07 Yanjie Fu , Dongjie Wang , Wangyang Ying , Xinyuan Wang , Xiangliang Zhang , Huan Liu , Jian Pei

In the future we can expect that artificial intelligent agents, once deployed, will be required to learn continually from their experience during their operational lifetime. Such agents will also need to communicate with humans and other…

Artificial Intelligence · Computer Science 2021-10-01 David Murphy , Thomas S. Paula , Wagston Staehler , Juliano Vacaro , Gabriel Paz , Guilherme Marques , Bruna Oliveira

Outcome-driven reinforcement learning has advanced reasoning in large language models (LLMs), but prevailing tool-augmented approaches train a single, monolithic policy that interleaves thoughts and tool calls under full context; this…

Artificial Intelligence · Computer Science 2025-10-08 Zhuofeng Li , Haoxiang Zhang , Seungju Han , Sheng Liu , Jianwen Xie , Yu Zhang , Yejin Choi , James Zou , Pan Lu

Memory-augmented Large Language Models (LLMs) are essential for developing capable, long-term AI agents. Recently, applying Reinforcement Learning (RL) to optimize memory operations, such as extraction, updating, and retrieval, has emerged…

Computation and Language · Computer Science 2026-04-08 Ziliang Guo , Ziheng Li , Bo Tang , Feiyu Xiong , Zhiyu Li

Enterprise AI deploys dozens of autonomous agent nodes across workflows, each acting on the same entities with no shared memory and no common governance. We identify five structural challenges arising from this memory governance gap: memory…

Artificial Intelligence · Computer Science 2026-03-19 Hamed Taheri

Recent benchmarks for Large Language Model (LLM) agents primarily focus on evaluating reasoning, planning, and execution capabilities, while another critical component-memory, encompassing how agents memorize, update, and retrieve long-term…

Computation and Language · Computer Science 2026-03-19 Yuanzhe Hu , Yu Wang , Julian McAuley

Agentic code generation requires large language models (LLMs) capable of complex context management and multi-step reasoning. Prior multi-agent frameworks attempt to address these challenges through collaboration, yet they often suffer from…

Software Engineering · Computer Science 2026-01-13 Ming-Tung Shen , Yuh-Jzer Joung

Reinforcement learning agents often forget details of the past, especially after delays or distractor tasks. Agents with common memory architectures struggle to recall and integrate across multiple timesteps of a past event, or even to…

Machine Learning · Computer Science 2021-12-09 Andrew Kyle Lampinen , Stephanie C. Y. Chan , Andrea Banino , Felix Hill

Reinforcement learning has shown great potential in developing high-level autonomous driving. However, for high-dimensional tasks, current RL methods suffer from low data efficiency and oscillation in the training process. This paper…

Machine Learning · Computer Science 2021-02-17 Yuhang Zhang , Yao Mu , Yujie Yang , Yang Guan , Shengbo Eben Li , Qi Sun , Jianyu Chen

Recent benchmarks for Large Language Model (LLM) agents mainly evaluate reasoning, planning, and execution. However, memory is also essential for agents, as it enables them to store, update, and retrieve information over time. This ability…

Computation and Language · Computer Science 2026-05-19 Yuyao Wang , Zhongjian Zhang , Mo Chi , Kaichi Yu , Yuhan Li , Miao Peng , Bing Tong , Chen Zhang , Yan Zhou , Jia Li

In this study, we present a novel paradigm for industrial robotic embodied agents, encapsulating an 'agent as cerebrum, controller as cerebellum' architecture. Our approach harnesses the power of Large Multimodal Models (LMMs) within an…

Robotics · Computer Science 2023-11-28 Haoran Zhao , Fengxing Pan , Huqiuyue Ping , Yaoming Zhou