English
Related papers

Related papers: BrainMem: Brain-Inspired Evolving Memory for Embod…

200 papers

Large Language Model (LLM) agents are increasingly deployed to automate complex workflows in mobile and desktop environments. However, current model-centric agent architectures struggle to self-evolve post-deployment: improving…

Artificial Intelligence · Computer Science 2025-12-19 Zibin Liu , Cheng Zhang , Xi Zhao , Yunfei Feng , Bingyu Bai , Dahu Feng , Erhu Feng , Yubin Xia , Haibo Chen

While large language models (LLMs) have shown promising capabilities as zero-shot planners for embodied agents, their inability to learn from experience and build persistent mental models limits their robustness in complex open-world…

Artificial Intelligence · Computer Science 2025-06-04 Anirudh Chari , Suraj Reddy , Aditya Tiwari , Richard Lian , Brian Zhou

Agents utilizing tools powered by large language models (LLMs) or vision-language models (VLMs) have demonstrated remarkable progress in diverse tasks across text and visual modalities. Unlike traditional tools such as calculators, which…

Computation and Language · Computer Science 2025-10-09 Yunzhong Xiao , Yangmin Li , Hewei Wang , Yunlong Tang , Zora Zhiruo Wang

The rapid evolution of artificial intelligence (AI) has shifted from static, data-driven models to dynamic systems capable of perceiving and interacting with real-world environments. Despite advancements in pattern recognition and symbolic…

In order to flexibly act in an everyday environment, a robotic agent needs a variety of cognitive capabilities that enable it to reason about plans and perform execution recovery. Large language models (LLMs) have been shown to demonstrate…

Robotics · Computer Science 2026-03-04 Shinas Shaji , Fabian Huppertz , Alex Mitrevski , Sebastian Houben

Long-term memory is essential for large language model (LLM) agents operating in complex environments, yet existing memory designs are either task-specific and non-transferable, or task-agnostic but less effective due to low task-relevance…

Computation and Language · Computer Science 2026-03-05 Ke Yang , Zixi Chen , Xuan He , Jize Jiang , Michel Galley , Chenglong Wang , Jianfeng Gao , Jiawei Han , ChengXiang Zhai

While Large Language Models (LLMs) have demonstrated strong zero-shot reasoning capabilities, their deployment as embodied agents still faces fundamental challenges in long-horizon planning. Unlike open-ended text generation, embodied…

Computation and Language · Computer Science 2026-05-19 Xiang Li , Ning Yan , Masood Mortazavi

Recent advancements in Large Language Models (LLMs) and Vision-Language Models (VLMs) have made them powerful tools in embodied navigation, enabling agents to leverage commonsense and spatial reasoning for efficient exploration in…

We introduce EMemBench, a programmatic benchmark for evaluating long-term memory of agents through interactive games. Rather than using a fixed set of questions, EMemBench generates questions from each agent's own trajectory, covering both…

Computation and Language · Computer Science 2026-01-26 Xinze Li , Ziyue Zhu , Siyuan Liu , Yubo Ma , Yuhang Zang , Yixin Cao , Aixin Sun

Recent advancements in Large Language Models (LLMs) have spurred numerous attempts to apply these technologies to embodied tasks, particularly focusing on high-level task planning and task decomposition. To further explore this area, we…

Modern LLM-based agents and chat assistants rely on long-term memory frameworks to store reusable knowledge, recall user preferences, and augment reasoning. As researchers create more complex memory architectures, it becomes increasingly…

Machine Learning · Computer Science 2026-05-25 Alina Shutova , Alexandra Olenina , Ivan Vinogradov , Anton Sinitsin

As embodied agents operate in increasingly complex environments, the ability to perceive, track, and reason about individual object instances over time becomes essential, especially in tasks requiring sequenced interactions with visually…

Recent benchmarks for Large Language Model (LLM) agents mainly evaluate reasoning, planning, and execution. However, memory is also essential for agents, as it enables them to store, update, and retrieve information over time. This ability…

Computation and Language · Computer Science 2026-05-19 Yuyao Wang , Zhongjian Zhang , Mo Chi , Kaichi Yu , Yuhan Li , Miao Peng , Bing Tong , Chen Zhang , Yan Zhou , Jia Li

Large language models (LLMs) are increasingly being adopted as the cognitive core of embodied agents. However, inherited hallucinations, which stem from failures to ground user instructions in the observed physical environment, can lead to…

The EmbodiedQA is a task of training an embodied agent by intelligently navigating in a simulated environment and gathering visual information to answer questions. Existing approaches fail to explicitly model the mental imagery function of…

Computer Vision and Pattern Recognition · Computer Science 2019-08-06 Juncheng Li , Siliang Tang , Fei Wu , Yueting Zhuang

Although long-term memory systems have made substantial progress in recent years, they still exhibit clear limitations in adaptability, scalability, and self-evolution under continuous interaction settings. Inspired by cognitive theories,…

Artificial Intelligence · Computer Science 2026-01-13 Ningning Zhang , Xingxing Yang , Zhizhong Tan , Weiping Deng , Wenyong Wang

Embodied agents tasked with complex scenarios, whether in real or simulated environments, rely heavily on robust planning capabilities. When instructions are formulated in natural language, large language models (LLMs) equipped with…

Multimodal large language model (MLLM)-based embodied agents have shown strong potential for solving complex tasks in physical environments. However, personalized assistance requires more than following generic instruction or recognizing…

Artificial Intelligence · Computer Science 2026-05-27 Jeongeun Lee , Chanyoung Park , Dongha Lee

Recent advances in Large Language Models (LLMs) have shown inspiring achievements in constructing autonomous agents that rely on language descriptions as inputs. However, it remains unclear how well LLMs can function as few-shot or…

Computation and Language · Computer Science 2024-06-25 Zixia Jia , Mengmeng Wang , Baichen Tong , Song-Chun Zhu , Zilong Zheng

Embodied AI focuses on the study and development of intelligent systems that possess a physical or virtual embodiment (i.e. robots) and are able to dynamically interact with their environment. Memory and control are the two essential parts…

Artificial Intelligence · Computer Science 2023-06-13 Jinjie Mai , Jun Chen , Bing Li , Guocheng Qian , Mohamed Elhoseiny , Bernard Ghanem