English
Related papers

Related papers: RMBench: Memory-Dependent Robotic Manipulation Ben…

200 papers

We introduce WritePolicyBench, a benchmark for evaluating memory write policies: decision rules that choose what to store, merge, and evict under a strict byte budget while processing a stream with document/API drift. The benchmark provides…

Performance · Computer Science 2026-02-04 Edgard El Cham

How effectively can LLM-based AI assistants utilize their memory (context) to perform various tasks? Traditional data benchmarks, which are often manually crafted, suffer from several limitations: they are static, susceptible to…

Computation and Language · Computer Science 2025-06-10 Menglin Xia , Victor Ruehle , Saravan Rajmohan , Reza Shokri

As Large Language Models (LLMs) evolve from static dialogue interfaces to autonomous general agents, effective memory is paramount to ensuring long-term consistency. However, existing benchmarks primarily focus on casual conversation or…

Computation and Language · Computer Science 2026-01-13 Haonan Bian , Zhiyuan Yao , Sen Hu , Zishan Xu , Shaolei Zhang , Yifu Guo , Ziliang Yang , Xueran Han , Huacan Wang , Ronghao Chen

Recently, large language model based (LLM-based) agents have been widely applied across various fields. As a critical part, their memory capabilities have captured significant interest from both industrial and academic communities. Despite…

Artificial Intelligence · Computer Science 2025-05-06 Zeyu Zhang , Quanyu Dai , Xu Chen , Rui Li , Zhongyang Li , Zhenhua Dong

Memory-augmented Large Language Models (LLMs) are essential for developing capable, long-term AI agents. Recently, applying Reinforcement Learning (RL) to optimize memory operations, such as extraction, updating, and retrieval, has emerged…

Computation and Language · Computer Science 2026-04-08 Ziliang Guo , Ziheng Li , Bo Tang , Feiyu Xiong , Zhiyu Li

End-to-end learning of robot control policies, structured as neural networks, has emerged as a promising approach to robotic manipulation. To complete many common tasks, relevant objects are required to pass in and out of a robot's field of…

Dexterous manipulation enables robots to purposefully alter the physical world, transforming them from passive observers into active agents in unstructured environments. This capability is the cornerstone of physical artificial…

The growing ambition for space exploration demands robust autonomous systems that can operate in unstructured environments under extreme extraterrestrial conditions. The adoption of robot learning in this domain is severely hindered by the…

Robotics · Computer Science 2025-09-30 Andrej Orsula , Matthieu Geist , Miguel Olivares-Mendez , Carol Martinez

Effective decision-making in the real world depends on memory that is both stable and adaptive: environments change over time, and agents must retain relevant information over long horizons while also updating or overwriting outdated…

Machine Learning · Computer Science 2026-01-22 Oleg Shchendrigin , Egor Cherepanov , Alexey K. Kovalev , Aleksandr I. Panov

Recent progress in Multimodal Large Language Models (MLLMs) has demonstrated remarkable advances in perception and reasoning, suggesting their potential for embodied intelligence. While recent studies have evaluated embodied MLLMs in…

Artificial Intelligence · Computer Science 2026-04-23 Shengyu Guo , Tongrui Ye , Jianbo Zhang , Zicheng Zhang , Chunyi Li , Guangtao Zhai

Recent works use a neuro-symbolic framework for general manipulation policies. The advantage of this framework is that -- by applying off-the-shelf vision and language models -- the robot can break complex tasks down into semantic subtasks.…

Modular robots can be rearranged into a new design, perhaps each day, to handle a wide variety of tasks by forming a customized robot for each new task. However, reconfiguring just the mechanism is not sufficient: each design also requires…

Robotics · Computer Science 2021-11-11 Julian Whitman , Matthew Travers , Howie Choset

Memory is a central capability for LLM agents operating across long-horizon tasks. Existing memory benchmarks predominantly evaluate retention of personalized information in multi-turn chat scenarios, overlooking the dynamic memory…

Computation and Language · Computer Science 2026-05-21 Wujiang Xu , Yu Wang , Kai Mei , Kaiqu Liang , Zhenting Wang , Mingyu Jin , Han Zhang , Shi-Xiong Zhang , Wenyue Hua , Sambit Sahu , Dimitris N. Metaxas

We present a benchmark to facilitate simulated manipulation; an attempt to overcome the obstacles of physical benchmarks through the distribution of a real world, ground truth dataset. Users are given various simulated manipulation tasks…

Robotics · Computer Science 2019-11-28 Jack Collins , Jessie McVicar , David Wedlock , Ross Brown , David Howard , Jürgen Leitner

We introduce LEGOMem, a modular procedural memory framework for multi-agent large language model (LLM) systems in workflow automation. LEGOMem decomposes past task trajectories into reusable memory units and flexibly allocates them across…

Artificial Intelligence · Computer Science 2025-10-07 Dongge Han , Camille Couturier , Daniel Madrigal Diaz , Xuchao Zhang , Victor Rühle , Saravan Rajmohan

In human environments, robots are expected to accomplish a variety of manipulation tasks given simple natural language instructions. Yet, robotic manipulation is extremely challenging as it requires fine-grained motor control, long-term…

Robotics · Computer Science 2022-12-20 Pierre-Louis Guhur , Shizhe Chen , Ricardo Garcia , Makarand Tapaswi , Ivan Laptev , Cordelia Schmid

Long-term memory is fundamental for personalized agents capable of accumulating knowledge, reasoning over user experiences, and adapting across time. However, existing memory benchmarks primarily target declarative memory, specifically…

Long-term conversational memory in practical LLM applications is inherently collaborative: information is produced by multiple participants, scattered across groups and channels, revised over time, and implicitly grounded in roles and…

Computation and Language · Computer Science 2026-03-12 Chuanrui Hu , Tong Li , Xingze Gao , Hongda Chen , Yi Bai , Dannong Xu , Tianwei Lin , Xiaohong Li , Yunyun Han , Jian Pei , Yafeng Deng

Current video benchmarks for multimodal large language models (MLLMs) focus on event recognition, temporal ordering, and long-context recall, but overlook a harder capability required for expert procedural judgment: tracking how ongoing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Xiyang Huang , Jiawei Lin , Keying Wu , Jiaxin Huang , Kailai Yang , Renxiong Wei , Cheng zeng , Jiayi Xiang , Ziyan Kuang , Min Peng , Qianqian Xie , Sophia Ananiadou

Recent benchmarks for Large Language Model (LLM) agents primarily focus on evaluating reasoning, planning, and execution capabilities, while another critical component-memory, encompassing how agents memorize, update, and retrieve long-term…

Computation and Language · Computer Science 2026-03-19 Yuanzhe Hu , Yu Wang , Julian McAuley