English
Related papers

Related papers: RMBench: Memory-Dependent Robotic Manipulation Ben…

200 papers

Vision-language-action (VLA) models for closed-loop robot control are typically cast under the Markov assumption, making them prone to errors on tasks requiring historical context. To incorporate memory, existing VLAs either retrieve from a…

Robotics · Computer Science 2026-03-16 Hang Li , Fengyi Shen , Dong Chen , Liudi Yang , Xudong Wang , Jinkui Shi , Zhenshan Bing , Ziyuan Liu , Alois Knoll

Workforce optimization plays a crucial role in efficient organizational operations where decision-making may span several different administrative and time scales. For instance, dispatching personnel to immediate service requests while…

Artificial Intelligence · Computer Science 2025-03-04 Kareem Eissa , Rayal Prasad , Sarith Mohan , Ankur Kapoor , Dorin Comaniciu , Vivek Singh

While reinforcement learning has been increasingly applied to stochastic control, few studies have systematically examined policy-based methods in queuing environments modeled as a semi-Markov decision process (SMDP). To address this gap,…

Optimization and Control · Mathematics 2026-04-28 Joseph Walton , Gabriel Nicolosi

Despite recent advances in understanding and leveraging long-range conversational memory, existing benchmarks still lack systematic evaluation of large language models(LLMs) across diverse memory dimensions, particularly in multi-session…

Computation and Language · Computer Science 2026-01-08 Ye Shen , Dun Pei , Yiqiu Guo , Junying Wang , Yijin Guo , Zicheng Zhang , Qi Jia , Jun Zhou , Guangtao Zhai

Local motion planning is a heavily researched topic in the field of robotics with many promising algorithms being published every year. However, it is difficult and time-consuming to compare different methods in the field. In this paper, we…

Robotics · Computer Science 2022-10-13 Max Spahn , Chadi Salmi , Javier Alonso-Mora

Teams of people coordinate to perform complex tasks by forming abstract mental models of world and agent dynamics. The use of abstract models contrasts with much recent work in robot learning that uses a high-fidelity simulator and…

Robotics · Computer Science 2025-03-10 Adam Labiosa , Josiah P. Hanna

Driven by inherent uncertainty and the sim-to-real gap, robust reinforcement learning (RL) seeks to improve resilience against the complexity and variability in agent-environment sequential interactions. Despite the existence of a large…

Machine Learning · Computer Science 2025-02-28 Shangding Gu , Laixi Shi , Muning Wen , Ming Jin , Eric Mazumdar , Yuejie Chi , Adam Wierman , Costas Spanos

Recent advances in mathematical reasoning and the long-term planning capabilities of large language models (LLMs) have precipitated the development of agents, which are being increasingly leveraged in business operations processes. Decision…

Artificial Intelligence · Computer Science 2025-08-18 Xuhua Zhao , Yuxuan Xie , Caihua Chen , Yuxiang Sun

Reinforcement learning (RL) is a branch of machine learning which is employed to solve various sequential decision making problems without proper supervision. Due to the recent advancement of deep learning, the newly proposed Deep-RL…

Artificial Intelligence · Computer Science 2019-04-17 Dhruv Ramani

Mobile robots are increasingly deployed in cluttered environments with movable objects, posing challenges for traditional methods that prohibit interaction. In such settings, the mobile robot must go beyond traditional obstacle avoidance,…

Robotics · Computer Science 2025-12-15 Ninghan Zhong , Steven Caro , Megnath Ramesh , Rishi Bhatnagar , Avraiem Iskandar , Stephen L. Smith

Deep reinforcement learning produces robust locomotion policies for legged robots over challenging terrains. To date, few studies have leveraged model-based methods to combine these locomotion skills with the precise control of…

Robotics · Computer Science 2022-01-12 Yuntao Ma , Farbod Farshidian , Takahiro Miki , Joonho Lee , Marco Hutter

LMMs have shown impressive visual understanding capabilities, with the potential to be applied in agents, which demand strong reasoning and planning abilities. Nevertheless, existing benchmarks mostly assess their reasoning abilities in…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Miaosen Zhang , Qi Dai , Yifan Yang , Jianmin Bao , Dongdong Chen , Kai Qiu , Chong Luo , Xin Geng , Baining Guo

Large language model (LLM) agents are constrained by limited context windows, necessitating external memory systems for long-term information understanding. Current memory-augmented agents typically depend on pre-defined instructions and…

Computation and Language · Computer Science 2025-10-01 Yu Wang , Ryuichi Takanobu , Zhiqi Liang , Yuzhen Mao , Yuanzhe Hu , Julian McAuley , Xiaojian Wu

Agentic memory systems enable large language model (LLM) agents to maintain state across long interactions, supporting long-horizon reasoning and personalization beyond fixed context windows. Despite rapid architectural development, the…

Computation and Language · Computer Science 2026-05-21 Dongming Jiang , Yi Li , Songtao Wei , Jinxin Yang , Ayushi Kishore , Alysa Zhao , Dingyi Kang , Xu Hu , Feng Chen , Qiannan Li , Bingzhe Li

Multimodal retrieval is becoming a crucial component of modern AI applications, yet its evaluation lags behind the demands of more realistic and challenging scenarios. Existing benchmarks primarily probe surface-level semantic…

Information Retrieval · Computer Science 2025-10-01 Junjie Zhou , Ze Liu , Lei Xiong , Jin-Ge Yao , Yueze Wang , Shitao Xiao , Fenfen Lin , Miguel Hu Chen , Zhicheng Dou , Siqi Bao , Defu Lian , Yongping Xiong , Zheng Liu

The model-based reinforcement learning paradigm, which uses planning algorithms and neural network models, has recently achieved unprecedented results in diverse applications, leading to what is now known as deep reinforcement learning.…

Machine Learning · Computer Science 2022-01-11 Tiago Gaspar Oliveira , Arlindo L. Oliveira

Memory systems for AI assistants were built for single-user dialogue and fail characteristically when applied to multi-party social group settings. This gap matters for the social assistants being built today: group-acting agents embedded…

Computation and Language · Computer Science 2026-05-19 Olukunle Owolabi

Recent advances in probabilistic modelling have led to a large number of simulation-based inference algorithms which do not require numerical evaluation of likelihoods. However, a public benchmark with appropriate performance metrics for…

Machine Learning · Statistics 2021-04-12 Jan-Matthis Lueckmann , Jan Boelts , David S. Greenberg , Pedro J. Gonçalves , Jakob H. Macke

Large Multimodal Models (LMMs) exhibit major shortfalls when interpreting images and, by some measures, have poorer spatial cognition than small children or animals. Despite this, they attain high scores on many popular visual benchmarks,…

Understanding human mental states from natural behavior is crucial for intelligent systems in the real world. However, most current research focuses on predicting isolated mental state labels, lacking structured annotations of complex…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Xiaoyu Yuan , Niklas Heikkala , Tiina Törmänen , Hanna Järvenoja , Guoying Zhao , Haoyu Chen