English
Related papers

Related papers: Predictive but Not Plannable: RC-aux for Latent Wo…

200 papers

World models aim to improve robotic decision making by predicting the consequences of actions. However, in practice, their predictions often become unreliable once the robot encounters states outside the training distribution, limiting…

Robotics · Computer Science 2026-05-18 Tuo An , Jindou Jia , Gen Li , Jingliang Li , Chuhao Zhou , Pengfei Liu , Bofan Lyu , Jiaqi Bai , Xinying Guo , Geng Li , Jianfei Yang

Offline Goal-Conditioned Reinforcement Learning seeks to train agents to reach specified goals from previously collected trajectories. Scaling that promises to long-horizon tasks remains challenging, notably due to compounding…

Machine Learning · Computer Science 2026-02-02 Anthony Kobanda , Waris Radji , Mathieu Petitbois , Odalric-Ambrym Maillard , Rémy Portelas

Associative memory has long underpinned the design of sequential models. Beyond recall, humans reason by projecting future states and selecting goal-directed actions, a capability that modern language models increasingly require but do not…

Machine Learning · Computer Science 2026-03-11 Peihao Wang , Shan Yang , Xijun Wang , Tesi Xiao , Xin Liu , Changlong Yu , Yu Lou , Pan Li , Zhangyang Wang , Ming Lin , René Vidal

Existing robot video world models are typically trained with low-level objectives such as reconstruction and perceptual similarity, which are poorly aligned with the capabilities that matter most for robot decision making, including…

Reachability-based Trajectory Design (RTD) is a provably safe, real-time trajectory planning framework that combines offline reachable-set computation with online trajectory optimization. However, standard RTD implementations suffer from…

Robotics · Computer Science 2026-03-24 Evanns Morales-Cuadrado , Long Kiu Chung , Shreyas Kousik , Samuel Coogan

The temporal lag between actions and their long-term consequences makes credit assignment a challenge when learning goal-directed behaviors from data. Generative world models capture the distribution of future states an agent may visit,…

Machine Learning · Computer Science 2026-04-23 Aravind Venugopal , Jiayu Chen , Xudong Wu , Chongyi Zheng , Benjamin Eysenbach , Jeff Schneider

Successful Human-Robot collaboration requires a predictive model of human behavior. The robot needs to be able to recognize current goals and actions and to predict future activities in a given context. However, the spatio-temporal sequence…

Computer Vision and Pattern Recognition · Computer Science 2018-09-20 Judith Bütepage , Danica Kragic

Robust robotic manipulation requires not only predicting how the scene evolves over time, but also recognizing task-relevant objects in complex scenes. However, existing VLA models face two limitations. They typically act only on the…

Robotics · Computer Science 2026-04-21 Kuanning Wang , Ke Fan , Chenhao Qiu , Zeyu Shangguan , Yuqian Fu , Yanwei Fu , Daniel Seita , Xiangyang Xue

World Action Models (WAMs) enhance Vision-Language-Action policies by jointly predicting scene evolution and robot actions, but existing methods usually represent the predicted world as holistic images, video tokens, or global latents.…

End-to-end models for autonomous driving hold the promise of learning complex behaviors directly from sensor data, but face critical challenges in safety and handling long-tail events. Reinforcement Learning (RL) offers a promising path to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Tianyi Yan , Tao Tang , Xingtai Gui , Yongkang Li , Jiasen Zhesng , Weiyao Huang , Lingdong Kong , Wencheng Han , Xia Zhou , Xueyang Zhang , Yifei Zhan , Kun Zhan , Cheng-zhong Xu , Jianbing Shen

Traditional AI alignment primarily focuses on individual model outputs; however, autonomous agents in long-horizon workflows require sustained reliability across entire interaction trajectories. We introduce APEMO (Affect-aware Peak-End…

Artificial Intelligence · Computer Science 2026-02-23 Hanjing Shi , Dominic DiFranzo

Large Vision-Language Models (LVLMs) show promise for embodied planning tasks but struggle with complex scenarios involving unfamiliar environments and multi-step goals. Current approaches rely on environment-agnostic imitation learning…

Artificial Intelligence · Computer Science 2025-07-03 Junhao Shi , Zhaoye Fei , Siyin Wang , Qipeng Guo , Jingjing Gong , Xipeng Qiu

Unmanned Aerial Vehicles (UAVs) increasingly enhance the Quality of Service (QoS) in wireless networks due to their flexibility and cost-effectiveness. However, optimizing UAV placement in dynamic, obstacle-prone environments remains a…

Networking and Internet Architecture · Computer Science 2026-01-30 Kamran Shafafi , Manuel Ricardo , Rui Campos

Predictive manipulation has recently gained considerable attention in the Embodied AI community due to its potential to improve robot policy performance by leveraging predicted states. However, generating accurate future visual states of…

Robotics · Computer Science 2025-09-15 Yuhang Huang , Jiazhao Zhang , Shilong Zou , Xinwang Liu , Ruizhen Hu , Kai Xu

Predictive models are being increasingly used to support consequential decision making at the individual level in contexts such as pretrial bail and loan approval. As a result, there is increasing social and legal pressure to provide…

Machine Learning · Computer Science 2020-03-02 Amir-Hossein Karimi , Gilles Barthe , Borja Balle , Isabel Valera

We consider the problem of learning useful robotic skills from previously collected offline data without access to manually specified rewards or additional online exploration, a setting that is becoming increasingly important for scaling…

Vision-Language Navigation (VLN) is a critical task for developing embodied agents that can follow natural language instructions to navigate in complex real-world environments. Recent advances in VLN by large pretrained models have…

To improve efficiency and temporal coherence, Vision-Language-Action (VLA) models often predict action chunks; however, this action chunking harms reactivity under inference delay and long horizons. We introduce Asynchronous Action Chunk…

Robotics · Computer Science 2025-09-30 Kohei Sendai , Maxime Alvarez , Tatsuya Matsushima , Yutaka Matsuo , Yusuke Iwasawa

Everyday tasks of long-horizon and comprising a sequence of multiple implicit subtasks still impose a major challenge in offline robot control. While a number of prior methods aimed to address this setting with variants of imitation and…

Robotics · Computer Science 2022-09-20 Erick Rosete-Beas , Oier Mees , Gabriel Kalweit , Joschka Boedecker , Wolfram Burgard

Large Language Models (LLMs) that can continually improve beyond their training budgets are able to solve increasingly difficult problems by adapting at test time, a property we refer to as extrapolation. However, standard reinforcement…

Machine Learning · Computer Science 2026-03-24 Ian Wu , Yuxiao Qu , Amrith Setlur , Aviral Kumar