English
Related papers

Related papers: Predictive but Not Plannable: RC-aux for Latent Wo…

200 papers

In high-stakes risk prediction, quantifying uncertainty through interval-valued predictions is essential for reliable decision-making. However, standard evaluation tools like the receiver operating characteristic (ROC) curve and the area…

Machine Learning · Computer Science 2026-02-05 Yuqi Li , Matthew M. Engelhard

We describe a robotic learning system for autonomous exploration and navigation in diverse, open-world environments. At the core of our method is a learned latent variable model of distances and actions, along with a non-parametric…

Robotics · Computer Science 2023-10-12 Dhruv Shah , Benjamin Eysenbach , Gregory Kahn , Nicholas Rhinehart , Sergey Levine

Time series forecasting serves as an essential tool for many real-world applications, supporting tasks such as resource optimization and decision-making. Despite significant architectural advancements, most modern models still treat…

Machine Learning · Computer Science 2026-05-12 Sheng Pan , Ming Jin , Bo Du , Shirui Pan

Reachable set computation is an important tool for analyzing control systems. Simulating a control system can show general trends, but a formal tool like reachability analysis can provide guarantees of correctness. Reachability analysis for…

Systems and Control · Electrical Eng. & Systems 2025-05-07 Chelsea Sidrane , Jana Tumova

World models aim to learn action-controlled future prediction and have proven essential for the development of intelligent agents. However, most existing world models rely heavily on substantial action-labeled data and costly training,…

Artificial Intelligence · Computer Science 2025-06-03 Shenyuan Gao , Siyuan Zhou , Yilun Du , Jun Zhang , Chuang Gan

Many real-world offline reinforcement learning (RL) problems involve continuous-time environments with delays. Such environments are characterized by two distinctive features: firstly, the state x(t) is observed at irregular time intervals,…

Machine Learning · Computer Science 2023-04-12 Samuel Holt , Alihan Hüyük , Zhaozhi Qian , Hao Sun , Mihaela van der Schaar

Modern vision-based world models can represent observations as compact yet expressive latent manifolds, but fast goal-oriented planning in these spaces remains challenging. This raises a central question: when does a learned representation…

Robotics · Computer Science 2026-05-12 Hoang Nguyen , Xiaohao Xu , Xiaonan Huang

Test-time compute has empowered multimodal large language models to generate extended reasoning chains, yielding strong performance on tasks such as multimodal math reasoning. However, this improved reasoning ability often comes with…

Computation and Language · Computer Science 2025-06-23 Chengzhi Liu , Zhongxing Xu , Qingyue Wei , Juncheng Wu , James Zou , Xin Eric Wang , Yuyin Zhou , Sheng Liu

World Action Models (WAMs) have recently emerged as a promising paradigm for robotic manipulation by jointly predicting future visual observations and future actions. However, current WAMs typically execute a fixed number of predicted…

Robotics · Computer Science 2026-05-12 Rui Wang , Yue Zhang , Jiehong Lin , Kuncheng Luo , Jianan Wang , Zhongrui Wang , Xiaojuan Qi

As autonomous robots increasingly become part of daily life, they will often encounter dynamic environments while only having limited information about their surroundings. Unfortunately, due to the possible presence of malicious dynamic…

Many AI alignment discussions of "runaway optimisation" focus on RL agents: unbounded utility maximisers that over-optimise a proxy objective (e.g., "paperclip maximiser", specification gaming) at the expense of everything else. LLM-based…

Computers and Society · Computer Science 2026-02-27 Roland Pihlakas , Sruthi Susan Kuriakose

Understanding object affordances is essential for enabling robots to perform purposeful and fine-grained interactions in diverse and unstructured environments. However, existing approaches either rely on retrieval, which is fragile due to…

Robotics · Computer Science 2026-04-01 Qiyuan Zhuang , He-Yang Xu , Yijun Wang , Xin-Yang Zhao , Yang-Yang Li , Xiu-Shen Wei

Complex, long-horizon planning and its combinatorial nature pose steep challenges for learning-based agents. Difficulties in such settings are exacerbated in low data regimes where over-fitting stifles generalization and compounding errors…

Machine Learning · Computer Science 2023-06-23 Joey Hejna , Pieter Abbeel , Lerrel Pinto

Human trajectory forecasting is a key component of autonomous vehicles, social-aware robots and advanced video-surveillance applications. This challenging task typically requires knowledge about past motion, the environment and likely…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Luigi Filippo Chiara , Pasquale Coscia , Sourav Das , Simone Calderara , Rita Cucchiara , Lamberto Ballan

Autonomous inspection in hazardous environments requires AI agents that can interpret high-level goals and execute precise control. A key capability for such agents is spatial grounding, for example when a drone must center a detected…

Artificial Intelligence · Computer Science 2025-11-25 Xian Yeow Lee , Lasitha Vidyaratne , Gregory Sin , Ahmed Farahat , Chetan Gupta

Planning methods can solve temporally extended sequential decision making problems by composing simple behaviors. However, planning requires suitable abstractions for the states and transitions, which typically need to be designed by hand.…

Machine Learning · Computer Science 2019-11-20 Soroush Nasiriany , Vitchyr H. Pong , Steven Lin , Sergey Levine

Long-horizon tasks requiring multi-step reasoning and dynamic re-planning remain challenging for large language models (LLMs). Sequential prompting methods are prone to context drift, loss of goal information, and recurrent failure cycles,…

Artificial Intelligence · Computer Science 2025-10-30 Zhenyu Zhang , Tianyi Chen , Weiran Xu , Alex Pentland , Jiaxin Pei

Hallucination in large language models (LLMs) remains a critical barrier to their safe deployment. For hallucination detection to be practical in real-world scenarios, the use of efficient small models is essential to ensure low latency and…

Artificial Intelligence · Computer Science 2026-03-05 Zepeng Bao , Shen Zhou , Qiankun Pi , Jianhao Chen , Mayi Xu , Ming Zhong , Yuanyuan Zhu , Tieyun Qian

Action-conditioned robot world models generate future video frames of the manipulated scene given a robot action sequence, offering a promising alternative for simulating tasks that are difficult to model with traditional physics engines.…

Robotics · Computer Science 2026-03-27 Jai Bardhan , Patrik Drozdik , Josef Sivic , Vladimir Petrik

For effective collaboration between humans and intelligent agents that employ machine learning for decision-making, humans must understand what agents can and cannot do to avoid over/under-reliance. A solution to this problem is adjusting…

Artificial Intelligence · Computer Science 2023-12-04 Yosuke Fukuchi , Seiji Yamada