English
Related papers

Related papers: Long-Horizon Visual Planning with Goal-Conditioned…

200 papers

Goal representation affects the performance of Hierarchical Reinforcement Learning (HRL) algorithms by decomposing the complex learning problem into easier subtasks. Recent studies show that representations that preserve temporally abstract…

Machine Learning · Computer Science 2024-12-24 Mehdi Zadem , Sergio Mover , Sao Mai Nguyen

Forecasting multiple future events within a given time horizon is essential for applications in finance, retail, social networks, and healthcare. Marked Temporal Point Processes (MTPP) provide a principled framework to model both the timing…

Machine Learning · Computer Science 2025-08-05 Ivan Karpukhin , Foma Shipilov , Andrey Savchenko

The current paper presents how a predictive coding type deep recurrent neural networks can generate vision-based goal-directed plans based on prior learning experience by examining experiment results using a real arm robot. The proposed…

Computer Vision and Pattern Recognition · Computer Science 2018-06-06 Minkyu Choi , Takazumi Matsumoto , Minju Jung , Jun Tani

Many AI problems, in robotics and other domains, are goal-directed, essentially seeking a trajectory leading to some goal state. In such problems, the way we choose to represent a trajectory underlies algorithms for trajectory prediction…

Machine Learning · Computer Science 2019-06-14 Tom Jurgenson , Edward Groshev , Aviv Tamar

Many real-world applications require decision-makers to assess the quality of solutions while considering multiple conflicting objectives. Obtaining good approximation sets for highly constrained many-objective problems is often a difficult…

Artificial Intelligence · Computer Science 2025-08-13 Rodrigo Lankaites Pinheiro , Dario Landa-Silva , Wasakorn Laesanklang , Ademir Aparecido Constantino

We design multi-horizon forecasting models for limit order book (LOB) data by using deep learning techniques. Unlike standard structures where a single prediction is made, we adopt encoder-decoder models with sequence-to-sequence and…

Machine Learning · Computer Science 2021-08-30 Zihao Zhang , Stefan Zohren

The enduring challenge in the field of artificial intelligence has been the control of systems to achieve desired behaviours. While for systems governed by straightforward dynamics equations, methods like Linear Quadratic Regulation (LQR)…

Machine Learning · Computer Science 2023-12-29 Jyothir S , Siddhartha Jalagam , Yann LeCun , Vlad Sobal

We present Points2Plans, a framework for composable planning with a relational dynamics model that enables robots to solve long-horizon manipulation tasks from partial-view point clouds. Given a language instruction and a point cloud of the…

Robotics · Computer Science 2025-03-05 Yixuan Huang , Christopher Agia , Jimmy Wu , Tucker Hermans , Jeannette Bohg

Object Goal Navigation (ObjectNav) task is to navigate an agent to an object category in unseen environments without a pre-built map. In this paper, we solve this task by predicting the distance to the target using semantically-related…

Robotics · Computer Science 2022-07-14 Minzhao Zhu , Binglei Zhao , Tao Kong

Trajectory prediction plays a crucial role in the autonomous driving stack by enabling autonomous vehicles to anticipate the motion of surrounding agents. Goal-based prediction models have gained traction in recent years for addressing the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Sepideh Afshar , Nachiket Deo , Akshay Bhagat , Titas Chakraborty , Yunming Shao , Balarama Raju Buddharaju , Adwait Deshpande , Henggang Cui

Motion prediction for intelligent vehicles typically focuses on estimating the most probable future evolutions of a traffic scenario. Estimating the gap acceptance, i.e., whether a vehicle merges or crosses before another vehicle with the…

Robotics · Computer Science 2024-09-18 Max Bastian Mertens , Jona Ruof , Jan Strohbeck , Michael Buchholz

Accurate modeling of system dynamics is crucial for achieving high-performance planning and control of robotic systems. Although existing data-driven approaches represent a promising approach for modeling dynamics, their accuracy is limited…

This paper presents a robust hierarchical MPC (H-MPC) for dynamic systems with slow states subject to demand forecast uncertainty. The H-MPC has two layers: (i) the scheduling MPC at the upper layer with a relatively long…

Optimization and Control · Mathematics 2019-09-16 Mohammad Reza Amini , Ilya Kolmanovsky , Jing Sun

To achieve full autonomous driving, a good understanding of the surrounding environment is necessary. Especially predicting the future states of other traffic participants imposes a non-trivial challenge. Current SotA-models already show…

Machine Learning · Computer Science 2025-07-25 Daniel Grimm , Ahmed Abouelazm , J. Marius Zöllner

Conformal prediction, a post-hoc, distribution-free, finite-sample method of uncertainty quantification that offers formal coverage guarantees under the assumption of data exchangeability. Unfortunately, the resulting uncertainty regions…

Machine Learning · Computer Science 2026-04-21 Nikolaos Bousias , Lars Lindemann , George Pappas

The feasibility of collecting a large amount of expert demonstrations has inspired growing research interests in learning-to-drive settings, where models learn by imitating the driving behaviour from experts. However, exclusively relying on…

Robotics · Computer Science 2022-12-20 Jonathan Francis , Bingqing Chen , Weiran Yao , Eric Nyberg , Jean Oh

Self-supervised goal proposal and reaching is a key component for exploration and efficient policy learning algorithms. Such a self-supervised approach without access to any oracle goal sampling distribution requires deep exploration and…

Robotics · Computer Science 2021-04-28 Homanga Bharadhwaj , Animesh Garg , Florian Shkurti

In this paper, we present Goal-GAN, an interpretable and end-to-end trainable model for human trajectory prediction. Inspired by human navigation, we model the task of trajectory prediction as an intuitive two-stage process: (i) goal…

Computer Vision and Pattern Recognition · Computer Science 2020-10-05 Patrick Dendorfer , Aljoša Ošep , Laura Leal-Taixé

The combination of exponentially large action spaces, stochastic dynamics, and long-horizon decision-making under limited resources makes Sequential Stochastic Combinatorial Optimization (SSCO) particularly challenging for reinforcement…

Machine Learning · Computer Science 2026-05-19 Vivienne Huiling Wang , Tinghuai Wang , Joni Pajarinen

The simplicity of the visual servoing approach makes it an attractive option for tasks dealing with vision-based control of robots in many real-world applications. However, attaining precise alignment for unseen environments pose a…