English
Related papers

Related papers: Long-Horizon Visual Planning with Goal-Conditioned…

200 papers

Reinforcement learning (RL) exhibits remarkable potential in addressing autonomous driving tasks. However, it is difficult to train a sample-efficient and safe policy in complex scenarios. In this article, we propose a novel hierarchical…

Robotics · Computer Science 2025-06-23 Yiou Huang

Recent work has demonstrated the effectiveness of formulating decision making as supervised learning on offline-collected trajectories. Powerful sequence models, such as GPT or BERT, are often employed to encode the trajectories. However,…

Machine Learning · Computer Science 2023-10-31 Zilai Zeng , Ce Zhang , Shijie Wang , Chen Sun

We consider the problem of object goal navigation in unseen environments. Solving this problem requires learning of contextual semantic priors, a challenging endeavour given the spatial and semantic variability of indoor environments.…

Computer Vision and Pattern Recognition · Computer Science 2022-03-10 Georgios Georgakis , Bernadette Bucher , Karl Schmeckpeper , Siddharth Singh , Kostas Daniilidis

We address key challenges in long-horizon embodied exploration and navigation by proposing a new object transport task and a novel modular framework for temporally extended navigation. Our first contribution is the design of a novel…

Computer Vision and Pattern Recognition · Computer Science 2022-10-31 Sriram Narayanan , Dinesh Jayaraman , Manmohan Chandraker

In this work, multi-step traffic predictions are leveraged to enable multi-period planning in reconfigurable optical networks. The proposed framework aims to achieve spectrum savings by adapting the network to predicted time-varying…

Networking and Internet Architecture · Computer Science 2026-05-26 Giannis Savva , Hafsa Maryam , Venkatesh Chebolu , Tania Panayiotou , Georgios Ellinas

Horizon length and model accuracy are defining factors when designing a Model Predictive Controller. While long horizons and detailed models have a positive effect on control performance, computational complexity increases. As predictions…

Systems and Control · Electrical Eng. & Systems 2021-08-19 Tim Brüdigam , Daniel Prader , Dirk Wollherr , Marion Leibold

Visual planning simulates how humans make decisions to achieve desired goals in the form of searching for visual causal transitions between an initial visual state and a final visual goal state. It has become increasingly important in…

Artificial Intelligence · Computer Science 2024-03-28 Yilue Qian , Peiyu Yu , Ying Nian Wu , Yao Su , Wei Wang , Lifeng Fan

The task of recognizing goals and plans from missing and full observations can be done efficiently by using automated planning techniques. In many applications, it is important to recognize goals and plans not only accurately, but also…

Artificial Intelligence · Computer Science 2019-05-24 Ramon Fraga Pereira , Nir Oren , Felipe Meneguzzi

Recently, graph-based planning algorithms have gained much attention to solve goal-conditioned reinforcement learning (RL) tasks: they provide a sequence of subgoals to reach the target-goal, and the agents learn to execute…

Machine Learning · Computer Science 2023-03-21 Junsu Kim , Younggyo Seo , Sungsoo Ahn , Kyunghwan Son , Jinwoo Shin

Deterministic planning assumes that the planning evolves along a fully predictable path, and therefore it loses the practical value in most real projections. A more realistic view is that planning ought to take into consideration partial…

Artificial Intelligence · Computer Science 2023-09-29 Peng Zhao

Automating long-horizon tasks with a robotic arm has been a central research topic in robotics. Optimization-based action planning is an efficient approach for creating an action plan to complete a given task. Construction of a reliable…

Robotics · Computer Science 2024-04-05 Naoya Sogi , Hiroyuki Oyama , Takashi Shibata , Makoto Terao

Complex, long-horizon planning and its combinatorial nature pose steep challenges for learning-based agents. Difficulties in such settings are exacerbated in low data regimes where over-fitting stifles generalization and compounding errors…

Machine Learning · Computer Science 2023-06-23 Joey Hejna , Pieter Abbeel , Lerrel Pinto

We propose the Temporal Point Cloud Networks (TPCN), a novel and flexible framework with joint spatial and temporal learning for trajectory prediction. Unlike existing approaches that rasterize agents and map information as 2D images or…

Computer Vision and Pattern Recognition · Computer Science 2021-03-05 Maosheng Ye , Tongyi Cao , Qifeng Chen

Goal Recognition is the task by which an observer aims to discern the goals that correspond to plans that comply with the perceived behavior of subject agents given as a sequence of observations. Research on Goal Recognition as Planning…

Artificial Intelligence · Computer Science 2024-04-12 Felipe Meneguzzi , Luísa R. de A. Santos , Ramon Fraga Pereira , André G. Pereira

Model predictive control (MPC) is a popular control method that has proved effective for robotics, among other fields. MPC performs re-planning at every time step. Re-planning is done with a limited horizon per computational and real-time…

Robotics · Computer Science 2017-03-22 Aviv Tamar , Garrett Thomas , Tianhao Zhang , Sergey Levine , Pieter Abbeel

Hierarchical forecasting methods have been widely used to support aligned decision-making by providing coherent forecasts at different aggregation levels. Traditional hierarchical forecasting approaches, such as the bottom-up and top-down…

Machine Learning · Computer Science 2020-06-04 Evangelos Spiliotis , Mahdi Abolghasemi , Rob J Hyndman , Fotios Petropoulos , Vassilios Assimakopoulos

We propose a hierarchical learning architecture for predictive control in unknown environments. We consider a constrained nonlinear dynamical system and assume the availability of state-input trajectories solving control tasks in different…

Systems and Control · Electrical Eng. & Systems 2020-07-16 Charlott Vallon , Francesco Borrelli

The ability to plan at many different levels of abstraction enables agents to envision the long-term repercussions of their decisions and thus enables sample-efficient learning. This becomes particularly beneficial in complex environments…

Artificial Intelligence · Computer Science 2023-10-17 Thomas Jiralerspong , Flemming Kondrup , Doina Precup , Khimya Khetarpal

We consider planning problems, that often arise in autonomous driving applications, in which an agent should decide on immediate actions so as to optimize a long term objective. For example, when a car tries to merge in a roundabout it…

Machine Learning · Computer Science 2016-02-05 Shai Shalev-Shwartz , Nir Ben-Zrihem , Aviad Cohen , Amnon Shashua

Robot control policies for temporally extended and sequenced tasks are often characterized by discontinuous switches between different local dynamics. These change-points are often exploited in hierarchical motion planning to build…

Robotics · Computer Science 2020-02-18 Daniel Angelov , Yordan Hristov , Michael Burke , Subramanian Ramamoorthy