English
Related papers

Related papers: GCImOpt: Learning efficient goal-conditioned polic…

200 papers

Actor-critic (AC) algorithms are known for their efficacy and high performance in solving reinforcement learning problems, but they also suffer from low sampling efficiency. An AC based policy optimization process is iterative and needs to…

Machine Learning · Computer Science 2021-12-02 Chayan Banerjee , Zhiyong Chen , Nasimul Noman , Mohsen Zamani

Learning robust navigation policies remains a core challenge in robotics. Offline imitation learning suffers from distribution shift and compounding errors at rollout, while reinforcement learning requires reward engineering and learns…

Robotics · Computer Science 2026-05-13 Xiaofei Wei , Chun Gu , Li Zhang

We propose a new policy representation based on score-based diffusion models (SDMs). We apply our new policy representation in the domain of Goal-Conditioned Imitation Learning (GCIL) to learn general-purpose goal-specified policies from…

Machine Learning · Computer Science 2023-06-02 Moritz Reuss , Maximilian Li , Xiaogang Jia , Rudolf Lioutikov

Model predictive control (MPC) is a powerful, optimization-based approach for controlling dynamical systems. However, the computational complexity of online optimization can be problematic on embedded devices. Especially, when we need to…

Imitation Learning offers a promising approach to learn directly from data without requiring explicit models, simulations, or detailed task definitions. During inference, actions are sampled from the learned distribution and executed on the…

Robotics · Computer Science 2025-10-28 Amirreza Razmjoo , Sylvain Calinon , Michael Gienger , Fan Zhang

Existing approaches for transporting and manipulating cable-suspended loads using multiple UAVs along reference trajectories typically rely on either centralized control architectures or reliable inter-agent communication. In this work, we…

Robotics · Computer Science 2025-10-21 Shantnav Agarwal , Javier Alonso-Mora , Sihao Sun

Model predictive control (MPC) is a popular approach for trajectory optimization in practical robotics applications. MPC policies can optimize trajectory parameters under kinodynamic and safety constraints and provide guarantees on safety,…

Robotics · Computer Science 2023-06-08 Returaj Burnwal , Anirban Santara , Nirav P. Bhatt , Balaraman Ravindran , Gaurav Aggarwal

Deep networks trained on demonstrations of human driving have learned to follow roads and avoid obstacles. However, driving policies trained via imitation learning cannot be controlled at test time. A vehicle trained end-to-end to imitate…

Robotics · Computer Science 2018-03-05 Felipe Codevilla , Matthias Müller , Antonio López , Vladlen Koltun , Alexey Dosovitskiy

Recently, learning-based controllers have been shown to push mobile robotic systems to their limits and provide the robustness needed for many real-world applications. However, only classical optimization-based control frameworks offer the…

Robotics · Computer Science 2023-04-04 Leonard Bauersfeld , Elia Kaufmann , Davide Scaramuzza

Imitation learning is a data-driven approach to learning policies from expert behavior, but it is prone to unreliable outcomes in out-of-sample (OOS) regions. While previous research relying on stable dynamical systems guarantees…

Machine Learning · Computer Science 2025-03-27 Amin Abyaneh , Mahrokh G. Boroujeni , Hsiu-Chin Lin , Giancarlo Ferrari-Trecate

End-to-end autonomous driving has substantially progressed by directly predicting future trajectories from raw perception inputs, which bypasses traditional modular pipelines. However, mainstream methods trained via imitation learning…

Robotics · Computer Science 2025-09-23 Shuyao Shang , Yuntao Chen , Yuqi Wang , Yingyan Li , Zhaoxiang Zhang

Data-driven iterative learning control can achieve high performance for systems performing repeating tasks without the need for modeling. The aim of this paper is to develop a fast data-driven method for iterative learning control that is…

Systems and Control · Electrical Eng. & Systems 2021-11-17 Leontine Aarnoudse , Tom Oomen

This paper introduces DiffTORI, which utilizes Differentiable Trajectory Optimization as the policy representation to generate actions for deep Reinforcement and Imitation learning. Trajectory optimization is a powerful and widely used…

Machine Learning · Computer Science 2025-06-16 Weikang Wan , Ziyu Wang , Yufei Wang , Zackory Erickson , David Held

Imitation learning is a powerful tool for training agents by leveraging expert knowledge, and being able to replicate a given trajectory is an integral part of it. In complex environments, like modern 3D video games, distribution shift and…

We propose a computationally efficient rollout-then-optimize method to improve a learned control policy at deployment time. A learned policy provides a nominal trajectory, which is refined online by a single Newton step implemented via a…

Optimization and Control · Mathematics 2026-04-13 Andrea Ghezzi , Rudolf Reiter , Katrin Baumgärtner , Alberto Bemporad , Moritz Diehl

The use of imitation learning to learn a single policy for a complex task that has multiple modes or hierarchical structure can be challenging. In fact, previous work has shown that when the modes are known, learning separate policies for…

Machine Learning · Computer Science 2019-03-13 Arjun Sharma , Mohit Sharma , Nicholas Rhinehart , Kris M. Kitani

We present a deep learning method for composite and task-driven motion control for physically simulated characters. In contrast to existing data-driven approaches using reinforcement learning that imitate full-body motions, we learn…

Graphics · Computer Science 2023-05-08 Pei Xu , Xiumin Shang , Victor Zordan , Ioannis Karamouzas

We present an end-to-end imitation learning system for agile, off-road autonomous driving using only low-cost sensors. By imitating a model predictive controller equipped with advanced sensors, we train a deep neural network control policy…

Robotics · Computer Science 2019-08-12 Yunpeng Pan , Ching-An Cheng , Kamil Saigol , Keuntaek Lee , Xinyan Yan , Evangelos Theodorou , Byron Boots

Imitation learning is a promising approach for training autonomous vehicles (AV) to navigate complex traffic environments by mimicking expert driver behaviors. While existing imitation learning frameworks focus on leveraging expert…

Robotics · Computer Science 2025-09-25 Yasin Sonmez , Hanna Krasowski , Murat Arcak

Training a deep network policy for robot manipulation is notoriously costly and time consuming as it depends on collecting a significant amount of real world data. To work well in the real world, the policy needs to see many instances of…

Robotics · Computer Science 2019-06-24 Xinchen Yan , Mohi Khansari , Jasmine Hsu , Yuanzheng Gong , Yunfei Bai , Sören Pirk , Honglak Lee