English
Related papers

Related papers: Dynamic Conditional Imitation Learning for Autonom…

200 papers

We demonstrate the first large-scale application of model-based generative adversarial imitation learning (MGAIL) to the task of dense urban self-driving. We augment standard MGAIL using a hierarchical model to enable generalization to…

Deep models, e.g., CNNs and Vision Transformers, have achieved impressive achievements in many vision tasks in the closed world. However, novel classes emerge from time to time in our ever-changing world, requiring a learning system to…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Da-Wei Zhou , Qi-Wei Wang , Zhi-Hong Qi , Han-Jia Ye , De-Chuan Zhan , Ziwei Liu

Model-free deep reinforcement learning (RL) has demonstrated its superiority on many complex sequential decision-making problems. However, heavy dependence on dense rewards and high sample-complexity impedes the wide adoption of these…

Machine Learning · Computer Science 2020-04-02 Zhuangdi Zhu , Kaixiang Lin , Bo Dai , Jiayu Zhou

Imitation learning (IL) enables robots to acquire skills quickly by transferring expert knowledge, which is widely adopted in reinforcement learning (RL) to initialize exploration. However, in long-horizon motion planning tasks, a…

Robotics · Computer Science 2021-03-30 Sha Luo , Hamidreza Kasaei , Lambert Schomaker

This paper aims to investigate direct imitation learning from human drivers for the task of lane keeping assistance in highway and country roads using grayscale images from a single front view camera. The employed method utilizes…

Machine Learning · Computer Science 2017-09-13 Christopher Innocenti , Henrik Lindén , Ghazaleh Panahandeh , Lennart Svensson , Nasser Mohammadiha

On end-to-end driving, human driving demonstrations are used to train perception-based driving models by imitation learning. This process is supervised on vehicle signals (e.g., steering angle, acceleration) but does not require extra…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Yi Xiao , Felipe Codevilla , Diego Porres , Antonio M. Lopez

In this paper, we present \textbf{C}ont\textbf{E}xtual \textbf{I}mitation \textbf{L}earning~(CEIL), a general and broadly applicable algorithm for imitation learning (IL). Inspired by the formulation of hindsight information matching, we…

Machine Learning · Computer Science 2023-10-27 Jinxin Liu , Li He , Yachen Kang , Zifeng Zhuang , Donglin Wang , Huazhe Xu

Autonomous driving has achieved significant progress in recent years, but autonomous cars are still unable to tackle high-risk situations where a potential accident is likely. In such near-accident scenarios, even a minor change in the…

Machine Learning · Computer Science 2020-07-02 Zhangjie Cao , Erdem Bıyık , Woodrow Z. Wang , Allan Raventos , Adrien Gaidon , Guy Rosman , Dorsa Sadigh

In-context imitation learning allows robots to acquire skills from demonstrations, yet one-shot trajectory generation remains fragile under environmental variation. We propose SAIL, a framework that reframes robot imitation as an iterative…

Robotics · Computer Science 2026-03-10 Makoto Sato , Yusuke Iwasawa , Yujin Tang , So Kuroki

We consider imitation learning with access only to expert demonstrations, whose real-world application is often limited by covariate shift due to compounding errors during execution. We investigate the effectiveness of the Continuity-based…

Robotics · Computer Science 2024-10-22 Abhay Deshpande , Liyiming Ke , Quinn Pfeifer , Abhishek Gupta , Siddhartha S. Srinivasa

We introduce Correspondence-Oriented Imitation Learning (COIL), a conditional policy learning framework for visuomotor control with a flexible task representation in 3D. At the core of our approach, each task is defined by the intended…

Robotics · Computer Science 2025-12-08 Yunhao Cao , Zubin Bhaumik , Jessie Jia , Xingyi He , Kuan Fang

Realistic traffic simulation is crucial for developing self-driving software in a safe and scalable manner prior to real-world deployment. Typically, imitation learning (IL) is used to learn human-like traffic agents directly from…

Robotics · Computer Science 2023-11-03 Chris Zhang , James Tu , Lunjun Zhang , Kelvin Wong , Simon Suo , Raquel Urtasun

Class-Incremental Learning (CIL) aims to continuously acquire new categories while preserving previously learned knowledge. Recently, Contrastive Language-Image Pre-trained (CLIP) models have shown strong potential for CIL due to their…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Tianqi Wang , Jingcai Guo

Class-incremental learning (CIL) enables models to continuously learn new categories from sequential tasks without forgetting previously acquired knowledge. While recent advances in vision-language models such as CLIP have demonstrated…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Haoran Chen , Houze Xu , Micah Goldblum , Daoguo Dong , Zuxuan Wu

This work evaluates and analyzes the combination of imitation learning (IL) and differentiable model predictive control (MPC) for the application of human-like autonomous driving. We combine MPC with a hierarchical learning-based policy,…

Robotics · Computer Science 2023-06-27 Flavia Sofia Acerbo , Jan Swevers , Tinne Tuytelaars , Tong Duy Son

In autonomous driving scenarios, current object detection models show strong performance when tested in clear weather. However, their performance deteriorates significantly when tested in degrading weather conditions. In addition, even when…

Computer Vision and Pattern Recognition · Computer Science 2023-05-31 Stefan Leitner , M. Jehanzeb Mirza , Wei Lin , Jakub Micorek , Marc Masana , Mateusz Kozinski , Horst Possegger , Horst Bischof

Imitation learning is a promising approach for training autonomous vehicles (AV) to navigate complex traffic environments by mimicking expert driver behaviors. While existing imitation learning frameworks focus on leveraging expert…

Robotics · Computer Science 2025-09-25 Yasin Sonmez , Hanna Krasowski , Murat Arcak

Microscopic traffic simulation plays a crucial role in transportation engineering by providing insights into individual vehicle behavior and overall traffic flow. However, creating a realistic simulator that accurately replicates human…

Artificial Intelligence · Computer Science 2024-05-24 Ke Guo , Zhenwei Miao , Wei Jing , Weiwei Liu , Weizi Li , Dayang Hao , Jia Pan

Decision-making in long-tail scenarios is pivotal to autonomous-driving development, and realistic and challenging simulations play a crucial role in testing safety-critical situations. However, existing open-source datasets lack systematic…

Robotics · Computer Science 2025-09-09 Chuancheng Zhang , Zhenhao Wang , Jiangcheng Wang , Kun Su , Qiang Lv , Bin Jiang , Kunkun Hao , Wenyu Wang

Autonomous driving technologies face significant safety challenges while operating under rare, diverse, and visually degraded weather scenarios. These challenges become more critical in cooperative settings, where vehicles and…

Robotics · Computer Science 2025-07-08 Junwei You , Pei Li , Zhuoyu Jiang , Zilin Huang , Rui Gan , Haotian Shi , Bin Ran