English
Related papers

Related papers: End-to-End Driving via Self-Supervised Imitation L…

200 papers

Human-vehicle interaction in safety-critical traffic environments increasingly incorporates neural sensing to infer user intent and cognitive state, yet most existing approaches either treat electroencephalography (EEG) as a static…

Neural and Evolutionary Computing · Computer Science 2026-03-10 Xiaoshan Zhou , Carol C. Menassa , Vineet R. Kamat

Recent advancements in deep learning and the availability of high-quality real-world driving datasets have propelled end-to-end autonomous driving. Despite this progress, relying solely on real-world data limits the variety of driving…

Robotics · Computer Science 2025-10-29 Jongsuk Kim , Jaeyoung Lee , Gyojin Han , Dongjae Lee , Minki Jeong , Junmo Kim

Autonomous driving in urban crowds at unregulated intersections is challenging, where dynamic occlusions and uncertain behaviors of other vehicles should be carefully considered. Traditional methods are heuristic and based on…

Robotics · Computer Science 2021-09-20 Peide Cai , Sukai Wang , Hengli Wang , Ming Liu

On end-to-end driving, human driving demonstrations are used to train perception-based driving models by imitation learning. This process is supervised on vehicle signals (e.g., steering angle, acceleration) but does not require extra…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Yi Xiao , Felipe Codevilla , Diego Porres , Antonio M. Lopez

Nowadays, supervised deep learning techniques yield the best state-of-the-art prediction performances for a wide variety of computer vision tasks. However, such supervised techniques generally require a large amount of manually labeled…

Computer Vision and Pattern Recognition · Computer Science 2020-06-09 Florent Chiaroni , Mohamed-Cherif Rahal , Nicolas Hueber , Frederic Dufaux

Designing a driving policy for autonomous vehicles is a difficult task. Recent studies suggested an end-toend (E2E) training of a policy to predict car actuators directly from raw sensory inputs. It is appealing due to the ease of labeled…

Robotics · Computer Science 2019-01-07 Yonatan Glassner , Liran Gispan , Ariel Ayash , Tal Furman Shohet

Imitation learning is a promising approach to end-to-end training of autonomous vehicle controllers. Typically the driving process with such approaches is entirely automatic and black-box, although in practice it is desirable to control the…

Robotics · Computer Science 2020-11-23 Renhao Wang , Adam Scibior , Frank Wood

We propose an image based end-to-end learning framework that helps lane-change decisions for human drivers and autonomous vehicles. The proposed system, Safe Lane-Change Aid Network (SLCAN), trains a deep convolutional neural network to…

Computer Vision and Pattern Recognition · Computer Science 2017-06-27 Seong-Gyun Jeong , Jiwon Kim , Sujung Kim , Jaesik Min

Autonomous driving has attracted great attention from both academics and industries. To realise autonomous driving, Deep Imitation Learning (DIL) is treated as one of the most promising solutions, because it improves autonomous driving…

Artificial Intelligence · Computer Science 2021-08-02 Hasan Bayarov Ahmedov , Dewei Yi , Jie Sui

One-shot Imitation Learning~(OSIL) aims to imbue AI agents with the ability to learn a new task from a single demonstration. To supervise the learning, OSIL typically requires a prohibitively large number of paired expert demonstrations --…

Machine Learning · Computer Science 2024-08-13 Philipp Wu , Kourosh Hakhamaneshi , Yuqing Du , Igor Mordatch , Aravind Rajeswaran , Pieter Abbeel

End-to-end autonomous driving systems, predominantly trained through imitation learning, have demonstrated considerable effectiveness in leveraging large-scale expert driving data. Despite their success in open-loop evaluations, these…

Robotics · Computer Science 2025-11-12 Yi Huang , Zhan Qu , Lihui Jiang , Bingbing Liu , Hongbo Zhang

Current autonomous driving systems are composed of a perception system and a decision system. Both of them are divided into multiple subsystems built up with lots of human heuristics. An end-to-end approach might clean up the system and…

Computer Vision and Pattern Recognition · Computer Science 2020-10-12 Jianyu Chen , Zhuo Xu , Masayoshi Tomizuka

In recent years, end-to-end autonomous driving architectures have gained increasing attention due to their advantage in avoiding error accumulation. Most existing end-to-end autonomous driving methods are based on Imitation Learning (IL),…

Artificial Intelligence · Computer Science 2025-04-22 Yueyuan Li , Mingyang Jiang , Songan Zhang , Wei Yuan , Chunxiang Wang , Ming Yang

End-to-end autonomous driving is typically built upon imitation learning (IL), yet its performance is constrained by the quality of human demonstrations. To overcome this limitation, recent methods incorporate reinforcement learning (RL)…

Robotics · Computer Science 2026-04-13 Zhexi Lian , Haoran Wang , Xuerun Yan , Weimeng Lin , Xianhong Zhang , Yongyu Chen , Jia Hu

Self-supervised learning (SSL) methods aim to exploit the abundance of unlabelled data for machine learning (ML), however the underlying principles are often method-specific. An SSL framework derived from biological first principles of…

Machine Learning · Computer Science 2023-08-03 Franz Scherr , Qinghai Guo , Timoleon Moraitis

With the evolution of various advanced driver assistance system (ADAS) platforms, the design of autonomous driving system is becoming more complex and safety-critical. The autonomous driving system simultaneously activates multiple ADAS…

Robotics · Computer Science 2019-05-15 MyungJae Shin , Joongheon Kim

In recent years, vision-based end-to-end autonomous driving has emerged as a new paradigm. However, popular end-to-end approaches typically rely on visual feature extraction networks trained under label supervision. This limited supervision…

Robotics · Computer Science 2025-11-04 Ling Niu , Xiaoji Zheng , Han Wang , Chen Zheng , Ziyuan Yang , Bokui Chen , Jiangtao Gong

This work presents our end-to-end (E2E) automatic speech recognition (ASR) model targetting at robust speech recognition, called Integraded speech Recognition with enhanced speech Input for Self-supervised learning representation (IRIS).…

Sound · Computer Science 2022-04-04 Xuankai Chang , Takashi Maekaku , Yuya Fujita , Shinji Watanabe

Hand-crafting generalised decision-making rules for real-world urban autonomous driving is hard. Alternatively, learning behaviour from easy-to-collect human driving demonstrations is appealing. Prior work has studied imitation learning…

Computer Vision and Pattern Recognition · Computer Science 2019-12-06 Jeffrey Hawke , Richard Shen , Corina Gurau , Siddharth Sharma , Daniele Reda , Nikolay Nikolov , Przemyslaw Mazur , Sean Micklethwaite , Nicolas Griffiths , Amar Shah , Alex Kendall

Current imitation learning approaches, predominantly based on deep neural networks (DNNs), offer efficient mechanisms for learning driving policies from real-world datasets. However, they suffer from inherent limitations in interpretability…

Machine Learning · Computer Science 2025-12-22 Iman Sharifi , Mustafa Yildirim , Saber Fallah