English
Related papers

Related papers: Scaling Vision-based End-to-End Driving with Multi…

200 papers

Human drivers produce a vast amount of data which could, in principle, be used to improve autonomous driving systems. Unfortunately, seemingly straightforward approaches for creating end-to-end driving models that map sensor data directly…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Yi Xiao , Felipe Codevilla , Christopher Pal , Antonio M. Lopez

In this work, we present a lightweight pipeline for robust behavioral cloning of a human driver using end-to-end imitation learning. The proposed pipeline was employed to train and deploy three distinct driving behavior models onto a…

Robotics · Computer Science 2021-10-19 Tanmay Vilas Samak , Chinmay Vilas Samak , Sivanathan Kandhasamy

Multi-instance scenes are especially challenging for end-to-end visuomotor (image-to-control) learning algorithms. "Pipeline" visual servo control algorithms use separate detection, selection and servo stages, allowing algorithms to focus…

Robotics · Computer Science 2024-01-23 Zheyu Zhuang , Xin Yu , Robert Mahony

Vehicles, as one of the most common and significant objects in the real world, the researches on which using computer vision technologies have made remarkable progress, such as vehicle detection, vehicle re-identification, etc. To search an…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Likai Wang , Ruize Han , Xiangqun Zhang , Wei Feng

Optical sensors and learning algorithms for autonomous vehicles have dramatically advanced in the past few years. Nonetheless, the reliability of today's autonomous vehicles is hindered by the limited line-of-sight sensing capability and…

Computer Vision and Pattern Recognition · Computer Science 2022-11-21 Jiaxun Cui , Hang Qiu , Dian Chen , Peter Stone , Yuke Zhu

In autonomous systems, sensor calibration is essential for safe and efficient navigation in dynamic environments. Accurate calibration is a prerequisite for reliable perception and planning tasks such as object detection and obstacle…

Robotics · Computer Science 2026-02-02 Ilir Tahiraj , Markus Edinger , Dominik Kulmer , Markus Lienkamp

In this paper, we present a novel end-to-end deep neural network model for autonomous driving that takes monocular image sequence as input, and directly generates the steering control angle. Firstly, we model the end-to-end driving problem…

Robotics · Computer Science 2021-03-11 Peng Wan , Zhenbo Song , Jianfeng Lu

Hand-crafting generalised decision-making rules for real-world urban autonomous driving is hard. Alternatively, learning behaviour from easy-to-collect human driving demonstrations is appealing. Prior work has studied imitation learning…

Computer Vision and Pattern Recognition · Computer Science 2019-12-06 Jeffrey Hawke , Richard Shen , Corina Gurau , Siddharth Sharma , Daniele Reda , Nikolay Nikolov , Przemyslaw Mazur , Sean Micklethwaite , Nicolas Griffiths , Amar Shah , Alex Kendall

In this paper we present a complete study of an end-to-end imitation learning system for speed control of a real car, based on a neural network with a Long Short Term Memory (LSTM). To achieve robustness and generalization from expert…

Computer Vision and Pattern Recognition · Computer Science 2018-12-17 Laurent George , Thibault Buhet , Emilie Wirbel , Gaetan Le-Gall , Xavier Perrotton

Distracted driving continues to be a significant cause of road traffic injuries and fatalities worldwide, even with advancements in driver monitoring technologies. Recent developments in machine learning (ML) and deep learning (DL) have…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Anthony Dontoh , Stephanie Ivey , Logan Sirbaugh , Andrews Danyo , Armstrong Aboah

Car-following models (CFMs) are fundamental to traffic flow analysis and autonomous driving. Although calibrated physics-based and trained data-driven CFMs can replicate human driving behavior, their reliance on specific datasets limits…

Artificial Intelligence · Computer Science 2025-10-13 Chengming Wang , Dongyao Jia , Wei Wang , Dong Ngoduy , Bei Peng , Jianping Wang

The goal of imitation learning (IL) is to learn a good policy from high-quality demonstrations. However, the quality of demonstrations in reality can be diverse, since it is easier and cheaper to collect demonstrations from a mix of experts…

Machine Learning · Computer Science 2019-09-17 Voot Tangkaratt , Bo Han , Mohammad Emtiyaz Khan , Masashi Sugiyama

In the behavioral cloning approach to end-to-end driving, a dataset of expert driving is collected and the model learns to guess what the expert would do in different situations. Situations are summarized in observations and the outputs are…

Robotics · Computer Science 2024-04-16 Ardi Tampuu , Ilmar Uduste , Kristjan Roosild

Traditional autonomous driving methods adopt a modular design, decomposing tasks into sub-tasks. In contrast, end-to-end autonomous driving directly outputs actions from raw sensor data, avoiding error accumulation. However, training an…

Robotics · Computer Science 2024-11-22 Zeyu Dong , Yimin Zhu , Yansong Li , Kevin Mahon , Yu Sun

High-risk artificial intelligence and machine learning classification tasks, such as healthcare diagnosis, require accurate and interpretable prediction models. However, classifier algorithms typically sacrifice individual case-accuracy for…

Machine Learning · Computer Science 2025-05-20 Alice Williams , Boris Kovalerchuk

An accurate model of the environment and the dynamic agents acting in it offers great potential for improving motion planning. We present MILE: a Model-based Imitation LEarning approach to jointly learn a model of the world and a policy for…

Computer Vision and Pattern Recognition · Computer Science 2022-11-04 Anthony Hu , Gianluca Corrado , Nicolas Griffiths , Zak Murez , Corina Gurau , Hudson Yeo , Alex Kendall , Roberto Cipolla , Jamie Shotton

End-to-end autonomous driving is a fully differentiable machine learning system that takes raw sensor input data and other metadata as prior information and directly outputs the ego vehicle's control signals or planned trajectories. This…

Robotics · Computer Science 2023-12-01 Apoorv Singh

Driver observation models are rarely deployed under perfect conditions. In practice, illumination, camera placement and type differ from the ones present during training and unforeseen behaviours may occur at any time. While observing the…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Alina Roitberg , Kunyu Peng , David Schneider , Kailun Yang , Marios Koulakis , Manuel Martinez , Rainer Stiefelhagen

End-to-end autonomous driving has been recently seen rapid development, exerting a profound influence on both industry and academia. However, the existing work places excessive focus on ego-vehicle status as their sole learning objectives…

Robotics · Computer Science 2025-08-08 Rui Yu , Xianghang Zhang , Runkai Zhao , Huaicheng Yan , Meng Wang

This study aims to improve the performance and generalization capability of end-to-end autonomous driving with scene understanding leveraging deep learning and multimodal sensor fusion techniques. The designed end-to-end deep neural network…

Robotics · Computer Science 2020-08-04 Zhiyu Huang , Chen Lv , Yang Xing , Jingda Wu