English
Related papers

Related papers: Driving Through Ghosts: Behavioral Cloning with Fa…

200 papers

Connected Autonomous Vehicles have great potential to improve automobile safety and traffic flow, especially in cooperative applications where perception data is shared between vehicles. However, this cooperation must be secured from…

Robotics · Computer Science 2024-09-05 Edward Andert , Francis Mendoza , Hans Walter Behrens , Aviral Shrivastava

In this paper, we present a system to train driving policies from experiences collected not just from the ego-vehicle, but all vehicles that it observes. This system uses the behaviors of other agents to create more diverse driving…

Robotics · Computer Science 2022-09-13 Dian Chen , Philipp Krähenbühl

Trustworthy AI is mandatory for the broad deployment of autonomous vehicles. Although end-to-end approaches derive control commands directly from raw data, interpreting these decisions remains challenging, especially in complex urban…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Mona Mirzaie , Bodo Rosenhahn

An outstanding challenge for the widespread deployment of robotic systems like autonomous vehicles is ensuring safe interaction with humans without sacrificing performance. Existing safety methods often neglect the robot's ability to learn…

Robotics · Computer Science 2023-11-03 Haimin Hu , Zixu Zhang , Kensuke Nakamura , Andrea Bajcsy , Jaime F. Fisac

Deep learning and computer vision techniques have become increasingly important in the development of self-driving cars. These techniques play a crucial role in enabling self-driving cars to perceive and understand their surroundings,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Kanishkha Jaisankar , Pranav M. Pawar , Diana Susane Joseph , Raja Muthalagu , Mithun Mukherjee

The overall goal of this work is to enrich training data for automated driving with so called corner cases. In road traffic, corner cases are critical, rare and unusual situations that challenge the perception by AI algorithms. For this…

Computer Vision and Pattern Recognition · Computer Science 2022-10-24 Kamil Kowol , Stefan Bracke , Hanno Gottschalk

In driving scenarios with poor visibility or occlusions, it is important that the autonomous vehicle would take into account all the uncertainties when making driving decisions, including choice of a safe speed. The grid-based perception…

Computer Vision and Pattern Recognition · Computer Science 2022-11-09 Markus Kängsepp , Meelis Kull

Widespread adoption of self-driving cars will depend not only on their safety but largely on their ability to interact with human users. Just like human drivers, self-driving cars will be expected to understand and safely follow…

Robotics · Computer Science 2019-10-18 Junha Roh , Chris Paxton , Andrzej Pronobis , Ali Farhadi , Dieter Fox

We challenge the perceived consensus that the application of deep learning to solve the automated driving planning task necessarily requires huge amounts of real-world data or highly realistic simulation. Focusing on a roundabout scenario,…

Robotics · Computer Science 2024-01-04 Martin Stoll , Markus Mazzola , Maxim Dolgov , Jürgen Mathes , Nicolas Möser

Traffic safety science has long been hindered by a fundamental data paradox: the crashes we most wish to prevent are precisely those events we rarely observe. Existing crash-frequency models and surrogate safety metrics rely heavily on…

Imitation learning is becoming more and more successful for autonomous driving. End-to-end (raw signal to command) performs well on relatively simple tasks (lane keeping and navigation). Mid-to-mid (environment abstraction to mid-level…

Artificial Intelligence · Computer Science 2019-09-04 Thibault Buhet , Emilie Wirbel , Xavier Perrotton

Ensuring safety in autonomous systems with vision-based control remains a critical challenge due to the high dimensionality of image inputs and the fact that the relationship between true system state and its visual manifestation is…

Robotics · Computer Science 2025-11-12 Xinhang Ma , Junlin Wu , Hussein Sibai , Yiannis Kantaros , Yevgeniy Vorobeychik

A general-purpose intelligent robot must be able to learn autonomously and be able to accomplish multiple tasks in order to be deployed in the real world. However, standard reinforcement learning approaches learn separate task-specific…

Robotics · Computer Science 2018-10-17 Gregory Kahn , Adam Villaflor , Pieter Abbeel , Sergey Levine

In this work, we present a lightweight pipeline for robust behavioral cloning of a human driver using end-to-end imitation learning. The proposed pipeline was employed to train and deploy three distinct driving behavior models onto a…

Robotics · Computer Science 2021-10-19 Tanmay Vilas Samak , Chinmay Vilas Samak , Sivanathan Kandhasamy

A framework is presented for handling a potential loss of observability of a dynamical system in a provably-safe way. Inspired by the fragility of data-driven perception systems used by autonomous vehicles, we formulate the problem that…

Systems and Control · Electrical Eng. & Systems 2020-05-19 Forrest Laine , Chiu-Yuan Chiu , Claire Tomlin

Guaranteeing constraint satisfaction is challenging in imitation learning (IL), particularly in tasks that require operating near a system's handling limits. Traditional IL methods, such as Behavior Cloning (BC), often struggle to enforce…

Machine Learning · Computer Science 2025-08-29 Shengfan Cao , Eunhyek Joa , Francesco Borrelli

Perception systems, especially cameras, are the eyes of automated driving systems. Ensuring that they function reliably and robustly is therefore an important building block in the automation of vehicles. There are various approaches to…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Philipp Rigoll , Laurenz Adolph , Lennart Ries , Eric Sax

To ensure user acceptance of autonomous vehicles (AVs), control systems are being developed to mimic human drivers from demonstrations of desired driving behaviors. Imitation learning (IL) algorithms serve this purpose, but struggle to…

Robotics · Computer Science 2022-06-27 Flavia Sofia Acerbo , Jan Swevers , Tinne Tuytelaars , Tong Duy Son

Learning-based autonomous driving systems are trained mostly on incident-free data, offering little guidance near safety-performance boundaries. Real crash reports contain precisely the contrastive evidence needed, but they are hard to use:…

Robotics · Computer Science 2025-09-24 Jay Patrikar , Apoorva Sharma , Sushant Veer , Boyi Li , Sebastian Scherer , Marco Pavone

We present a novel method for testing the safety of self-driving vehicles in simulation. We propose an alternative to sensor simulation, as sensor simulation is expensive and has large domain gaps. Instead, we directly simulate the outputs…

Computer Vision and Pattern Recognition · Computer Science 2020-08-14 Kelvin Wong , Qiang Zhang , Ming Liang , Bin Yang , Renjie Liao , Abbas Sadat , Raquel Urtasun