English
Related papers

Related papers: Behavioral Cloning Models Reality Check for Autono…

200 papers

Recent advances in Behavior Cloning (BC) have led to strong performance in robotic manipulation, driven by expressive models, sequence modeling of actions, and large-scale demonstration data. However, BC faces significant challenges when…

Robotics · Computer Science 2025-08-05 Sung-Wook Lee , Xuhui Kang , Brandon Yang , Yen-Ling Kuo

Convolutional Neural Networks (CNN) have been successfully applied to autonomous driving tasks, many in an end-to-end manner. Previous end-to-end steering control methods take an image or an image sequence as the input and directly predict…

Computer Vision and Pattern Recognition · Computer Science 2018-02-06 Zhengyuan Yang , Yixuan Zhang , Jerry Yu , Junjie Cai , Jiebo Luo

Guaranteeing constraint satisfaction is challenging in imitation learning (IL), particularly in tasks that require operating near a system's handling limits. Traditional IL methods, such as Behavior Cloning (BC), often struggle to enforce…

Machine Learning · Computer Science 2025-08-29 Shengfan Cao , Eunhyek Joa , Francesco Borrelli

In safety-critical systems that interface with the real world, the role of uncertainty in decision-making is pivotal, particularly in the context of machine learning models. For the secure functioning of Cyber-Physical Systems (CPS), it is…

Machine Learning · Computer Science 2024-04-29 Neha Kumari , Sumit Kumar. Sneha Priya , Ayush Kumar , Akash Fogla

We present an integrated approach for perception and control for an autonomous vehicle and demonstrate this approach in a high-fidelity urban driving simulator. Our approach first builds a model for the environment, then trains a policy…

Systems and Control · Electrical Eng. & Systems 2020-03-19 Ali Baheri , Ilya Kolmanovsky , Anouck Girard , H. Eric Tseng , Dimitar Filev

A key component in autonomous driving is the ability of the self-driving car to understand, track and predict the dynamics of the surrounding environment. Although there is significant work in the area of object detection, tracking and…

Robotics · Computer Science 2021-07-20 Cosmin Ginerica , Mihai Zaha , Florin Gogianu , Lucian Busoniu , Bogdan Trasnea , Sorin Grigorescu

Behavioral cloning is an imitation learning technique that teaches an agent how to behave through expert demonstrations. Recent approaches use self-supervision of fully-observable unlabeled snapshots of the states to decode state-pairs into…

Machine Learning · Computer Science 2020-08-14 Nathan Gavenski , Juarez Monteiro , Roger Granada , Felipe Meneguzzi , Rodrigo C. Barros

Autonomous vehicles are becoming popular day by day not only for autonomous road traversal but also for industrial automation, farming and military. Most of the standard vehicles follow the Ackermann style steering mechanism. This has…

Robotics · Computer Science 2025-11-27 Shantanu Rahman , Nayeb Hasin , Mainul Islam , Golam Sarowar

In recent years, autonomous driving algorithms using low-cost vehicle-mounted cameras have attracted increasing endeavors from both academia and industry. There are multiple fronts to these endeavors, including object detection on roads,…

Computer Vision and Pattern Recognition · Computer Science 2017-08-15 Lu Chi , Yadong Mu

In this paper, we present a state-of-the-art reinforcement learning method for autonomous driving. Our approach employs temporal difference learning in a Bayesian framework to learn vehicle control signals from sensor data. The agent has…

Computer Vision and Pattern Recognition · Computer Science 2021-04-09 Zahra Gharaee , Karl Holmquist , Linbo He , Michael Felsberg

Behavior Cloning (BC) is an effective imitation learning technique and has even been adopted in some safety-critical domains such as autonomous vehicles. BC trains a policy to mimic the behavior of an expert by using a dataset composed of…

Machine Learning · Computer Science 2025-08-12 Shili Wu , Yizhao Jin , Puhua Niu , Aniruddha Datta , Sean B. Andersson

End-to-end visual-based imitation learning has been widely applied in autonomous driving. When deploying the trained visual-based driving policy, a deterministic command is usually directly applied without considering the uncertainty of the…

Robotics · Computer Science 2019-07-19 Lei Tai , Peng Yun , Yuying Chen , Congcong Liu , Haoyang Ye , Ming Liu

Recent advances in behavior cloning (BC) have enabled impressive visuomotor control policies. However, these approaches are limited by the quality of human demonstrations, the manual effort required for data collection, and the diminishing…

Robotics · Computer Science 2025-09-29 Lars Ankile , Zhenyu Jiang , Rocky Duan , Guanya Shi , Pieter Abbeel , Anusha Nagabandi

Braking system, the key module to ensure the safety and steer-ability of current vehicles, relies on extensive manual calibration during production. Reducing labor and time consumption while maintaining the Vehicle Braking Controller (VBC)…

Robotics · Computer Science 2026-04-07 Haoxin Lin , Junjie Zhou , Daheng Xu , Yang Yu

We present a novel method for testing the safety of self-driving vehicles in simulation. We propose an alternative to sensor simulation, as sensor simulation is expensive and has large domain gaps. Instead, we directly simulate the outputs…

Computer Vision and Pattern Recognition · Computer Science 2020-08-14 Kelvin Wong , Qiang Zhang , Ming Liang , Bin Yang , Renjie Liao , Abbas Sadat , Raquel Urtasun

Driver observation models are rarely deployed under perfect conditions. In practice, illumination, camera placement and type differ from the ones present during training and unforeseen behaviours may occur at any time. While observing the…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Alina Roitberg , Kunyu Peng , David Schneider , Kailun Yang , Marios Koulakis , Manuel Martinez , Rainer Stiefelhagen

This paper aims to investigate direct imitation learning from human drivers for the task of lane keeping assistance in highway and country roads using grayscale images from a single front view camera. The employed method utilizes…

Machine Learning · Computer Science 2017-09-13 Christopher Innocenti , Henrik Lindén , Ghazaleh Panahandeh , Lennart Svensson , Nasser Mohammadiha

Numerous groups have applied a variety of deep learning techniques to computer vision problems in highway perception scenarios. In this paper, we presented a number of empirical evaluations of recent deep learning advances. Computer vision,…

Designing a controller for autonomous vehicles capable of providing adequate performance in all driving scenarios is challenging due to the highly complex environment and inability to test the system in the wide variety of scenarios which…

Machine Learning · Computer Science 2019-12-24 Sampo Kuutti , Richard Bowden , Yaochu Jin , Phil Barber , Saber Fallah

This paper presents a novel approach for learning self-awareness models for autonomous vehicles. The proposed technique is based on the availability of synchronized multi-sensor dynamic data related to different maneuvering tasks performed…

Computer Vision and Pattern Recognition · Computer Science 2018-06-08 Mahdyar Ravanbakhsh , Mohamad Baydoun , Damian Campo , Pablo Marin , David Martin , Lucio Marcenaro , Carlo S. Regazzoni