English
Related papers

Related papers: Safer End-to-End Autonomous Driving via Conditiona…

200 papers

Reinforcement learning is considered to be a strong AI paradigm which can be used to teach machines through interaction with the environment and learning from their mistakes, but it has not yet been successfully used for automotive…

Machine Learning · Statistics 2016-12-14 Ahmad El Sallab , Mohammed Abdou , Etienne Perot , Senthil Yogamani

The technology for autonomous vehicles is close to replacing human drivers by artificial systems endowed with high-level decision-making capabilities. In this regard, systems must learn about the usual vehicle's behavior to predict imminent…

Image and Video Processing · Electrical Eng. & Systems 2020-04-22 Mahdyar Ravanbakhsh , Mohamad Baydoun , Damian Campo , Pablo Marin , David Martin , Lucio Marcenaro , andCarlo Regazzoni

Learning high-performance control policies that remain consistent with expert behavior is a fundamental challenge in robotics. Reinforcement learning can discover high-performing strategies but often departs from desirable human behavior,…

Robotics · Computer Science 2026-04-06 Siwei Ju , Jan Tauberschmidt , Oleg Arenz , Peter van Vliet , Jan Peters

In many learning based control methodologies, learning the unknown dynamic model precedes the control phase, while the aim is to control the system such that it remains in some safe region of the state space. In this work, our aim is to…

Machine Learning · Computer Science 2021-05-14 Farhad Farokhi , Alex Leong , Iman Shames , Mohammad Zamani

One way to approach end-to-end autonomous driving is to learn a policy function that maps from a sensory input, such as an image frame from a front-facing camera, to a driving action, by imitating an expert driver, or a reference policy.…

Machine Learning · Computer Science 2016-05-23 Jiakai Zhang , Kyunghyun Cho

Traditional autonomous driving methods adopt a modular design, decomposing tasks into sub-tasks. In contrast, end-to-end autonomous driving directly outputs actions from raw sensor data, avoiding error accumulation. However, training an…

Robotics · Computer Science 2024-11-22 Zeyu Dong , Yimin Zhu , Yansong Li , Kevin Mahon , Yu Sun

We introduce Ignition: an end-to-end neural network architecture for training unconstrained self-driving vehicles in simulated environments. The model is a ResNet-18 variant, which is fed in images from the front of a simulated F1 car, and…

Computer Vision and Pattern Recognition · Computer Science 2018-07-02 Rooz Mahdavian , Richard Diehl Martinez

The current autonomous stack is well modularized and consists of perception, decision making and control in a handcrafted framework. With the advances in artificial intelligence (AI) and computing resources, researchers have been pushing…

Robotics · Computer Science 2024-04-19 Satya R. Jaladi , Zhimin Chen , Narahari R. Malayanur , Raja M. Macherla , Bing Li

Personalized motion planning holds significant importance within urban automated driving, catering to the unique requirements of individual users. Nevertheless, prior endeavors have frequently encountered difficulties in simultaneously…

Robotics · Computer Science 2024-08-06 Fangze Lin , Ying He , Fei Yu

The controller is one of the most important modules in the autonomous driving pipeline, ensuring the vehicle reaches its desired position. In this work, a reinforcement learning based lateral control approach, despite the imperfections in…

Robotics · Computer Science 2025-06-05 Chengdong Wu , Sven Kirchner , Nils Purschke , Alois C. Knoll

Autonomous driving presents many challenges due to the large number of scenarios the autonomous vehicle (AV) may encounter. End-to-end deep learning models are comparatively simplistic models that can handle a broad set of scenarios.…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Zhongying CuiZhu , Francois Charette , Amin Ghafourian , Debo Shi , Matthew Cui , Anjali Krishnamachar , Iman Soltani

Already today, driver assistance systems help to make daily traffic more comfortable and safer. However, there are still situations that are quite rare but are hard to handle at the same time. In order to cope with these situations and to…

Robotics · Computer Science 2021-01-13 Florian Wirthmüller , Marvin Klimke , Julian Schlechtriemen , Jochen Hipp , Manfred Reichert

World models learn the consequences of actions in vision-based interactive systems. However, in practical scenarios such as autonomous driving, there commonly exists noncontrollable dynamics independent of the action signals, making it…

Machine Learning · Computer Science 2022-12-20 Minting Pan , Xiangming Zhu , Yunbo Wang , Xiaokang Yang

Deep Neural Networks (DNNs) which are trained end-to-end have been successfully applied to solve complex problems that we have not been able to solve in past decades. Autonomous driving is one of the most complex problems which is yet to be…

End-to-end (E2E) autonomous driving models that take only camera images as input and directly predict a future trajectory are appealing for their computational efficiency and potential for improved generalization via unified optimization;…

Robotics · Computer Science 2026-04-10 Chihiro Noguchi , Takaki Yamamoto

Co-optimization of both vehicle speed and gear position via model predictive control (MPC) has been shown to offer benefits for fuel-efficient autonomous driving. However, optimizing both the vehicle's continuous dynamics and discrete gear…

Systems and Control · Electrical Eng. & Systems 2025-05-29 Samuel Mallick , Gianpietro Battocletti , Qizhang Dong , Azita Dabiri , Bart De Schutter

The autonomous driving community has witnessed a rapid growth in approaches that embrace an end-to-end algorithm framework, utilizing raw sensor input to generate vehicle motion plans, instead of concentrating on individual tasks such as…

Robotics · Computer Science 2024-08-16 Li Chen , Penghao Wu , Kashyap Chitta , Bernhard Jaeger , Andreas Geiger , Hongyang Li

Data availability has dramatically increased in recent years, driving model-based control methods to exploit learning techniques for improving the system description, and thus control performance. Two key factors that hinder the practical…

Systems and Control · Electrical Eng. & Systems 2022-11-22 Elena Arcari , Andrea Carron , Melanie N. Zeilinger

While conventional reinforcement learning focuses on designing agents that can perform one task, meta-learning aims, instead, to solve the problem of designing agents that can generalize to different tasks (e.g., environments, obstacles,…

Machine Learning · Computer Science 2021-09-06 Xiaowu Sun , Wael Fatnassi , Ulices Santa Cruz , Yasser Shoukry

Overtaking on two-lane roads is a great challenge for autonomous vehicles, as oncoming traffic appearing on the opposite lane may require the vehicle to change its decision and abort the overtaking. Deep reinforcement learning (DRL) has…

Robotics · Computer Science 2023-08-21 Jinxiong Lu , Gokhan Alcan , Ville Kyrki