English
Related papers

Related papers: End-to-end driving simulation via angle branched n…

200 papers

In this work, we study vision-based end-to-end reinforcement learning on vehicle control problems, such as lane following and collision avoidance. Our controller policy is able to control a small-scale robot to follow the right-hand lane of…

Machine Learning · Computer Science 2020-12-15 András Kalapos , Csaba Gór , Róbert Moni , István Harmati

Currently decision making is one of the biggest challenges in autonomous driving. This paper introduces a method for safely navigating an autonomous vehicle in highway scenarios by combining deep Q-Networks and insight from control theory.…

Robotics · Computer Science 2023-03-23 Max Peter Ronecker , Yuan Zhu

End-to-end learners for autonomous driving are deep neural networks that predict the instantaneous steering angle directly from images of the ahead-lying street. These learners must provide reliable uncertainty estimates for their…

Machine Learning · Statistics 2021-10-05 Clara Hoffmann , Nadja Klein

Machine learning has become increasingly popular for efficiently modelling the dynamics of complex physical systems, demonstrating a capability to learn effective models for dynamics which ignore redundant degrees of freedom. Learned…

Machine Learning · Computer Science 2022-11-29 Ameya Daigavane , Arthur Kosmala , Miles Cranmer , Tess Smidt , Shirley Ho

End-to-end approaches to autonomous driving have high sample complexity and are difficult to scale to realistic urban driving. Simulation can help end-to-end driving systems by providing a cheap, safe, and diverse training environment. Yet…

Robotics · Computer Science 2018-12-14 Matthias Müller , Alexey Dosovitskiy , Bernard Ghanem , Vladlen Koltun

An intelligent driving system should dynamically formulate appropriate driving strategies based on the current environment and vehicle status while ensuring system security and reliability. However, methods based on reinforcement learning…

Robotics · Computer Science 2025-09-11 Zuojin Tang , Xiaoyu Chen , Yongqiang Li , Jianyu Chen

Recent success suggests that deep neural control networks are likely to be a key component of self-driving vehicles. These networks are trained on large datasets to imitate human actions, but they lack semantic understanding of image…

Computer Vision and Pattern Recognition · Computer Science 2019-11-19 Jinkyu Kim , Teruhisa Misu , Yi-Ting Chen , Ashish Tawari , John Canny

Imitation learning is becoming more and more successful for autonomous driving. End-to-end (raw signal to command) performs well on relatively simple tasks (lane keeping and navigation). Mid-to-mid (environment abstraction to mid-level…

Artificial Intelligence · Computer Science 2019-09-04 Thibault Buhet , Emilie Wirbel , Xavier Perrotton

Enabling robots to autonomously navigate unknown, complex, and dynamic real-world environments presents several challenges, including imperfect perception, partial observability, localization uncertainty, and safety constraints. Current…

In this paper we present a complete study of an end-to-end imitation learning system for speed control of a real car, based on a neural network with a Long Short Term Memory (LSTM). To achieve robustness and generalization from expert…

Computer Vision and Pattern Recognition · Computer Science 2018-12-17 Laurent George , Thibault Buhet , Emilie Wirbel , Gaetan Le-Gall , Xavier Perrotton

In the modern era of automation and robotics, autonomous vehicles are currently the focus of academic and industrial research. With the ever increasing number of unmanned aerial vehicles getting involved in activities in the civilian and…

Robotics · Computer Science 2018-09-05 Saumya Kumaar , Arpit Sangotra , Sudakshin Kumar , Mayank Gupta , Navaneethkrishnan B , S N Omkar

A promising approach to autonomous driving is machine learning. In such systems, training datasets are created that capture the sensory input to a vehicle as well as the desired response. A disadvantage of using a learned navigation system…

Robotics · Computer Science 2016-06-28 Artem Provodin , Liila Torabi , Beat Flepp , Yann LeCun , Michael Sergio , L. D. Jackel , Urs Muller , Jure Zbontar

Obstacle avoidance is crucial for mobile robots' navigation in both known and unknown environments. This research designs, trains, and tests two custom Convolutional Neural Networks (CNNs), using color and depth images from a depth camera…

Robotics · Computer Science 2025-07-14 Lamiaa H. Zain , Hossam H. Ammar , Raafat E. Shalaby

Object goal navigation aims to navigate an agent to locations of a given object category in unseen environments. Classical methods explicitly build maps of environments and require extensive engineering while lacking semantic information…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Shizhe Chen , Thomas Chabal , Ivan Laptev , Cordelia Schmid

Autonomous intersection management (AIM) poses significant challenges due to the intricate nature of real-world traffic scenarios and the need for a highly expensive centralised server in charge of simultaneously controlling all the…

Robotics · Computer Science 2024-11-19 Matteo Cederle , Marco Fabris , Gian Antonio Susto

We use reinforcement learning in simulation to obtain a driving system controlling a full-size real-world vehicle. The driving policy takes RGB images from a single camera and their semantic segmentation as input. We use mostly synthetic…

Autonomous vehicles need to accomplish their tasks while interacting with human drivers in traffic. It is thus crucial to equip autonomous vehicles with artificial reasoning to better comprehend the intentions of the surrounding traffic,…

Artificial Intelligence · Computer Science 2023-11-02 Xiao Li , Kaiwen Liu , H. Eric Tseng , Anouck Girard , Ilya Kolmanovsky

Multi-stage decision-making is crucial in various real-world artificial intelligence applications, including recommendation systems, autonomous driving, and quantitative investment systems. In quantitative investment, for example, the…

Machine Learning · Computer Science 2024-11-19 Jian Guo , Saizhuo Wang , Yiyan Qi

End-to-end autonomous driving aims to produce planning trajectories from raw sensors directly. Currently, most approaches integrate perception, prediction, and planning modules into a fully differentiable network, promising great…

Robotics · Computer Science 2025-12-23 Pengxuan Yang , Yupeng Zheng , Qichao Zhang , Kefei Zhu , Zebin Xing , Qiao Lin , Yun-Fu Liu , Zhiguo Su , Dongbin Zhao

With the advent of autonomous driving technologies, traffic control at intersections is expected to experience revolutionary changes. Various novel intersection control methods have been proposed in the existing literature, and they can be…

Systems and Control · Electrical Eng. & Systems 2020-08-17 Chen Yang , Xi Lin , Meng Li , Fang He