English
Related papers

Related papers: Learning Multi-Modal Self-Awareness Models for Aut…

200 papers

End-to-end learning from sensory data has shown promising results in autonomous driving. While employing many sensors enhances world perception and should lead to more robust and reliable behavior of autonomous vehicles, it is challenging…

Robotics · Computer Science 2020-09-21 Shihong Fang , Anna Choromanska

Behaviour prediction function of an autonomous vehicle predicts the future states of the nearby vehicles based on the current and past observations of the surrounding environment. This helps enhance their awareness of the imminent hazards.…

Computer Vision and Pattern Recognition · Computer Science 2020-08-07 Sajjad Mozaffari , Omar Y. Al-Jarrah , Mehrdad Dianati , Paul Jennings , Alexandros Mouzakitis

Motion planning for autonomous vehicles sharing the road with human drivers remains challenging. The difficulty arises from three challenging aspects: human drivers are 1) multi-modal, 2) interacting with the autonomous vehicle, and 3)…

Robotics · Computer Science 2023-02-02 Rui Oliveira , Siddharth H. Nair , Bo Wahlberg

Convolutional Neural Networks (CNN) have been successfully applied to autonomous driving tasks, many in an end-to-end manner. Previous end-to-end steering control methods take an image or an image sequence as the input and directly predict…

Computer Vision and Pattern Recognition · Computer Science 2018-02-06 Zhengyuan Yang , Yixuan Zhang , Jerry Yu , Junjie Cai , Jiebo Luo

Autonomous driving systems require a deep understanding of human driving behaviors to achieve higher intelligence and safety.Despite advancements in deep learning, challenges such as long-tail distribution due to scarce samples and…

Artificial Intelligence · Computer Science 2025-03-19 Yilin Wang

Imitation learning is a promising approach for training autonomous vehicles (AV) to navigate complex traffic environments by mimicking expert driver behaviors. While existing imitation learning frameworks focus on leveraging expert…

Robotics · Computer Science 2025-09-25 Yasin Sonmez , Hanna Krasowski , Murat Arcak

This paper presents a novel approach to modeling human driving behavior, designed for use in evaluating autonomous vehicle control systems in a simulation environments. Our methodology leverages a hierarchical forward-looking, risk-aware…

Robotics · Computer Science 2024-08-20 Nathan Ludlow , Yiwei Lyu , John Dolan

Highly automated driving requires precise models of traffic participants. Many state of the art models are currently based on machine learning techniques. Among others, the required amount of labeled data is one major challenge. An…

Artificial Intelligence · Computer Science 2018-03-12 Maarten Bieshaar , Günther Reitberger , Viktor Kreß , Stefan Zernetsch , Konrad Doll , Erich Fuchs , Bernhard Sick

The advancements in connected and autonomous vehicles in these times demand the availability of tools providing the agents with the capability to be aware and predict their own states and context dynamics. This article presents a novel…

Autonomous cars have to navigate in dynamic environment which can be full of uncertainties. The uncertainties can come either from sensor limitations such as occlusions and limited sensor range, or from probabilistic prediction of other…

Robotics · Computer Science 2019-05-06 Liting Sun , Wei Zhan , Ching-Yao Chan , Masayoshi Tomizuka

Multi-sensor fusion plays a critical role in enhancing perception for autonomous driving, overcoming individual sensor limitations, and enabling comprehensive environmental understanding. This paper first formalizes multi-sensor fusion…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Chuheng Wei , Ziye Qin , Ziyan Zhang , Guoyuan Wu , Matthew J. Barth

A promising approach to autonomous driving is machine learning. In such systems, training datasets are created that capture the sensory input to a vehicle as well as the desired response. A disadvantage of using a learned navigation system…

Robotics · Computer Science 2016-06-28 Artem Provodin , Liila Torabi , Beat Flepp , Yann LeCun , Michael Sergio , L. D. Jackel , Urs Muller , Jure Zbontar

Deep learning and computer vision techniques have become increasingly important in the development of self-driving cars. These techniques play a crucial role in enabling self-driving cars to perceive and understand their surroundings,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Kanishkha Jaisankar , Pranav M. Pawar , Diana Susane Joseph , Raja Muthalagu , Mithun Mukherjee

In autonomous driving, perceiving the driving behaviors of surrounding agents is important for the ego-vehicle to make a reasonable decision. In this paper, we propose a neural network model based on trajectories information for driving…

Computer Vision and Pattern Recognition · Computer Science 2021-03-02 He Zhang , Zhixiong Nan , Tao Yang , Yifan Liu , Nanning Zheng

Autonomous vehicles have a great potential in the application of both civil and military fields, and have become the focus of research with the rapid development of science and economy. This article proposes a brief review on learning-based…

Robotics · Computer Science 2021-07-05 Qi Liu , Xueyuan Li , Shihua Yuan , Zirui Li

Accurate driving behavior recognition and reasoning are critical for autonomous driving video understanding. However, existing methods often tend to dig out the shallow causal, fail to address spurious correlations across modalities, and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Tongtong Cheng , Rongzhen Li , Yixin Xiong , Tao Zhang , Jing Wang , Kai Liu

Model-based approaches have become increasingly popular in the domain of automated driving. This includes runtime algorithms, such as Model Predictive Control, as well as formal and simulative approaches for the verification of automated…

Systems and Control · Electrical Eng. & Systems 2020-05-12 Marcus Nolte , Richard Schubert , Cordula Reisch , Markus Maurer

World models have gained significant attention as a promising approach for autonomous driving. By emulating human-like perception and decision-making processes, these models can predict and adapt to dynamic environments. Existing methods…

Robotics · Computer Science 2025-12-03 Huiqian Li , Wei Pan , Haodong Zhang , Jin Huang , Zhihua Zhong

We propose a model predictive control approach for autonomous vehicles that exploits learned Gaussian processes for predicting human driving behavior. The proposed approach employs the uncertainty about the GP's prediction to achieve…

Systems and Control · Electrical Eng. & Systems 2023-03-09 Johanna Bethge , Maik Pfefferkorn , Alexander Rose , Jan Peters , Rolf Findeisen

Traffic scene recognition, which requires various visual classification tasks, is a critical ingredient in autonomous vehicles. However, most existing approaches treat each relevant task independently from one another, never considering the…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 Younkwan Lee , Jihyo Jeon , Jongmin Yu , Moongu Jeon