English
Related papers

Related papers: World Models for Autonomous Driving: An Initial Su…

200 papers

Inspired by widely-used techniques of causal modelling in risk, failure, and accident analysis, this work discusses a compositional framework for risk modelling. Risk models capture fragments of the space of risky events likely to occur…

Software Engineering · Computer Science 2025-03-21 Mario Gleirscher

Autonomous vehicles (AV) look set to become common on our roads within the next few years. However, to achieve the final breakthrough, not only functional progress is required, but also satisfactory safety assurance must be provided. Among…

Robotics · Computer Science 2025-06-04 Peter Popov , Lorenzo Strigini , Cornelius Buerkle , Fabian Oboril , Michael Paulitsch

With the rapid development of machine learning, autonomous driving has become a hot issue, making urgent demands for more intelligent perception and planning systems. Self-driving cars can avoid traffic crashes with precisely predicted…

Robotics · Computer Science 2021-11-01 Jianbang Liu , Xinyu Mao , Yuqi Fang , Delong Zhu , Max Q. -H. Meng

As autonomous driving technology matures, end-to-end methodologies have emerged as a leading strategy, promising seamless integration from perception to control via deep learning. However, existing systems grapple with challenges such as…

Behaviour prediction function of an autonomous vehicle predicts the future states of the nearby vehicles based on the current and past observations of the surrounding environment. This helps enhance their awareness of the imminent hazards.…

Computer Vision and Pattern Recognition · Computer Science 2020-08-07 Sajjad Mozaffari , Omar Y. Al-Jarrah , Mehrdad Dianati , Paul Jennings , Alexandros Mouzakitis

One of the most exciting technology breakthroughs in the last few years has been the rise of deep learning. State-of-the-art deep learning models are being widely deployed in academia and industry, across a variety of areas, from image…

Machine Learning · Computer Science 2019-06-25 Kanwar Bharat Singh , Mustafa Ali Arat

Interaction-aware Autonomous Driving (IAAD) is a rapidly growing field of research that focuses on the development of autonomous vehicles (AVs) that are capable of interacting safely and efficiently with human road users. This is a…

Human-Computer Interaction · Computer Science 2023-11-01 Luca Crosato , Kai Tian , Hubert P. H Shum , Edmond S. L. Ho , Yafei Wang , Chongfeng Wei

World models have become central to autonomous driving, where accurate scene understanding and future prediction are crucial for safe control. Recent work has explored using vision-language models (VLMs) for planning, yet existing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Zhexiao Xiong , Xin Ye , Burhan Yaman , Sheng Cheng , Yiren Lu , Jingru Luo , Nathan Jacobs , Liu Ren

Understanding how the 3D scene evolves is vital for making decisions in autonomous driving. Most existing methods achieve this by predicting the movements of object boxes, which cannot capture more fine-grained scene information. In this…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Wenzhao Zheng , Weiliang Chen , Yuanhui Huang , Borui Zhang , Yueqi Duan , Jiwen Lu

The goal of autonomous vehicles is to navigate public roads safely and comfortably. To enforce safety, traditional planning approaches rely on handcrafted rules to generate trajectories. Machine learning-based systems, on the other hand,…

Recent progress in advanced driver assistance systems and the race towards autonomous vehicles is mainly driven by two factors: (1) increasingly sophisticated algorithms that interpret the environment around the vehicle and react…

Computer Vision and Pattern Recognition · Computer Science 2017-04-04 Marius Cordts , Timo Rehfeld , Lukas Schneider , David Pfeiffer , Markus Enzweiler , Stefan Roth , Marc Pollefeys , Uwe Franke

A self-driving vehicle must understand its environment to determine the appropriate action. Traditional autonomy systems rely on object detection to find the agents in the scene. However, object detection assumes a discrete set of objects…

Robotics · Computer Science 2024-04-03 Sourav Biswas , Sergio Casas , Quinlan Sykora , Ben Agro , Abbas Sadat , Raquel Urtasun

Data-efficient learning remains a central challenge in autonomous driving due to the high cost and safety risks of large-scale real-world interaction. Although world-model-based reinforcement learning enables policy optimization through…

Robotics · Computer Science 2026-03-10 Jiazhuo Li , Linjiang Cao , Qi Liu , Xi Xiong

The field of autonomous mobile robots has undergone dramatic advancements over the past decades. Despite achieving important milestones, several challenges are yet to be addressed. Aggregating the achievements of the robotic community as…

World models for autonomous driving have the potential to dramatically improve the reasoning capabilities of today's systems. However, most works focus on camera data, with only a few that leverage lidar data or combine both to better…

Machine Learning · Computer Science 2025-08-21 Daniel Bogdoll , Yitian Yang , Tim Joseph , Melih Yazgan , J. Marius Zöllner

Learning-based controllers are often purposefully kept out of real-world applications due to concerns about their safety and reliability. We explore how state-of-the-art world models in Model-Based Reinforcement Learning can be utilized…

Robotics · Computer Science 2025-03-05 Fabian Domberg , Georg Schildbach

Autonomous cars have to navigate in dynamic environment which can be full of uncertainties. The uncertainties can come either from sensor limitations such as occlusions and limited sensor range, or from probabilistic prediction of other…

Robotics · Computer Science 2019-05-06 Liting Sun , Wei Zhan , Ching-Yao Chan , Masayoshi Tomizuka

Autonomous driving technology can improve traffic safety and reduce traffic accidents. In addition, it improves traffic flow, reduces congestion, saves energy and increases travel efficiency. In the relatively mature automatic driving…

Robotics · Computer Science 2024-03-13 Wenjian Sun , Linying Pan , Jingyu Xu , Weixiang Wan , Yong Wang

Autonomous systems have gained an important role in many industry domains and are beginning to change everyday life. However, due to dynamically emerging applications and often proprietary constraints, there is a lack of information about…

Software Engineering · Computer Science 2025-06-06 Katerina Goseva-Popstojanova , Denny Hood , Johann Schumann , Noble Nkwocha

The increasing complexity and unpredictability of many ICT scenarios let us envision that future systems will have to dynamically learn how to act and adapt to face evolving situations with little or no a priori knowledge, both at the level…

Artificial Intelligence · Computer Science 2021-10-05 Marco Lippi , Stefano Mariani , Matteo Martinelli , Franco Zambonelli