English
Related papers

Related papers: GenAD: Generalized Predictive Model for Autonomous…

200 papers

Autonomous driving gained huge traction in recent years, due to its potential to change the way we commute. Much effort has been put into trying to estimate the state of a vehicle. Meanwhile, learning to forecast the state of a vehicle…

Computer Vision and Pattern Recognition · Computer Science 2021-09-28 Eitan Kosman , Dotan Di Castro

We present a novel dataset covering seasonal and challenging perceptual conditions for autonomous driving. Among others, it enables research on visual odometry, global place recognition, and map-based re-localization tracking. The data was…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Patrick Wenzel , Rui Wang , Nan Yang , Qing Cheng , Qadeer Khan , Lukas von Stumberg , Niclas Zeller , Daniel Cremers

Autonomous driving requires a comprehensive understanding of the surrounding environment for reliable trajectory planning. Previous works rely on dense rasterized scene representation (e.g., agent occupancy and semantic map) to perform…

The ability to predict the future movements of other vehicles is a subconscious and effortless skill for humans and key to safe autonomous driving. Therefore, trajectory prediction for autonomous cars has gained a lot of attention in recent…

Robotics · Computer Science 2021-09-16 Benedikt Mersch , Thomas Höllen , Kun Zhao , Cyrill Stachniss , Ribana Roscher

Current autonomous driving systems are composed of a perception system and a decision system. Both of them are divided into multiple subsystems built up with lots of human heuristics. An end-to-end approach might clean up the system and…

Computer Vision and Pattern Recognition · Computer Science 2020-10-12 Jianyu Chen , Zhuo Xu , Masayoshi Tomizuka

The advancement of safety-critical research in driving behavior in ADAS-equipped vehicles require real-world datasets that not only include diverse traffic scenarios but also capture high-risk edge cases such as near-miss events and system…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Shaoyan Zhai , Mohamed Abdel-Aty , Chenzhu Wang , Rodrigo Vena Garcia

The primary focus of autonomous driving research is to improve driving accuracy. While great progress has been made, state-of-the-art algorithms still fail at times. Such failures may have catastrophic consequences. It therefore is…

Computer Vision and Pattern Recognition · Computer Science 2018-05-07 Simon Hecker , Dengxin Dai , Luc Van Gool

We develop a novel generative model to simulate vehicle health and forecast faults, conditioned on practical operational considerations. The model, trained on data from the US Army's Predictive Logistics program, aims to support predictive…

Machine Learning · Computer Science 2024-07-31 Patrick Kuiper , Sirui Lin , Jose Blanchet , Vahid Tarokh

End-to-end autonomous driving systems built on Vision Language Models (VLMs) have shown significant promise, yet their reliance on autoregressive architectures introduces some limitations for real-world applications. The sequential,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Can Cui , Yupeng Zhou , Juntong Peng , Sung-Yeon Park , Zichong Yang , Prashanth Sankaranarayanan , Jiaru Zhang , Ruqi Zhang , Ziran Wang

A key component in autonomous driving is the ability of the self-driving car to understand, track and predict the dynamics of the surrounding environment. Although there is significant work in the area of object detection, tracking and…

Robotics · Computer Science 2021-07-20 Cosmin Ginerica , Mihai Zaha , Florin Gogianu , Lucian Busoniu , Bogdan Trasnea , Sorin Grigorescu

World models that forecast environmental changes from actions are vital for autonomous driving models with strong generalization. The prevailing driving world model mainly build on video prediction model. Although these models can produce…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Jingcheng Ni , Yuxin Guo , Yichen Liu , Rui Chen , Lewei Lu , Zehuan Wu

To achieve full autonomous driving, a good understanding of the surrounding environment is necessary. Especially predicting the future states of other traffic participants imposes a non-trivial challenge. Current SotA-models already show…

Machine Learning · Computer Science 2025-07-25 Daniel Grimm , Ahmed Abouelazm , J. Marius Zöllner

Action anticipation is critical in scenarios where one needs to react before the action is finalized. This is, for instance, the case in automated driving, where a car needs to, e.g., avoid hitting pedestrians and respect traffic lights.…

Computer Vision and Pattern Recognition · Computer Science 2018-10-31 Mohammad Sadegh Aliakbarian , Fatemeh Sadat Saleh , Mathieu Salzmann , Basura Fernando , Lars Petersson , Lars Andersson

The validation of autonomous driving systems benefits greatly from the ability to generate scenarios that are both realistic and precisely controllable. Conventional approaches, such as real-world test drives, are not only expensive but…

Robotics · Computer Science 2025-04-01 Yizhuo Xiao , Mustafa Suphi Erden , Cheng Wang

Emerging generative world models and vision-language-action (VLA) systems are rapidly reshaping automated driving by enabling scalable simulation, long-horizon forecasting, and capability-rich decision making. Across these directions,…

Robotics · Computer Science 2026-03-11 Rongxiang Zeng , Yongqi Dong

With the rapid development of machine learning, autonomous driving has become a hot issue, making urgent demands for more intelligent perception and planning systems. Self-driving cars can avoid traffic crashes with precisely predicted…

Robotics · Computer Science 2021-11-01 Jianbang Liu , Xinyu Mao , Yuqi Fang , Delong Zhu , Max Q. -H. Meng

Recent successful video generation systems that predict and create realistic automotive driving scenes from short video inputs assign tokenization, future state prediction (world model), and video decoding to dedicated models. These…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Björn Möller , Zhengyang Li , Malte Stelzer , Thomas Graave , Fabian Bettels , Muaaz Ataya , Tim Fingscheidt

Automated lane changing is a critical feature for advanced autonomous driving systems. In recent years, reinforcement learning (RL) algorithms trained on traffic simulators yielded successful results in computing lane changing policies that…

Robotics · Computer Science 2021-03-16 Anil Ozturk , Mustafa Burak Gunel , Melih Dal , Ugur Yavas , Nazim Kemal Ure

Autonomous driving needs fast, scalable 4D reconstruction and re-simulation for training and evaluation, yet most methods for dynamic driving scenes still rely on per-scene optimization, known camera calibration, or short frame windows,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Xiaoxue Chen , Ziyi Xiong , Yuantao Chen , Gen Li , Nan Wang , Hongcheng Luo , Long Chen , Haiyang Sun , Bing Wang , Guang Chen , Hangjun Ye , Hongyang Li , Ya-Qin Zhang , Hao Zhao

Retrieving rare and safety-critical driving scenarios from large-scale datasets is essential for building robust autonomous driving (AD) systems. As dataset sizes continue to grow, the key challenge shifts from collecting more data to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Felix Embacher , Jonas Uhrig , Marius Cordts , Markus Enzweiler