English
Related papers

Related papers: Vehicle Dynamics Embedded World Models for Autonom…

200 papers

We present a new interaction mechanism of prediction and planning for end-to-end autonomous driving, called PPAD (Iterative Interaction of Prediction and Planning Autonomous Driving), which considers the timestep-wise interaction to better…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Zhili Chen , Maosheng Ye , Shuangjie Xu , Tongyi Cao , Qifeng Chen

Directly producing planning results from raw sensors has been a long-desired solution for autonomous driving and has attracted increasing attention recently. Most existing end-to-end autonomous driving methods factorize this problem into…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Wenzhao Zheng , Ruiqi Song , Xianda Guo , Chenming Zhang , Long Chen

Focusing on the task of point-to-point navigation for an autonomous driving vehicle, we propose a novel deep learning model trained with end-to-end and multi-task learning manners to perform both perception and control tasks simultaneously.…

Robotics · Computer Science 2022-06-23 Oskar Natan , Jun Miura

Efficient scalability of automated driving (AD) is key to reducing costs, enhancing safety, conserving resources, and maximizing impact. However, research focuses on specific vehicles and context, while broad deployment requires scalability…

Computers and Society · Computer Science 2025-07-25 Lars Ullrich , Michael Buchholz , Jonathan Petit , Klaus Dietmayer , Knut Graichen

Autonomous vehicles with a self-evolving ability are expected to cope with unknown scenarios in the real-world environment. Take advantage of trial and error mechanism, reinforcement learning is able to self evolve by learning the optimal…

Robotics · Computer Science 2024-08-23 Shuo Yang , Liwen Wang , Yanjun Huang , Hong Chen

State-of-the-art approaches for autonomous driving integrate multiple sub-tasks of the overall driving task into a single pipeline that can be trained in an end-to-end fashion by passing latent representations between the different modules.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Simon Doll , Niklas Hanselmann , Lukas Schneider , Richard Schulz , Marius Cordts , Markus Enzweiler , Hendrik P. A. Lensch

As autonomous driving technology progresses, the need for precise trajectory prediction models becomes paramount. This paper introduces an innovative model that infuses cognitive insights into trajectory prediction, focusing on perceived…

With the development of autonomous driving technology, there are increasing demands for vehicle control, and MPC has become a widely researched topic in both industry and academia. Existing MPC control methods based on vehicle kinematics or…

Systems and Control · Electrical Eng. & Systems 2024-07-19 Jiarui Zhang , Aijing Kong , Yu Tang , Zhichao Lv , Lulu Guo , Peng Hang

Holistically understanding an object and its 3D movable parts through visual perception models is essential for enabling an autonomous agent to interact with the world. For autonomous driving, the dynamics and states of vehicle parts such…

Computer Vision and Pattern Recognition · Computer Science 2021-01-07 Feixiang Lu , Zongdai Liu , Hui Miao , Peng Wang , Liangjun Zhang , Ruigang Yang , Dinesh Manocha , Bin Zhou

Vision-Language-Action (VLA) models have recently achieved notable progress in end-to-end autonomous driving by integrating perception, reasoning, and control within a unified multimodal framework. However, they often lack explicit modeling…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Guoqing Wang , Pin Tang , Xiangxuan Ren , Guodongfang Zhao , Bailan Feng , Chao Ma

Recent video diffusion models generate photorealistic, temporally coherent videos, yet they fall short as reliable world models for autonomous driving, where structured motion and physically consistent interactions are essential. Adapting…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Ahmad Rahimi , Valentin Gerard , Eloi Zablocki , Matthieu Cord , Alexandre Alahi

Model-based approaches have become increasingly popular in the domain of automated driving. This includes runtime algorithms, such as Model Predictive Control, as well as formal and simulative approaches for the verification of automated…

Systems and Control · Electrical Eng. & Systems 2020-05-12 Marcus Nolte , Richard Schubert , Cordula Reisch , Markus Maurer

Autonomous driving presents a complex challenge, which is usually addressed with artificial intelligence models that are end-to-end or modular in nature. Within the landscape of modular approaches, a bio-inspired neural circuit policy model…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Anass Bairouk , Mirjana Maras , Simon Herlin , Alexander Amini , Marc Blanchon , Ramin Hasani , Patrick Chareyre , Daniela Rus

Recent years have seen remarkable progress in autonomous driving, yet generalization to long-tail and open-world scenarios remains a major bottleneck for large-scale deployment. To address this challenge, some works use LLMs and VLMs for…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Hao Shao , Letian Wang , Yang Zhou , Yuxuan Hu , Zhuofan Zong , Steven L. Waslander , Wei Zhan , Hongsheng Li

Scenario-based testing for automated driving systems (ADS) must be able to simulate traffic scenarios that rely on interactions with other vehicles. Although many languages for high-level scenario modelling have been proposed, they lack the…

While there have been advancements in autonomous driving control and traffic simulation, there have been little to no works exploring their unification with deep learning. Works in both areas seem to focus on entirely different exclusive…

Robotics · Computer Science 2023-04-10 Laura Zheng , Sanghyun Son , Ming C. Lin

The lack of generalization in learning-based autonomous driving applications is shown by the narrow range of road scenarios that vehicles can currently cover. A generalizable approach should capture many distinct road structures and…

Machine Learning · Computer Science 2025-04-25 Juan Carlos Climent Pardo

World models, which are predictive representations of how environments evolve under actions, have become a central component of robot learning. They support policy learning, planning, simulation, evaluation, data generation, and have…

In this paper, we introduce the first large-scale video prediction model in the autonomous driving discipline. To eliminate the restriction of high-cost data collection and empower the generalization ability of our model, we acquire massive…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Jiazhi Yang , Shenyuan Gao , Yihang Qiu , Li Chen , Tianyu Li , Bo Dai , Kashyap Chitta , Penghao Wu , Jia Zeng , Ping Luo , Jun Zhang , Andreas Geiger , Yu Qiao , Hongyang Li

World model-based searching and planning are widely recognized as a promising path toward human-level physical intelligence. However, current driving world models primarily rely on video diffusion models, which specialize in visual…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 Yuntao Chen , Yuqi Wang , Zhaoxiang Zhang