English
Related papers

Related papers: World Models for Autonomous Driving: An Initial Su…

200 papers

World models are emerging as a transformative paradigm in artificial intelligence, enabling agents to construct internal representations of their environments for predictive reasoning, planning, and decision-making. By learning latent…

Artificial Intelligence · Computer Science 2025-06-03 Changyuan Zhao , Ruichen Zhang , Jiacheng Wang , Gaosheng Zhao , Dusit Niyato , Geng Sun , Shiwen Mao , Dong In Kim

Autonomous vehicles currently suffer from a time-inefficient driving style caused by uncertainty about human behavior in traffic interactions. Accurate and reliable prediction models enabling more efficient trajectory planning could make…

Robotics · Computer Science 2023-02-21 Julian Frederik Schumann , Jens Kober , Arkady Zgonnikov

End-to-End driving is a promising paradigm as it circumvents the drawbacks associated with modular systems, such as their overwhelming complexity and propensity for error propagation. Autonomous driving transcends conventional traffic…

Robotics · Computer Science 2023-09-20 Pranav Singh Chib , Pravendra Singh

Motion prediction, recently popularized as world models, refers to the anticipation of future agent states or scene evolution, which is rooted in human cognition, bridging perception and decision-making. It enables intelligent systems, such…

World models, especially in autonomous driving, are trending and drawing extensive attention due to their capacity for comprehending driving environments. The established world model holds immense potential for the generation of…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Xiaofeng Wang , Zheng Zhu , Guan Huang , Xinze Chen , Jiagang Zhu , Jiwen Lu

Autonomous driving techniques have been flourishing in recent years while thirsting for huge amounts of high-quality data. However, it is difficult for real-world datasets to keep up with the pace of changing requirements due to their…

Image and Video Processing · Electrical Eng. & Systems 2024-02-29 Zhihang Song , Zimin He , Xingyu Li , Qiming Ma , Ruibo Ming , Zhiqi Mao , Huaxin Pei , Lihui Peng , Jianming Hu , Danya Yao , Yi Zhang

A world model creates a surrogate world to train a controller and predict safety violations by learning the internal dynamic model of systems. However, the existing world models rely solely on statistical learning of how observations change…

Machine Learning · Computer Science 2024-05-06 Zhenjiang Mao , Siqi Dai , Yuang Geng , Ivan Ruchkin

This paper explores the emerging knowledge-driven autonomous driving technologies. Our investigation highlights the limitations of current autonomous driving systems, in particular their sensitivity to data bias, difficulty in handling…

General world models represent a crucial pathway toward achieving Artificial General Intelligence (AGI), serving as the cornerstone for various applications ranging from virtual environments to decision-making systems. Recently, the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Zheng Zhu , Xiaofeng Wang , Wangbo Zhao , Chen Min , Bohan Li , Nianchen Deng , Min Dou , Yuqi Wang , Botian Shi , Kai Wang , Chi Zhang , Yang You , Zhaoxiang Zhang , Dawei Zhao , Liang Xiao , Jian Zhao , Jiwen Lu , Guan Huang

World models envision potential future states based on various ego actions. They embed extensive knowledge about the driving environment, facilitating safe and scalable autonomous driving. Most existing methods primarily focus on either…

Computer Vision and Pattern Recognition · Computer Science 2025-01-20 Yu Yang , Jianbiao Mei , Yukai Ma , Siliang Du , Wenqing Chen , Yijie Qian , Yuxiang Feng , Yong Liu

Autonomous systems require identifying the environment and it has a long way to go before putting it safely into practice. In autonomous driving systems, the detection of obstacles and traffic lights are of importance as well as lane…

Robotics · Computer Science 2021-06-30 Namig Aliyev , Oguzhan Sezer , Mehmet Turan Guzel

Self-driving technology is expected to revolutionize different sectors and is seen as the natural evolution of road vehicles. In the last years, real-world validation of designed and virtually tested solutions is growing in importance since…

Robotics · Computer Science 2022-02-15 Stefano Arrigoni , Simone Mentasti , Federico Cheli , Matteo Matteucci , Francesco Braghin

As the potential for autonomous vehicles to be integrated on a large scale into modern traffic systems continues to grow, ensuring safe navigation in dynamic environments is crucial for smooth integration. To guarantee safety and prevent…

Autonomous vehicles have a great potential in the application of both civil and military fields, and have become the focus of research with the rapid development of science and economy. This article proposes a brief review on learning-based…

Robotics · Computer Science 2021-07-05 Qi Liu , Xueyuan Li , Shihua Yuan , Zirui Li

Driver models play a vital role in developing and verifying autonomous vehicles (AVs). Previously, they are mainly applied in traffic flow simulation to model driver behavior. With the development of AVs, driver models attract much…

Robotics · Computer Science 2023-11-16 Cheng Wang , Fengwei Guo , Ruilin Yu , Luyao Wang , Yuxin Zhang

Short-term future of automated driving can be imagined as a hybrid scenario in which both automated and human-driven vehicles co-exist in the same environment. In order to address the needs of such road configuration, many technology…

Signal Processing · Electrical Eng. & Systems 2020-08-24 Behrad Toghi , Divas Grover , Mahdi Razzaghpour , Rajat Jain , Rodolfo Valiente , Mahdi Zaman , Ghayoor Shah , Yaser P. Fallah

Uncertainty plays a key role in future prediction. The future is uncertain. That means there might be many possible futures. A future prediction method should cover the whole possibilities to be robust. In autonomous driving, covering…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Adil Kaan Akan

Embodied AI requires agents that perceive, act, and anticipate how actions reshape future world states. World models serve as internal simulators that capture environment dynamics, enabling forward and counterfactual rollouts to support…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Xinqing Li , Xin He , Le Zhang , Min Wu , Xiaoli Li , Yun Liu

The potential benefits of autonomous systems have been driving intensive development of such systems, and of supporting tools and methodologies. However, there are still major issues to be dealt with before such development becomes…

Software Engineering · Computer Science 2022-05-25 David Harel , Assaf Marron , Joseph Sifakis

The autonomous driving community has witnessed a rapid growth in approaches that embrace an end-to-end algorithm framework, utilizing raw sensor input to generate vehicle motion plans, instead of concentrating on individual tasks such as…

Robotics · Computer Science 2024-08-16 Li Chen , Penghao Wu , Kashyap Chitta , Bernhard Jaeger , Andreas Geiger , Hongyang Li