English
Related papers

Related papers: World Models for Autonomous Driving: An Initial Su…

200 papers

Autonomous vehicles (AVs) have the potential to significantly revolutionize society by providing a secure and efficient mode of transportation. Recent years have witnessed notable advancements in autonomous driving perception and…

Machine Learning · Computer Science 2023-11-27 Di Chen , Meixin Zhu , Hao Yang , Xuesong Wang , Yinhai Wang

World models aim to learn action-controlled future prediction and have proven essential for the development of intelligent agents. However, most existing world models rely heavily on substantial action-labeled data and costly training,…

Artificial Intelligence · Computer Science 2025-06-03 Shenyuan Gao , Siyuan Zhou , Yilun Du , Jun Zhang , Chuang Gan

Much research in artificial intelligence is concerned with the development of autonomous agents that can interact effectively with other agents. An important aspect of such agents is the ability to reason about the behaviours of other…

Artificial Intelligence · Computer Science 2018-02-12 Stefano V. Albrecht , Peter Stone

No human drives a car in a vacuum; she/he must negotiate with other road users to achieve their goals in social traffic scenes. A rational human driver can interact with other road users in a socially-compatible way through implicit…

Robotics · Computer Science 2022-11-29 Wenshuo Wang , Letian Wang , Chengyuan Zhang , Changliu Liu , Lijun Sun

Various methods have been proposed for utilizing Large Language Models (LLMs) in autonomous driving. One strategy of using LLMs for autonomous driving involves inputting surrounding objects as text prompts to the LLMs, along with their…

Recent advances in foundation models (FMs), including large language models (LLMs), vision-language models (VLMs), and world models, have opened new opportunities for autonomous driving systems (ADSs) in perception, reasoning,…

Software Engineering · Computer Science 2026-04-03 Xiongfei Wu , Mingfei Cheng , Xiaoning Ren , Qiang Hu , Jianlang Chen , Yuheng Huang , Maxime Cordy , Yao Zhang , Xiaofei Xie , Lei Ma , Yves Le Traon

To maximize safety and driving comfort, autonomous driving systems can benefit from implementing foresighted action choices that take different potential scenario developments into account. While artificial scene prediction methods are…

Robotics · Computer Science 2022-04-15 Chao Wang , Thomas H. Weisswange , Matti Krueger , Christiane B. Wiebel-Herboth

The risen complexity of automotive systems requires new development strategies and methods to master the upcoming challenges. Traditional methods need thus to be changed by an increased level of automation, and a faster continuous…

Software Engineering · Computer Science 2024-04-04 Romina Eramo , Hamzeh Eyal Salman , Matteo Spezialetti , Darko Stern , Pierre Quinton , Antonio Cicchetti

World models, which explicitly learn environmental dynamics to lay the foundation for planning, reasoning, and decision-making, are rapidly advancing in predicting both physical dynamics and aspects of social behavior, yet predominantly in…

Computers and Society · Computer Science 2025-10-27 Xiaoyuan Zhang , Chengdong Ma , Yizhe Huang , Weidong Huang , Siyuan Qi , Song-Chun Zhu , Xue Feng , Yaodong Yang

The aviation industry has a market driven need to maintain and develop enhanced simulation capabilities for a wide range of application domains. In particular, the future growth and disruptive ability of smart cities, autonomous vehicles…

Computers and Society · Computer Science 2019-10-15 Joshua Fadaie

Understanding world dynamics is crucial for planning in autonomous driving. Recent methods attempt to achieve this by learning a 3D occupancy world model that forecasts future surrounding scenes based on current observation. However, 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Xiang Li , Pengfei Li , Yupeng Zheng , Wei Sun , Yan Wang , Yilun Chen

Autonomous vehicle (AV) technology is transforming the landscape of transportation bypromising safer, more efficient, and sustainable mobilitysolutions. In recent years, significant advancements in AI, machine learning, sensor fusion, and…

Computational Engineering, Finance, and Science · Computer Science 2024-12-31 Venkata Sai Chandra Prasanth Narisetty , Tejaswi Maddineni

Addressing the challenge of ensuring safety in ever-changing and unpredictable environments, particularly in the swiftly advancing realm of autonomous driving in today's 5G wireless communication world, we present Navigation Secure…

Robotics · Computer Science 2024-11-26 Hong Ding , Ziming Wang , Yi Ding , Hongjie Lin , SuYang Xi , Chia Chao Kang

Modeling environmental ecosystems is essential for effective resource management, sustainable development, and understanding complex ecological processes. However, traditional data-driven methods face challenges in capturing inherently…

Machine Learning · Computer Science 2025-04-08 Runlong Yu , Shengyu Chen , Yiqun Xie , Huaxiu Yao , Jared Willard , Xiaowei Jia

World models aim to improve robotic decision making by predicting the consequences of actions. However, in practice, their predictions often become unreliable once the robot encounters states outside the training distribution, limiting…

Robotics · Computer Science 2026-05-18 Tuo An , Jindou Jia , Gen Li , Jingliang Li , Chuhao Zhou , Pengfei Liu , Bofan Lyu , Jiaqi Bai , Xinying Guo , Geng Li , Jianfei Yang

The future of transportation is being shaped by technology, and one revolutionary step in improving road safety is the incorporation of robotic systems into driver monitoring infrastructure. This literature review explores the current…

Robotics · Computer Science 2024-01-30 Farhin Farhad Riya , Shahinul Hoque , Xiaopeng Zhao , Jinyuan Stella Sun

Highly automated driving requires precise models of traffic participants. Many state of the art models are currently based on machine learning techniques. Among others, the required amount of labeled data is one major challenge. An…

Artificial Intelligence · Computer Science 2018-03-12 Maarten Bieshaar , Günther Reitberger , Viktor Kreß , Stefan Zernetsch , Konrad Doll , Erich Fuchs , Bernhard Sick

The autonomous car technology promises to replace human drivers with safer driving systems. But although autonomous cars can become safer than human drivers this is a long process that is going to be refined over time. Before these vehicles…

Artificial Intelligence · Computer Science 2018-05-09 Thomio Watanabe , Denis Wolf

Achieving fully autonomous driving with enhanced safety and efficiency relies on vehicle-to-everything cooperative perception, which enables vehicles to share perception data, thereby enhancing situational awareness and overcoming the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Tao Huang , Jianan Liu , Xi Zhou , Dinh C. Nguyen , Mostafa Rahimi Azghadi , Yuxuan Xia , Qing-Long Han , Sumei Sun

As autonomous driving technology matures, safety and robustness of its key components, including trajectory prediction, is vital. Though real-world datasets, such as Waymo Open Motion, provide realistic recorded scenarios for model…

Robotics · Computer Science 2024-02-06 Benjamin Stoler , Ingrid Navarro , Meghdeep Jana , Soonmin Hwang , Jonathan Francis , Jean Oh