English
Related papers

Related papers: Risk-Aware World Model Predictive Control for Gene…

200 papers

This paper explores the role and challenges of Artificial Intelligence (AI) algorithms, specifically AI-based software elements, in autonomous driving systems. These AI systems are fundamental in executing real-time critical functions in…

Artificial Intelligence · Computer Science 2024-03-01 Mandar Pitale , Alireza Abbaspour , Devesh Upadhyay

Controller design faces a trade-off between robustness and performance, and the reliability of linear controllers has caused many practitioners to focus on the former. However, there is renewed interest in improving system performance to…

Optimization and Control · Mathematics 2012-08-07 Anil Aswani , Humberto Gonzalez , S. Shankar Sastry , Claire Tomlin

The need for a systematic approach to risk assessment has increased in recent years due to the ubiquity of autonomous systems that alter our day-to-day experiences and their need for safety, e.g., for self-driving vehicles, mobile service…

Autonomous driving has advanced significantly due to sensors, machine learning, and artificial intelligence improvements. However, prevailing methods struggle with intricate scenarios and causal relationships, hindering adaptability and…

Applying reinforcement learning to autonomous driving has garnered widespread attention. However, classical reinforcement learning methods optimize policies by maximizing expected rewards but lack sufficient safety considerations, often…

Robotics · Computer Science 2025-03-28 Bo Leng , Ran Yu , Wei Han , Lu Xiong , Zhuoren Li , Hailong Huang

World models can foresee the outcomes of different actions, which is of paramount importance for autonomous driving. Nevertheless, existing driving world models still have limitations in generalization to unseen environments, prediction…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Shenyuan Gao , Jiazhi Yang , Li Chen , Kashyap Chitta , Yihang Qiu , Andreas Geiger , Jun Zhang , Hongyang Li

With the rapid advancement of autonomous driving, deploying Vision-Language Models (VLMs) to enhance perception and decision-making has become increasingly common. However, the real-time application of VLMs is hindered by high latency and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Lianming Huang , Haibo Hu , Yufei Cui , Jiacheng Zuo , Shangyu Wu , Nan Guan , Chun Jason Xue

Personalization, while extensively studied in conventional autonomous driving pipelines, has been largely overlooked in the context of end-to-end autonomous driving (E2EAD), despite its critical role in fostering user trust, safety…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Ruiyang Hao , Bowen Jing , Haibao Yu , Zaiqing Nie

Ensuring the safety of autonomous vehicles (AVs) in long-tail scenarios remains a critical challenge, particularly under high uncertainty and complex multi-agent interactions. To address this, we propose RiskNet, an interaction-aware risk…

Robotics · Computer Science 2025-04-23 Qichao Liu , Heye Huang , Shiyue Zhao , Lei Shi , Soyoung Ahn , Xiaopeng Li

We present a new interaction mechanism of prediction and planning for end-to-end autonomous driving, called PPAD (Iterative Interaction of Prediction and Planning Autonomous Driving), which considers the timestep-wise interaction to better…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Zhili Chen , Maosheng Ye , Shuangjie Xu , Tongyi Cao , Qifeng Chen

The end-to-end (E2E) paradigm, which maps sensor inputs directly to driving decisions, has recently attracted significant attention due to its unified modeling capability and scalability. However, ensuring safety in this unified framework…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Jungho Kim , Jiyong Oh , Seunghoon Yu , Hongjae Shin , Donghyuk Kwak , Jun Won Choi

End-to-end autonomous driving models based on Vision-Language-Action (VLA) architectures have shown promising results by learning driving policies through behavior cloning on expert demonstrations. However, imitation learning inherently…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Zihao Sheng , Xin Ye , Jingru Luo , Sikai Chen , Liu Ren

This paper presents a novel approach to Autonomous Vehicle (AV) control through the application of active inference, a theory derived from neuroscience that conceptualizes the brain as a predictive machine. Traditional autonomous driving…

Robotics · Computer Science 2025-03-17 Elahe Delavari , John Moore , Junho Hong , Jaerock Kwon

World models enable planning in imagined future predicted space, offering a promising framework for embodied navigation. However, existing navigation world models often lack action-conditioned consistency, so visually plausible predictions…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Han Yan , Zishang Xiang , Zeyu Zhang , Hao Tang

Autonomous driving (AD) systems are becoming increasingly capable of handling complex tasks, mainly due to recent advances in deep learning and AI. As interactions between autonomous systems and humans increase, the interpretability of…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Mukilan Karuppasamy , Shankar Gangisetty , Shyam Nandan Rai , Carlo Masone , C V Jawahar

Real-world driving requires people to observe the current environment, anticipate the future, and make appropriate driving decisions. This requirement is aligned well with the capabilities of world models, which understand the environment…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Xiaodong Wang , Peixi Peng

Generating safe and non-conservative behaviors in dense, dynamic environments remains challenging for automated vehicles due to the stochastic nature of traffic participants' behaviors and their implicit interaction with the ego vehicle.…

Robotics · Computer Science 2023-09-13 Tong Li , Lu Zhang , Sikang Liu , Shaojie Shen

An approach to resilient planning and control of autonomous vehicles in multi-vehicle traffic scenarios is proposed. The proposed method is based on model predictive control (MPC), where alternative predictions of the surrounding traffic…

Systems and Control · Electrical Eng. & Systems 2022-04-21 Victor Fors , Björn Olofsson , Erik Frisk

End-to-end autonomous driving solutions, which process multi-modal sensory data to directly generate refined control commands, have become a dominant paradigm in autonomous driving research. However, these approaches predominantly depend on…

Robotics · Computer Science 2025-05-12 Ruidan Xing , Runyi Huang , Qing Xu , Lei He

In recent years, advanced model-based and data-driven control methods are unlocking the potential of complex robotics systems, and we can expect this trend to continue at an exponential rate in the near future. However, ensuring safety with…

Robotics · Computer Science 2024-08-29 Gianni Lunardi , Asia La Rocca , Matteo Saveriano , Andrea Del Prete