English
Related papers

Related papers: DriveFuture: Future-Aware Latent World Models for …

200 papers

To plan safe maneuvers and act with foresight, autonomous vehicles must be capable of accurately predicting the uncertain future. In the context of autonomous driving, deep neural networks have been successfully applied to learning…

Robotics · Computer Science 2022-08-02 Salar Arbabi , Davide Tavernini , Saber Fallah , Richard Bowden

The ability to predict the future trajectories of traffic participants is crucial for the safe and efficient operation of autonomous vehicles. In this paper, a diffusion-based generative model for multi-agent trajectory prediction is…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Theodor Westny , Björn Olofsson , Erik Frisk

For autonomous vehicles, safe navigation in complex environments depends on handling a broad range of diverse and rare driving scenarios. Simulation- and scenario-based testing have emerged as key approaches to development and validation of…

In this paper, we present LookOut, a novel autonomy system that perceives the environment, predicts a diverse set of futures of how the scene might unroll and estimates the trajectory of the SDV by optimizing a set of contingency plans over…

Robotics · Computer Science 2022-11-07 Alexander Cui , Sergio Casas , Abbas Sadat , Renjie Liao , Raquel Urtasun

Efficient trajectory planning for urban intersections is currently one of the most challenging tasks for an Autonomous Vehicle (AV). Courteous behavior towards other traffic participants, the AV's comfort and its progression in the…

Robotics · Computer Science 2020-10-08 Oliver Speidel , Maximilian Graf , Ankit Kaushik , Thanh Phan-Huu , Andreas Wedel , Klaus Dietmayer

We propose DOME, a diffusion-based world model that predicts future occupancy frames based on past occupancy observations. The ability of this world model to capture the evolution of the environment is crucial for planning in autonomous…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Songen Gu , Wei Yin , Bu Jin , Xiaoyang Guo , Junming Wang , Haodong Li , Qian Zhang , Xiaoxiao Long

Video generation models, as one form of world models, have emerged as one of the most exciting frontiers in AI, promising agents the ability to imagine the future by modeling the temporal evolution of complex scenes. In autonomous driving,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Yang Zhou , Hao Shao , Letian Wang , Zhuofan Zong , Hongsheng Li , Steven L. Waslander

We present a reward-predictive, model-based deep learning method featuring trajectory-constrained visual attention for local planning in visual navigation tasks. Our method learns to place visual attention at locations in latent image space…

Robotics · Computer Science 2022-05-27 Stefan Wapnick , Travis Manderson , David Meger , Gregory Dudek

Accurately forecasting the future movements of surrounding vehicles is essential for safe and efficient operations of autonomous driving cars. This task is difficult because a vehicle's moving trajectory is greatly determined by its…

Machine Learning · Computer Science 2021-01-15 Jiacheng Pan , Hongyi Sun , Kecheng Xu , Yifei Jiang , Xiangquan Xiao , Jiangtao Hu , Jinghao Miao

Recognizing the surrounding environment at low latency is critical in autonomous driving. In real-time environment, surrounding environment changes when processing is over. Current detection models are incapable of dealing with changes in…

Computer Vision and Pattern Recognition · Computer Science 2022-12-26 Wonwoo Jo , Kyungshin Lee , Jaewon Baik , Sangsun Lee , Dongho Choi , Hyunkyoo Park

End-to-End driving is a promising paradigm as it circumvents the drawbacks associated with modular systems, such as their overwhelming complexity and propensity for error propagation. Autonomous driving transcends conventional traffic…

Robotics · Computer Science 2023-09-20 Pranav Singh Chib , Pravendra Singh

Recent studies have explored leveraging the world knowledge and cognitive capabilities of Vision-Language Models (VLMs) to address the long-tail problem in end-to-end autonomous driving. However, existing methods typically formulate…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Yongkang Li , Kaixin Xiong , Xiangyu Guo , Fang Li , Sixu Yan , Gangwei Xu , Lijun Zhou , Long Chen , Haiyang Sun , Bing Wang , Kun Ma , Guang Chen , Hangjun Ye , Wenyu Liu , Xinggang Wang

Vehicle trajectory prediction is crucial for advancing autonomous driving and advanced driver assistance systems (ADAS), enhancing road safety and traffic efficiency. While traditional methods have laid foundational work, modern deep…

Machine Learning · Computer Science 2024-06-19 Junwei You , Haotian Shi , Keshu Wu , Keke Long , Sicheng Fu , Sikai Chen , Bin Ran

The provision of reliable connectivity is envisioned as a key enabler for future autonomous driving. Anticipatory communication techniques have been proposed for proactively considering the properties of the highly dynamic radio channel…

Networking and Internet Architecture · Computer Science 2019-12-03 Benjamin Sliwa , Christian Wietfeld

Technological advancements focus on developing comfortable and acceptable driving characteristics in autonomous vehicles. Present driving functions predominantly possess predefined parameters, and there is no universally accepted driving…

Systems and Control · Electrical Eng. & Systems 2024-10-28 Johann Haselberger , Maximilian Böhle , Bernhard Schick , Steffen Müller

Autonomous vehicles (AVs) are poised to revolutionize global transportation systems. However, its widespread acceptance and market penetration remain significantly below expectations. This gap is primarily driven by persistent challenges in…

Robotics · Computer Science 2026-02-10 Yuxin Zhang , Cheng Wang , Hubert P. H. Shum

Advancements in intelligent technologies have significantly improved navigation in complex traffic environments by enhancing environment perception and trajectory prediction for automated vehicles. However, current research often overlooks…

Artificial Intelligence · Computer Science 2025-03-11 Pei Liu , Haipeng Liu , Xingyu Liu , Yiqun Li , Junlan Chen , Yangfan He , Jun Ma

Vision-based deep learning (DL) methods have made great progress in learning autonomous driving models from large-scale crowd-sourced video datasets. They are trained to predict instantaneous driving behaviors from video data captured by…

Human-Computer Interaction · Computer Science 2021-09-24 Suphanut Jamonnak , Ye Zhao , Xinyi Huang , Md Amiruzzaman

Autonomous driving (AD) systems are becoming increasingly capable of handling complex tasks, mainly due to recent advances in deep learning and AI. As interactions between autonomous systems and humans increase, the interpretability of…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Mukilan Karuppasamy , Shankar Gangisetty , Shyam Nandan Rai , Carlo Masone , C V Jawahar

Future trajectories of neighboring traffic agents have a significant influence on the path planning and decision-making of autonomous vehicles. While trajectory forecasting is a well-studied field, research mainly focuses on snapshot-based…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Alexander Prutsch , David Schinagl , Horst Possegger