English
Related papers

Related papers: DriveFuture: Future-Aware Latent World Models for …

200 papers

The goal of autonomous vehicles is to navigate public roads safely and comfortably. To enforce safety, traditional planning approaches rely on handcrafted rules to generate trajectories. Machine learning-based systems, on the other hand,…

Trajectory prediction for autonomous driving must continuously reason the motion stochasticity of road agents and comply with scene constraints. Existing methods typically rely on one-stage trajectory prediction models, which condition…

Computer Vision and Pattern Recognition · Computer Science 2023-02-28 Mengmeng Liu , Hao Cheng , Lin Chen , Hellward Broszio , Jiangtao Li , Runjiang Zhao , Monika Sester , Michael Ying Yang

This paper presents DriVerse, a generative model for simulating navigation-driven driving scenes from a single image and a future trajectory. Previous autonomous driving world models either directly feed the trajectory or discrete control…

Robotics · Computer Science 2026-04-28 Xiaofan Li , Chenming Wu , Zhao Yang , Zhihao Xu , Dingkang Liang , Yumeng Zhang , Ji Wan , Jun Wang

Recently, world-action models (WAM) have emerged to bridge vision-language-action (VLA) models and world models, unifying their reasoning and instruction-following capabilities and spatio-temporal world modeling. However, existing WAM…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Yang Zhou , Xiaofeng Wang , Hao Shao , Letian Wang , Guosheng Zhao , Jiangnan Shao , Jiagang Zhu , Tingdong Yu , Zheng Zhu , Guan Huang , Steven L. Waslander

End-to-end autonomous driving planners typically generate trajectories from current observations alone. However, real-world driving is highly dynamic, and such reactive planning cannot anticipate future scene evolution, often leading to…

Robotics · Computer Science 2026-04-29 Chuyao Fu , Shengzhe Gan , Zhuoli Ouyang , Yuhan Rui , Xiaowei Chi , Sirui Han , Jiankun Wang , Hong Zhang

Analyzing the impact of the environment on drivers' stress level and workload is of high importance for designing human-centered driver-vehicle interaction systems and to ultimately help build a safer driving experience. However, driver's…

Human-Computer Interaction · Computer Science 2022-03-03 Arash Tavakoli , Steven Boker , Arsalan Heydarian

Current autonomous driving systems are composed of a perception system and a decision system. Both of them are divided into multiple subsystems built up with lots of human heuristics. An end-to-end approach might clean up the system and…

Computer Vision and Pattern Recognition · Computer Science 2020-10-12 Jianyu Chen , Zhuo Xu , Masayoshi Tomizuka

The ability to accurately predict the trajectory of surrounding vehicles is a critical hurdle to overcome on the journey to fully autonomous vehicles. To address this challenge, we pioneer a novel behavior-aware trajectory prediction model…

Advanced end-to-end autonomous driving systems predict other vehicles' motions and plan ego vehicle's trajectory. The world model that can foresee the outcome of the trajectory has been used to evaluate the autonomous driving system.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Jian Zhu , Zhengyu Jia , Tian Gao , Jiaxin Deng , Shidi Li , Lang Zhang , Fu Liu , Peng Jia , Xianpeng Lang

The ability to predict the future movements of other vehicles is a subconscious and effortless skill for humans and key to safe autonomous driving. Therefore, trajectory prediction for autonomous cars has gained a lot of attention in recent…

Robotics · Computer Science 2021-09-16 Benedikt Mersch , Thomas Höllen , Kun Zhao , Cyrill Stachniss , Ribana Roscher

Benchmarking autonomous driving planners to align with human judgment remains a critical challenge, as state-of-the-art metrics like the Extended Predictive Driver Model Score (EPDMS) lack context awareness in nuanced scenarios. To address…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Jingyu Song , Zhenxin Li , Shiyi Lan , Xinglong Sun , Nadine Chang , Maying Shen , Joshua Chen , Katherine A. Skinner , Jose M. Alvarez

World models have attracted increasing attention in autonomous driving for their ability to forecast potential future scenarios. In this paper, we propose BEVWorld, a novel framework that transforms multimodal sensor inputs into a unified…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Yumeng Zhang , Shi Gong , Kaixin Xiong , Xiaoqing Ye , Xiaofan Li , Xiao Tan , Fan Wang , Jizhou Huang , Hua Wu , Haifeng Wang

To safely navigate intricate real-world scenarios, autonomous vehicles must be able to adapt to diverse road conditions and anticipate future events. World model (WM) based reinforcement learning (RL) has emerged as a promising approach by…

Robotics · Computer Science 2024-07-29 Dechen Gao , Shuangyu Cai , Hanchu Zhou , Hang Wang , Iman Soltani , Junshan Zhang

Learned dynamics models combined with both planning and policy learning algorithms have shown promise in enabling artificial agents to learn to perform many diverse tasks with limited supervision. However, one of the fundamental challenges…

Machine Learning · Computer Science 2020-08-12 Suraj Nair , Silvio Savarese , Chelsea Finn

In mixed autonomous driving environments, accurately predicting the future trajectories of surrounding vehicles is crucial for the safe operation of autonomous vehicles (AVs). In driving scenarios, a vehicle's trajectory is determined by…

Robotics · Computer Science 2025-02-28 Haicheng Liao , Chengyue Wang , Kaiqun Zhu , Yilong Ren , Bolin Gao , Shengbo Eben Li , Chengzhong Xu , Zhenning Li

World models have gained significant attention as a promising approach for autonomous driving. By emulating human-like perception and decision-making processes, these models can predict and adapt to dynamic environments. Existing methods…

Robotics · Computer Science 2025-12-03 Huiqian Li , Wei Pan , Haodong Zhang , Jin Huang , Zhihua Zhong

Autonomous driving has rapidly developed and shown promising performance due to recent advances in hardware and deep learning techniques. High-quality datasets are fundamental for developing reliable autonomous driving algorithms. Previous…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Mingyu Liu , Ekim Yurtsever , Jonathan Fossaert , Xingcheng Zhou , Walter Zimmer , Yuning Cui , Bare Luka Zagar , Alois C. Knoll

With increasing automation in passenger vehicles, the study of safe and smooth occupant-vehicle interaction and control transitions is key. In this study, we focus on the development of contextual, semantically meaningful representations of…

Robotics · Computer Science 2021-07-26 Akshay Rangesh , Nachiket Deo , Ross Greer , Pujitha Gunaratne , Mohan M. Trivedi

World models have become central to autonomous driving, where accurate scene understanding and future prediction are crucial for safe control. Recent work has explored using vision-language models (VLMs) for planning, yet existing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Zhexiao Xiong , Xin Ye , Burhan Yaman , Sheng Cheng , Yiren Lu , Jingru Luo , Nathan Jacobs , Liu Ren

We introduce DriveAgent, a novel multi-agent autonomous driving framework that leverages large language model (LLM) reasoning combined with multimodal sensor fusion to enhance situational understanding and decision-making. DriveAgent…

Robotics · Computer Science 2025-05-06 Xinmeng Hou , Wuqi Wang , Long Yang , Hao Lin , Jinglun Feng , Haigen Min , Xiangmo Zhao