English
Related papers

Related papers: DriveFuture: Future-Aware Latent World Models for …

200 papers

Data scaling plays a pivotal role in the pursuit of general intelligence. However, the prevailing perception-planning paradigm in autonomous driving relies heavily on expensive manual annotations to supervise trajectory planning, which…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Jiawei Xu , Zhizhou Zhong , Zhijian Shu , Mingkai Jia , Mingxiao Li , Jia-Wang Bian , Qian Zhang , Kaicheng Zhang , Jin Xie , Jian Yang , Wei Yin

World models, especially in autonomous driving, are trending and drawing extensive attention due to their capacity for comprehending driving environments. The established world model holds immense potential for the generation of…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Xiaofeng Wang , Zheng Zhu , Guan Huang , Xinze Chen , Jiagang Zhu , Jiwen Lu

Autonomous driving has received a lot of attention in the automotive industry and is often seen as the future of transportation. Passenger vehicles equipped with a wide array of sensors (e.g., cameras, front-facing radars, LiDARs, and IMUs)…

Machine Learning · Computer Science 2022-05-27 Andrey Pak , Hemanth Manjunatha , Dimitar Filev , Panagiotis Tsiotras

Data-efficient learning remains a central challenge in autonomous driving due to the high cost and safety risks of large-scale real-world interaction. Although world-model-based reinforcement learning enables policy optimization through…

Robotics · Computer Science 2026-03-10 Jiazhuo Li , Linjiang Cao , Qi Liu , Xi Xiong

End-to-end autonomous driving has achieved remarkable progress by integrating perception, prediction, and planning into a fully differentiable framework. Yet, to fully realize its potential, an effective online trajectory evaluation is…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Yingyan Li , Yuqi Wang , Yang Liu , Jiawei He , Lue Fan , Zhaoxiang Zhang

World models envision potential future states based on various ego actions. They embed extensive knowledge about the driving environment, facilitating safe and scalable autonomous driving. Most existing methods primarily focus on either…

Computer Vision and Pattern Recognition · Computer Science 2025-01-20 Yu Yang , Jianbiao Mei , Yukai Ma , Siliang Du , Wenqing Chen , Yijie Qian , Yuxiang Feng , Yong Liu

Autonomous vehicles must navigate safely in complex driving environments. Imitating a single expert trajectory, as in regression-based approaches, usually does not explicitly assess the safety of the predicted trajectory. Selection-based…

Robotics · Computer Science 2025-11-25 Wenhao Yao , Zhenxin Li , Shiyi Lan , Zi Wang , Xinglong Sun , Jose M. Alvarez , Zuxuan Wu

Vision-based autonomous driving has gained much attention due to its low costs and excellent performance. Compared with dense BEV (Bird's Eye View) or sparse query models, Gaussian-centric method is a comprehensive yet sparse representation…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Yiyao Zhu , Ying Xue , Haiming Zhang , Guangfeng Jiang , Wending Zhou , Xu Yan , Jiantao Gao , Yingjie Cai , Bingbing Liu , Zhen Li , Shaojie Shen

Addressing the challenge of ensuring safety in ever-changing and unpredictable environments, particularly in the swiftly advancing realm of autonomous driving in today's 5G wireless communication world, we present Navigation Secure…

Robotics · Computer Science 2024-11-26 Hong Ding , Ziming Wang , Yi Ding , Hongjie Lin , SuYang Xi , Chia Chao Kang

End-to-End (E2E) autonomous driving models have shown growing capability in recent years, with performance improving on increasingly challenging benchmarks. However, modern generative E2E planners still suffer from a substantial number of…

Robotics · Computer Science 2026-05-19 Shounak Sural , Raj Rajkumar

Social navigation requires robots to act safely in dynamic human environments. Effective behavior demands thinking ahead: reasoning about how the scene and pedestrians evolve under different robot actions rather than reacting to current…

Robotics · Computer Science 2026-03-19 Tianshuai Hu , Zeying Gong , Lingdong Kong , XiaoDong Mei , Yiyi Ding , Qi Zeng , Ao Liang , Rong Li , Yangyi Zhong , Junwei Liang

Uncertainty plays a key role in future prediction. The future is uncertain. That means there might be many possible futures. A future prediction method should cover the whole possibilities to be robust. In autonomous driving, covering…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Adil Kaan Akan

Autonomous driving technology can improve traffic safety and reduce traffic accidents. In addition, it improves traffic flow, reduces congestion, saves energy and increases travel efficiency. In the relatively mature automatic driving…

Robotics · Computer Science 2024-03-13 Wenjian Sun , Linying Pan , Jingyu Xu , Weixiang Wan , Yong Wang

Data-driven simulation has become a favorable way to train and test autonomous driving algorithms. The idea of replacing the actual environment with a learned simulator has also been explored in model-based reinforcement learning in the…

Robotics · Computer Science 2023-09-29 Zhejun Zhang , Alexander Liniger , Dengxin Dai , Fisher Yu , Luc Van Gool

Generalization is a central challenge in autonomous driving, as real-world deployment requires robust performance under unseen scenarios, sensor domains, and environmental conditions. Recent world-model-based planning methods have shown…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Mengmeng Liu , Diankun Zhang , Jiuming Liu , Jianfeng Cui , Hongwei Xie , Guang Chen , Hangjun Ye , Michael Ying Yang , Francesco Nex , Hao Cheng

Recently, world models have made significant progress in enhancing end-to-end driving systems through both future situation forecasting and improved scene understanding. However, existing driving world models are typically built upon dense…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Ruoyu Wang , Jingke Wang , Yukai Ma , Yuehao Huang , Shuangming Lei , Guanglin Xu , Aixue Ye , Yong Liu

How can we reliably simulate future driving scenarios under a wide range of ego driving behaviors? Recent driving world models, developed exclusively on real-world driving data composed mainly of safe expert trajectories, struggle to follow…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Jiazhi Yang , Kashyap Chitta , Shenyuan Gao , Long Chen , Yuqian Shao , Xiaosong Jia , Hongyang Li , Andreas Geiger , Xiangyu Yue , Li Chen

End-to-end autonomous driving aims to generate safe and plausible planning policies from raw sensor input. Driving world models have shown great potential in learning rich representations by predicting the future evolution of a driving…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Xingtai Gui , Meijie Zhang , Tianyi Yan , Wencheng Han , Jiahao Gong , Feiyang Tan , Cheng-zhong Xu , Jianbing Shen

Existing vision-and-language navigation (VLN) models primarily reason over past and current visual observations, while largely ignoring the future visual dynamics induced by actions. As a result, they often lack an effective understanding…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Haihong Hao , Lei Chen , Mingfei Han , Changlin Li , Dong An , Yuqiang Yang , Zhihui Li , Xiaojun Chang

The autoregressive world model exhibits robust generalization capabilities in vectorized scene understanding but encounters difficulties in deriving actions due to insufficient uncertainty modeling and self-delusion. In this paper, we…

Robotics · Computer Science 2024-09-25 Lingyu Xiao , Jiang-Jiang Liu , Sen Yang , Xiaofan Li , Xiaoqing Ye , Wankou Yang , Jingdong Wang