English
Related papers

Related papers: RenderWorld: World Model with Self-Supervised 3D L…

200 papers

The field of autonomous driving is experiencing a surge of interest in world models, which aim to predict potential future scenarios based on historical observations. In this paper, we introduce DFIT-OccWorld, an efficient 3D occupancy…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Haiming Zhang , Ying Xue , Xu Yan , Jiacheng Zhang , Weichao Qiu , Dongfeng Bai , Bingbing Liu , Shuguang Cui , Zhen Li

Recent advances in driving-scene generation and reconstruction have demonstrated significant potential for enhancing autonomous driving systems by producing scalable and controllable training data. Existing generation methods primarily…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Ziyue Zhu , Zhanqian Wu , Zhenxin Zhu , Lijun Zhou , Haiyang Sun , Bing Wan , Kun Ma , Guang Chen , Hangjun Ye , Jin Xie , jian Yang

Autonomous navigation of terrestrial robots using Reinforcement Learning (RL) from LIDAR observations remains challenging due to the high dimensionality of sensor data and the sample inefficiency of model-free approaches. Conventional…

Reliable anticipation of traffic accidents is essential for advancing autonomous driving systems. However, this objective is limited by two fundamental challenges: the scarcity of diverse, high-quality training data and the frequent absence…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Yanchen Guan , Haicheng Liao , Chengyue Wang , Xingcheng Liu , Jiaxun Zhang , Zhenning Li

End-to-End (E2E) planning has become a powerful paradigm for autonomous driving, yet current systems remain fundamentally uncertainty-blind. They assume perception outputs are fully reliable, even in ambiguous or poorly observed scenes,…

Robotics · Computer Science 2025-12-01 Wonjeong Ryu , Seungjun Yu , Seokha Moon , Hojun Choi , Junsung Park , Jinkyu Kim , Hyunjung Shim

Semantic occupancy has emerged as a powerful representation in world models for its ability to capture rich spatial semantics. However, most existing occupancy world models rely on static and fixed embeddings or grids, which inherently…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Chenxu Dang , Haiyan Liu , Jason Bao , Pei An , Xinyue Tang , PanAn , Jie Ma , Bingchuan Sun , Yan Wang

End-to-end autonomous driving (E2E-AD) has emerged as a promising paradigm that unifies perception, prediction, and planning into a holistic, data-driven framework. However, achieving robustness to varying camera viewpoints, a common…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Hoonhee Cho , Jae-Young Kang , Giwon Lee , Hyemin Yang , Heejun Park , Seokwoo Jung , Kuk-Jin Yoon

This paper focuses on scene reconstruction under nighttime conditions in autonomous driving simulation. Recent methods based on Neural Radiance Fields (NeRFs) and 3D Gaussian Splatting (3DGS) have achieved photorealistic modeling in…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Tae-Kyeong Kim , Xingxin Chen , Guile Wu , Chengjie Huang , Dongfeng Bai , Bingbing Liu

End-to-end autonomous driving provides a feasible way to automatically maximize overall driving system performance by directly mapping the raw pixels from a front-facing camera to control signals. Recent advanced methods construct a latent…

Machine Learning · Computer Science 2024-05-21 Zeyu Gao , Yao Mu , Chen Chen , Jingliang Duan , Shengbo Eben Li , Ping Luo , Yanfeng Lu

With the rapid advancement of autonomous driving technology, a lack of data has become a major obstacle to enhancing perception model accuracy. Researchers are now exploring controllable data generation using world models to diversify…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Xinqing Li , Ruiqi Song , Qingyu Xie , Ye Wu , Nanxin Zeng , Yunfeng Ai

Realistic scene reconstruction and view synthesis are essential for advancing autonomous driving systems by simulating safety-critical scenarios. 3D Gaussian Splatting excels in real-time rendering and static scene reconstructions but…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Mustafa Khan , Hamidreza Fazlali , Dhruv Sharma , Tongtong Cao , Dongfeng Bai , Yuan Ren , Bingbing Liu

World models have become central to autonomous driving, where accurate scene understanding and future prediction are crucial for safe control. Recent work has explored using vision-language models (VLMs) for planning, yet existing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Zhexiao Xiong , Xin Ye , Burhan Yaman , Sheng Cheng , Yiren Lu , Jingru Luo , Nathan Jacobs , Liu Ren

Semantic occupancy has recently gained significant traction as a prominent 3D scene representation. However, most existing methods rely on large and costly datasets with fine-grained 3D voxel labels for training, which limits their…

Computer Vision and Pattern Recognition · Computer Science 2024-02-21 Simon Boeder , Fabian Gigengack , Benjamin Risse

End-to-end autonomous driving models based on Vision-Language-Action (VLA) architectures have shown promising results by learning driving policies through behavior cloning on expert demonstrations. However, imitation learning inherently…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Zihao Sheng , Xin Ye , Jingru Luo , Sikai Chen , Liu Ren

Building an efficient and physically consistent world model from limited observations is a long standing challenge in vision and robotics. Many existing world modeling pipelines are based on implicit generative models, which are hard to…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Wenhao Hu , Xuexiang Wen , Xi Li , Gaoang Wang

Directly producing planning results from raw sensors has been a long-desired solution for autonomous driving and has attracted increasing attention recently. Most existing end-to-end autonomous driving methods factorize this problem into…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Wenzhao Zheng , Ruiqi Song , Xianda Guo , Chenming Zhang , Long Chen

Closed-loop evaluation of autonomous-driving policies requires interactive simulation beyond log replay. However, existing generative world models often degrade in closed loop due to (i) history-free initialization that mismatches policy…

Robotics · Computer Science 2026-03-19 Chaokang Jiang , Desen Zhou , Jiuming Liu , Kevin Li Sun

End-to-end autonomous driving methods aim to directly map raw sensor inputs to future driving actions such as planned trajectories, bypassing traditional modular pipelines. While these approaches have shown promise, they often operate under…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Bozhou Zhang , Nan Song , Jingyu Li , Xiatian Zhu , Jiankang Deng , Li Zhang

3D world generation is essential for applications such as immersive content creation or autonomous driving simulation. Recent advances in 3D world generation have shown promising results; however, these methods are constrained by grid…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Jaeyoung Chung , Suyoung Lee , Jianfeng Xiang , Jiaolong Yang , Kyoung Mu Lee

In this paper, we draw inspiration from Alberto Elfes' pioneering work in 1989, where he introduced the concept of the occupancy grid as World Models for robots. We imbue the robot with a spatial-temporal world model, termed UniWorld, to…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Chen Min , Dawei Zhao , Liang Xiao , Yiming Nie , Bin Dai