English
Related papers

Related papers: RenderOcc: Vision-Centric 3D Occupancy Prediction …

200 papers

Occupancy prediction plays a pivotal role in autonomous driving. Previous methods typically construct dense 3D volumes, neglecting the inherent sparsity of the scene and suffering from high computational costs. To bridge the gap, we…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Haisong Liu , Yang Chen , Haiguang Wang , Zetong Yang , Tianyu Li , Jia Zeng , Li Chen , Hongyang Li , Limin Wang

Accurate 3D perception is essential for understanding the environment in autonomous driving. Recent advancements in 3D semantic occupancy prediction have leveraged camera-LiDAR fusion to improve robustness and accuracy. However, current…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Minjae Seong , Jisong Kim , Geonho Bang , Hawook Jeong , Jun Won Choi

3D occupancy becomes a promising perception representation for autonomous driving to model the surrounding environment at a fine-grained scale. However, it remains challenging to efficiently aggregate 3D occupancy over time across multiple…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Ziyang Leng , Jiawei Yang , Wenlong Yi , Bolei Zhou

3D semantic occupancy prediction is a cornerstone of robotic perception, yet real-world voxel annotations are inherently corrupted by structural artifacts and dynamic trailing effects. This raises a critical but underexplored question: can…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Wenxin Li , Kunyu Peng , Di Wen , Junwei Zheng , Jiale Wei , Mengfei Duan , Yuheng Zhang , Rui Fan , Kailun Yang

Occupancy prediction reconstructs 3D structures of surrounding environments. It provides detailed information for autonomous driving planning and navigation. However, most existing methods heavily rely on the LiDAR point clouds to generate…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Chubin Zhang , Juncheng Yan , Yi Wei , Jiaxin Li , Li Liu , Yansong Tang , Yueqi Duan , Jiwen Lu

3D semantic occupancy prediction has emerged as a critical perception task for autonomous driving due to its ability to offer voxel-level semantic and geometric understanding of the environment. However, such a refined representation for…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Hanlin Wu , Pengfei Lin , Ehsan Javanmardi , Naren Bao , Bo Qian , Hao Si , Manabu Tsukada

Human driver can easily describe the complex traffic scene by visual system. Such an ability of precise perception is essential for driver's planning. To achieve this, a geometry-aware representation that quantizes the physical 3D scene…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Chonghao Sima , Wenwen Tong , Tai Wang , Li Chen , Silei Wu , Hanming Deng , Yi Gu , Lewei Lu , Ping Luo , Dahua Lin , Hongyang Li

The resolution of voxel queries significantly influences the quality of view transformation in camera-based 3D occupancy prediction. However, computational constraints and the practical necessity for real-time deployment require smaller…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Gyeongrok Oh , Sungjune Kim , Heeju Ko , Hyung-gun Chi , Jinkyu Kim , Dongwook Lee , Daehyun Ji , Sungjoon Choi , Sujin Jang , Sangpil Kim

Occupancy is crucial for autonomous driving, providing essential geometric priors for perception and planning. However, existing methods predominantly rely on LiDAR-based occupancy annotations, which limits scalability and prevents…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Baijun Ye , Minghui Qin , Saining Zhang , Moonjun Gong , Shaoting Zhu , Zebang Shen , Luan Zhang , Lu Zhang , Hao Zhao , Hang Zhao

Vision-based 3D occupancy prediction has made significant advancements, but its reliance on cameras alone struggles in challenging environments. This limitation has driven the adoption of sensor fusion, among which camera-radar fusion…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Chaehee Song , Sanmin Kim , Hyeonjun Jeong , Juyeb Shin , Joonhee Lim , Dongsuk Kum

Accurate perception of the surrounding environment is essential for safe autonomous driving. 3D occupancy prediction, which estimates detailed 3D structures of roads, buildings, and other objects, is particularly important for…

Computer Vision and Pattern Recognition · Computer Science 2025-12-24 Chihiro Noguchi , Takaki Yamamoto

3D reconstruction has been widely used in autonomous navigation fields of mobile robotics. However, the former research can only provide the basic geometry structure without the capability of open-world scene understanding, limiting…

Computer Vision and Pattern Recognition · Computer Science 2024-08-12 Haochen Jiang , Yueming Xu , Yihan Zeng , Hang Xu , Wei Zhang , Jianfeng Feng , Li Zhang

3D occupancy prediction enables the robots to obtain spatial fine-grained geometry and semantics of the surrounding scene, and has become an essential task for embodied perception. Existing methods based on 3D Gaussians instead of dense…

Robotics · Computer Science 2025-04-22 Zhang Zhang , Qiang Zhang , Wei Cui , Shuai Shi , Yijie Guo , Gang Han , Wen Zhao , Hengle Ren , Renjing Xu , Jian Tang

3D semantic occupancy prediction is crucial for autonomous driving perception, offering comprehensive geometric scene understanding and semantic recognition. However, existing methods struggle with geometric misalignment in view…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Xubo Zhu , Haoyang Zhang , Fei He , Rui Wu , Yanhu Shan , Wen Yang , Huai Yu

Vision-based perception for autonomous driving requires an explicit modeling of a 3D space, where 2D latent representations are mapped and subsequent 3D operators are applied. However, operating on dense latent spaces introduces a cubic…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Pin Tang , Zhongdao Wang , Guoqing Wang , Jilai Zheng , Xiangxuan Ren , Bailan Feng , Chao Ma

Accurate perception of the dynamic environment is a fundamental task for autonomous driving and robot systems. This paper introduces Let Occ Flow, the first self-supervised work for joint 3D occupancy and occupancy flow prediction using…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Yili Liu , Linzhan Mou , Xuan Yu , Chenrui Han , Sitong Mao , Rong Xiong , Yue Wang

3D semantic occupancy prediction, which seeks to provide accurate and comprehensive representations of environment scenes, is important to autonomous driving systems. For autonomous cars equipped with multi-camera and LiDAR, it is critical…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Zhuangwei Zhuang , Ziyin Wang , Sitao Chen , Lizhao Liu , Hui Luo , Mingkui Tan

The task of estimating 3D occupancy from surrounding-view images is an exciting development in the field of autonomous driving, following the success of Bird's Eye View (BEV) perception. This task provides crucial 3D attributes of the…

Computer Vision and Pattern Recognition · Computer Science 2023-11-20 Wanshui Gan , Ningkai Mo , Hongbin Xu , Naoto Yokoya

LiDAR-based 3D occupancy prediction evolved rapidly alongside the emergence of large datasets. Nevertheless, the potential of existing diverse datasets remains underutilized as they kick in individually. Models trained on a specific dataset…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Zikun Xu , Jianqiang Wang , Shaobing Xu

Understanding how the surrounding environment changes is crucial for performing downstream tasks safely and reliably in autonomous driving applications. Recent occupancy estimation techniques using only camera images as input can provide…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Junyi Ma , Xieyuanli Chen , Jiawei Huang , Jingyi Xu , Zhen Luo , Jintao Xu , Weihao Gu , Rui Ai , Hesheng Wang