English
Related papers

Related papers: FMOcc: TPV-Driven Flow Matching for 3D Occupancy P…

200 papers

3D semantic occupancy prediction is crucial for autonomous driving perception, offering comprehensive geometric scene understanding and semantic recognition. However, existing methods struggle with geometric misalignment in view…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Xubo Zhu , Haoyang Zhang , Fei He , Rui Wu , Yanhu Shan , Wen Yang , Huai Yu

3D occupancy prediction (3DOcc) is a rapidly rising and challenging perception task in the field of autonomous driving. Existing 3D occupancy networks (OccNets) are both computationally heavy and label-hungry. In terms of model complexity,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Yining Shi , Kun Jiang , Jinyu Miao , Ke Wang , Kangan Qian , Yunlong Wang , Jiusi Li , Tuopu Wen , Mengmeng Yang , Yiliang Xu , Diange Yang

Crucial for autonomous exploration, online 3D occupancy prediction and mapping incrementally constructs dense spatial representations on the fly. However, recent Gaussian-centric methods struggle with structural boundary fidelity and rely…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Ruoyu Wang , Yong Liu , Sheng Tao , Yuhang Lin , Yukai Ma

Depth completion is a vital task for autonomous driving, as it involves reconstructing the precise 3D geometry of a scene from sparse and noisy depth measurements. However, most existing methods either rely only on 2D depth representations…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Zhiqiang Yan , Yuankai Lin , Kun Wang , Yupeng Zheng , Yufei Wang , Zhenyu Zhang , Jun Li , Jian Yang

Vision-centric occupancy networks, which represent the surrounding environment with uniform voxels with semantics, have become a new trend for safe driving of camera-only autonomous driving perception systems, as they are able to detect…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Yining Shi , Jiusi Li , Kun Jiang , Ke Wang , Yunlong Wang , Mengmeng Yang , Diange Yang

Panoptic occupancy poses a novel challenge by aiming to integrate instance occupancy and semantic occupancy within a unified framework. However, there is still a lack of efficient solutions for panoptic occupancy. In this paper, we propose…

Computer Vision and Pattern Recognition · Computer Science 2024-10-25 Zichen Yu , Changyong Shu , Qianpu Sun , Yifan Bian , Xiaobao Wei , Jiangyong Yu , Zongdai Liu , Dawei Yang , Hui Li , Yan Chen

Self-supervised 3D occupancy prediction offers a promising solution for understanding complex driving scenes without requiring costly 3D annotations. However, training dense occupancy decoders to capture fine-grained geometry and semantics…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Fengyi Zhang , Xiangyu Sun , Huitong Yang , Zheng Zhang , Zi Huang , Yadan Luo

3D semantic occupancy prediction has emerged as a critical perception task for autonomous driving due to its ability to offer voxel-level semantic and geometric understanding of the environment. However, such a refined representation for…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Hanlin Wu , Pengfei Lin , Ehsan Javanmardi , Naren Bao , Bo Qian , Hao Si , Manabu Tsukada

Comprehensive modeling of the surrounding 3D world is key to the success of autonomous driving. However, existing perception tasks like object detection, road structure segmentation, depth & elevation estimation, and open-set object…

Computer Vision and Pattern Recognition · Computer Science 2023-06-19 Yuqi Wang , Yuntao Chen , Xingyu Liao , Lue Fan , Zhaoxiang Zhang

Camera-based occupancy prediction is a mainstream approach for 3D perception in autonomous driving, aiming to infer complete 3D scene geometry and semantics from 2D images. Almost existing methods focus on improving performance through…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Rongtao Xu , Jinzhou Lin , Jialei Zhou , Jiahua Dong , Changwei Wang , Ruisheng Wang , Li Guo , Shibiao Xu , Xiaodan Liang

3D scene understanding plays a vital role in vision-based autonomous driving. While most existing methods focus on 3D object detection, they have difficulty describing real-world objects of arbitrary shapes and infinite classes. Towards a…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Yi Wei , Linqing Zhao , Wenzhao Zheng , Zheng Zhu , Jie Zhou , Jiwen Lu

Accurate 3D semantic occupancy perception is essential for autonomous driving in complex environments with diverse and irregular objects. While vision-centric methods suffer from geometric inaccuracies, LiDAR-based approaches often lack…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Zhiqiang Wei , Lianqing Zheng , Jianan Liu , Tao Huang , Qing-Long Han , Wenwen Zhang , Fengdeng Zhang

3D semantic occupancy has rapidly become a research focus in the fields of robotics and autonomous driving environment perception due to its ability to provide more realistic geometric perception and its closer integration with downstream…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Mu Chen , Wenyu Chen , Mingchuan Yang , Yuan Zhang , Tao Han , Xinchi Li , Yunlong Li , Huaici Zhao

The autonomous driving community has shown significant interest in 3D occupancy prediction, driven by its exceptional geometric perception and general object recognition capabilities. To achieve this, current works try to construct a…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Qihang Ma , Xin Tan , Yanyun Qu , Lizhuang Ma , Zhizhong Zhang , Yuan Xie

While multi-modal 3D semantic occupancy prediction typically enhances robustness by fusing camera and LiDAR inputs, its effectiveness is fundamentally constrained by environmental variability. Specifically, camera sensors suffer from severe…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 A. Enes Doruk , Abdelaziz Hussein , Hasan F. Ates

The resolution of voxel queries significantly influences the quality of view transformation in camera-based 3D occupancy prediction. However, computational constraints and the practical necessity for real-time deployment require smaller…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Gyeongrok Oh , Sungjune Kim , Heeju Ko , Hyung-gun Chi , Jinkyu Kim , Dongwook Lee , Daehyun Ji , Sungjoon Choi , Sujin Jang , Sangpil Kim

Visual Odometry (VO) plays a pivotal role in autonomous systems, with a principal challenge being the lack of depth information in camera images. This paper introduces OCC-VO, a novel framework that capitalizes on recent advances in deep…

Robotics · Computer Science 2024-03-27 Heng Li , Yifan Duan , Xinran Zhang , Haiyi Liu , Jianmin Ji , Yanyong Zhang

Forecasting the future states of surrounding traffic participants is a crucial capability for autonomous vehicles. The recently proposed occupancy flow field prediction introduces a scalable and effective representation to jointly predict…

Computer Vision and Pattern Recognition · Computer Science 2023-07-07 Haochen Liu , Zhiyu Huang , Chen Lv

Semantic Scene Completion (SSC) is pivotal in autonomous driving perception, frequently confronted with the complexities of weather and illumination changes. The long-term strategy involves fusing multi-modal information to bolster the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Yukai Ma , Jianbiao Mei , Xuemeng Yang , Licheng Wen , Weihua Xu , Jiangning Zhang , Botian Shi , Yong Liu , Xingxing Zuo

3D occupancy prediction based on multi-sensor fusion,crucial for a reliable autonomous driving system, enables fine-grained understanding of 3D scenes. Previous fusion-based 3D occupancy predictions relied on depth estimation for processing…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Ji Zhang , Yiran Ding , Zixin Liu