English
Related papers

Related papers: SurroundOcc: Multi-Camera 3D Occupancy Prediction …

200 papers

3D occupancy prediction based on multi-sensor fusion,crucial for a reliable autonomous driving system, enables fine-grained understanding of 3D scenes. Previous fusion-based 3D occupancy predictions relied on depth estimation for processing…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Ji Zhang , Yiran Ding , Zixin Liu

Autonomous driving requires forecasting both geometry and semantics over time to effectively reason about future environment states. Existing vision-based occupancy forecasting methods focus on motion-related categories such as static and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Riya Mohan , Juana Valeria Hurtado , Rohit Mohan , Abhinav Valada

In the realm of autonomous vehicle perception, comprehending 3D scenes is paramount for tasks such as planning and mapping. Camera-based 3D Semantic Occupancy Prediction (OCC) aims to infer scene geometry and semantics from limited…

Computer Vision and Pattern Recognition · Computer Science 2025-02-03 Sanbao Su , Nuo Chen , Chenchen Lin , Felix Juefei-Xu , Chen Feng , Fei Miao

3D semantic occupancy prediction is a pivotal task in the field of autonomous driving. Recent approaches have made great advances in 3D semantic occupancy predictions on a single modality. However, multi-modal semantic occupancy prediction…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Jingyi Pan , Zipeng Wang , Lin Wang

While 3D object bounding box (bbox) representation has been widely used in autonomous driving perception, it lacks the ability to capture the precise details of an object's intrinsic geometry. Recently, occupancy has emerged as a promising…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Chaoda Zheng , Feng Wang , Naiyan Wang , Shuguang Cui , Zhen Li

3D occupancy becomes a promising perception representation for autonomous driving to model the surrounding environment at a fine-grained scale. However, it remains challenging to efficiently aggregate 3D occupancy over time across multiple…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Ziyang Leng , Jiawei Yang , Wenlong Yi , Bolei Zhou

Multi-sensor fusion significantly enhances the accuracy and robustness of 3D semantic occupancy prediction, which is crucial for autonomous driving and robotics. However, most existing approaches depend on high-resolution images and complex…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Zhen Yang , Yanpeng Dong , Jiayu Wang , Heng Wang , Lichao Ma , Zijian Cui , Qi Liu , Haoran Pei , Kexin Zhang , Chao Zhang

Occupancy prediction infers fine-grained 3D geometry and semantics from camera images of the surrounding environment, making it a critical perception task for autonomous driving. Existing methods either adopt dense grids as scene…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Yunxiao Shi , Yinhao Zhu , Shizhong Han , Jisoo Jeong , Amin Ansari , Hong Cai , Fatih Porikli

In autonomous driving, 3D occupancy prediction outputs voxel-wise status and semantic labels for more comprehensive understandings of 3D scenes compared with traditional perception tasks, such as 3D object detection and bird's-eye view…

Computer Vision and Pattern Recognition · Computer Science 2024-03-06 Jiawei Hou , Xiaoyan Li , Wenhao Guan , Gang Zhang , Di Feng , Yuheng Du , Xiangyang Xue , Jian Pu

Accurate perception of the dynamic environment is a fundamental task for autonomous driving and robot systems. This paper introduces Let Occ Flow, the first self-supervised work for joint 3D occupancy and occupancy flow prediction using…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Yili Liu , Linzhan Mou , Xuan Yu , Chenrui Han , Sitong Mao , Rong Xiong , Yue Wang

The task of estimating 3D occupancy from surrounding-view images is an exciting development in the field of autonomous driving, following the success of Bird's Eye View (BEV) perception. This task provides crucial 3D attributes of the…

Computer Vision and Pattern Recognition · Computer Science 2023-11-20 Wanshui Gan , Ningkai Mo , Hongbin Xu , Naoto Yokoya

3D semantic occupancy prediction is crucial for autonomous driving perception, offering comprehensive geometric scene understanding and semantic recognition. However, existing methods struggle with geometric misalignment in view…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Xubo Zhu , Haoyang Zhang , Fei He , Rui Wu , Yanhu Shan , Wen Yang , Huai Yu

Monocular Semantic Occupancy Prediction aims to infer the complete 3D geometry and semantic information of scenes from only 2D images. It has garnered significant attention, particularly due to its potential to enhance the 3D perception of…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Yupeng Zheng , Xiang Li , Pengfei Li , Yuhang Zheng , Bu Jin , Chengliang Zhong , Xiaoxiao Long , Hao Zhao , Qichao Zhang

3D semantic occupancy prediction is one of the crucial tasks of autonomous driving. It enables precise and safe interpretation and navigation in complex environments. Reliable predictions rely on effective sensor fusion, as different…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Tomislav Pavković , Mohammad-Ali Nikouei Mahani , Johannes Niedermayer , Johannes Betz

The 3D occupancy estimation task has become an important challenge in the area of vision-based autonomous driving recently. However, most existing camera-based methods rely on costly 3D voxel labels or LiDAR scans for training, limiting…

Computer Vision and Pattern Recognition · Computer Science 2024-07-26 Simon Boeder , Fabian Gigengack , Benjamin Risse

Autonomous vehicles need a complete map of their surroundings to plan and act. This has sparked research into the tasks of 3D occupancy prediction, 3D scene completion, and 3D panoptic scene completion, which predict a dense map of the ego…

Computer Vision and Pattern Recognition · Computer Science 2025-05-15 Nicola Marinello , Simen Cassiman , Jonas Heylen , Marc Proesmans , Luc Van Gool

Occupancy prediction has garnered increasing attention in recent years for its comprehensive fine-grained environmental representation and strong generalization to open-set objects. However, cumbersome voxel features and 3D convolution…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Jinqing Zhang , Yanan Zhang , Qingjie Liu , Yunhong Wang

As a novel 3D scene representation, semantic occupancy has gained much attention in autonomous driving. However, existing occupancy prediction methods mainly focus on designing better occupancy representations, such as tri-perspective view…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Zhiwei Lin , Hongbo Jin , Yongtao Wang , Yufei Wei , Nan Dong

3D semantic occupancy prediction has emerged as a critical perception task for autonomous driving due to its ability to offer voxel-level semantic and geometric understanding of the environment. However, such a refined representation for…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Hanlin Wu , Pengfei Lin , Ehsan Javanmardi , Naren Bao , Bo Qian , Hao Si , Manabu Tsukada

Understanding how the 3D scene evolves is vital for making decisions in autonomous driving. Most existing methods achieve this by predicting the movements of object boxes, which cannot capture more fine-grained scene information. In this…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Wenzhao Zheng , Weiliang Chen , Yuanhui Huang , Borui Zhang , Yueqi Duan , Jiwen Lu