English
Related papers

Related papers: DSOcc: Leveraging Depth Awareness and Semantic Aid…

200 papers

Accurate 3D perception is essential for understanding the environment in autonomous driving. Recent advancements in 3D semantic occupancy prediction have leveraged camera-LiDAR fusion to improve robustness and accuracy. However, current…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Minjae Seong , Jisong Kim , Geonho Bang , Hawook Jeong , Jun Won Choi

Vision-centric semantic occupancy prediction plays a crucial role in autonomous driving, which requires accurate and reliable predictions from low-cost sensors. Although having notably narrowed the accuracy gap with LiDAR, there is still…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Song Wang , Zhongdao Wang , Jiawei Yu , Wentong Li , Bailan Feng , Junbo Chen , Jianke Zhu

3D semantic occupancy prediction is an essential part of autonomous driving, focusing on capturing the geometric details of scenes. Off-road environments are rich in geometric information, therefore it is suitable for 3D semantic occupancy…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Heng Zhai , Jilin Mei , Chen Min , Liang Chen , Fangzhou Zhao , Yu Hu

Multimodal 3D occupancy prediction has garnered significant attention for its potential in autonomous driving. However, most existing approaches are single-modality: camera-based methods lack depth information, while LiDAR-based methods…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Zaipeng Duan , Chenxu Dang , Xuzhong Hu , Pei An , Junfeng Ding , Jie Zhan , Yunbiao Xu , Jie Ma

3D occupancy becomes a promising perception representation for autonomous driving to model the surrounding environment at a fine-grained scale. However, it remains challenging to efficiently aggregate 3D occupancy over time across multiple…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Ziyang Leng , Jiawei Yang , Wenlong Yi , Bolei Zhou

Vision-based 3D semantic occupancy prediction is vital for autonomous driving, enabling unified modeling of static infrastructure and dynamic agents. Global occupancy maps serve as long-term memory priors, providing valuable historical…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Shanshuai Yuan , Julong Wei , Muer Tie , Xiangyun Ren , Zhongxue Gan , Wenchao Ding

Monocular 3D occupancy prediction, aiming to predict the occupancy and semantics within interesting regions of 3D scenes from only 2D images, has garnered increasing attention recently for its vital role in 3D scene understanding.…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Xu Zhao , Pengju Zhang , Bo Liu , Yihong Wu

3D occupancy perception holds a pivotal role in recent vision-centric autonomous driving systems by converting surround-view images into integrated geometric and semantic representations within dense 3D grids. Nevertheless, current models…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Xin Tan , Wenbin Wu , Zhiwei Zhang , Chaojie Fan , Yong Peng , Zhizhong Zhang , Yuan Xie , Lizhuang Ma

Autonomous driving perception faces significant challenges due to occlusions and incomplete scene data in the environment. To overcome these issues, the task of semantic occupancy prediction (SOP) is proposed, which aims to jointly infer…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Helin Cao , Sven Behnke

Robust 3D occupancy prediction is essential for autonomous driving, particularly under adverse weather conditions where traditional vision-only systems struggle. While the fusion of surround-view 4D radar and cameras offers a promising…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Long Yang , Lianqing Zheng , Wenjin Ai , Minghao Liu , Sen Li , Qunshu Lin , Shengyu Yan , Jie Bai , Zhixiong Ma , Tao Huang , Xichan Zhu

Vision-based 3D semantic scene completion (SSC) describes autonomous driving scenes through 3D volume representations. However, the occlusion of invisible voxels by scene surfaces poses challenges to current SSC methods in hallucinating…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Xiao Zhao , Bo Chen , Mingyang Sun , Dingkang Yang , Youxing Wang , Xukun Zhang , Mingcheng Li , Dongliang Kou , Xiaoyi Wei , Lihua Zhang

A comprehensive understanding of 3D scenes is crucial in autonomous vehicles (AVs), and recent models for 3D semantic occupancy prediction have successfully addressed the challenge of describing real-world objects with varied shapes and…

Computer Vision and Pattern Recognition · Computer Science 2024-05-10 Zhenxing Ming , Julie Stephany Berrio , Mao Shan , Stewart Worrall

Understanding 3D scenes semantically and spatially is crucial for the safe navigation of robots and autonomous vehicles, aiding obstacle avoidance and accurate trajectory planning. Camera-based 3D semantic occupancy prediction, which infers…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Junsu Kim , Junhee Lee , Ukcheol Shin , Jean Oh , Kyungdon Joo

In autonomous driving, 3D occupancy prediction outputs voxel-wise status and semantic labels for more comprehensive understandings of 3D scenes compared with traditional perception tasks, such as 3D object detection and bird's-eye view…

Computer Vision and Pattern Recognition · Computer Science 2024-03-06 Jiawei Hou , Xiaoyan Li , Wenhao Guan , Gang Zhang , Di Feng , Yuheng Du , Xiangyang Xue , Jian Pu

3D semantic occupancy prediction aims to forecast detailed geometric and semantic information of the surrounding environment for autonomous vehicles (AVs) using onboard surround-view cameras. Existing methods primarily focus on intricate…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Zhenxing Ming , Julie Stephany Berrio , Mao Shan , Stewart Worrall

3D occupancy prediction based on multi-sensor fusion,crucial for a reliable autonomous driving system, enables fine-grained understanding of 3D scenes. Previous fusion-based 3D occupancy predictions relied on depth estimation for processing…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Ji Zhang , Yiran Ding , Zixin Liu

3D occupancy prediction holds significant promise in the fields of robot perception and autonomous driving, which quantifies 3D scenes into grid cells with semantic labels. Recent works mainly utilize complete occupancy labels in 3D voxel…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Mingjie Pan , Jiaming Liu , Renrui Zhang , Peixiang Huang , Xiaoqi Li , Bing Wang , Hongwei Xie , Li Liu , Shanghang Zhang

Occupancy prediction has garnered increasing attention in recent years for its comprehensive fine-grained environmental representation and strong generalization to open-set objects. However, cumbersome voxel features and 3D convolution…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Jinqing Zhang , Yanan Zhang , Qingjie Liu , Yunhong Wang

Camera-based 3D semantic scene completion (SSC) plays a crucial role in autonomous driving, enabling voxelized 3D scene understanding for effective scene perception and decision-making. Existing SSC methods have shown efficacy in improving…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Zhiwen Yang , Yuxin Peng

3D semantic occupancy prediction offers an intuitive and efficient scene understanding and has attracted significant interest in autonomous driving perception. Existing approaches either rely on full supervision, which demands costly…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Naiyu Fang , Zheyuan Zhou , Fayao Liu , Xulei Yang , Jiacheng Wei , Lemiao Qiu , Hongsheng Li , Guosheng Lin