English
Related papers

Related papers: EmbodiedOcc++: Boosting Embodied 3D Occupancy Pred…

200 papers

Monocular 3D occupancy prediction, aiming to predict the occupancy and semantics within interesting regions of 3D scenes from only 2D images, has garnered increasing attention recently for its vital role in 3D scene understanding.…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Xu Zhao , Pengju Zhang , Bo Liu , Yihong Wu

Autonomous driving in complex urban scenarios requires 3D perception to be both comprehensive and precise. Traditional 3D perception methods focus on object detection, resulting in sparse representations that lack environmental detail.…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Chao Chen , Ruoyu Wang , Yuliang Guo , Cheng Zhao , Xinyu Huang , Chen Feng , Liu Ren

A comprehensive understanding of 3D scenes is crucial in autonomous vehicles (AVs), and recent models for 3D semantic occupancy prediction have successfully addressed the challenge of describing real-world objects with varied shapes and…

Computer Vision and Pattern Recognition · Computer Science 2024-05-10 Zhenxing Ming , Julie Stephany Berrio , Mao Shan , Stewart Worrall

The performance of multi-modal 3D occupancy prediction is limited by ineffective fusion, mainly due to geometry-semantics mismatch from fixed fusion strategies and surface detail loss caused by sparse, noisy annotations. The mismatch stems…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Luyao Lei , Shuo Xu , Yifan Bai , Xing Wei

Occupancy prediction infers fine-grained 3D geometry and semantics from camera images of the surrounding environment, making it a critical perception task for autonomous driving. Existing methods either adopt dense grids as scene…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Yunxiao Shi , Yinhao Zhu , Shizhong Han , Jisoo Jeong , Amin Ansari , Hong Cai , Fatih Porikli

3D semantic occupancy has rapidly become a research focus in the fields of robotics and autonomous driving environment perception due to its ability to provide more realistic geometric perception and its closer integration with downstream…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Mu Chen , Wenyu Chen , Mingchuan Yang , Yuan Zhang , Tao Han , Xinchi Li , Yunlong Li , Huaici Zhao

3D occupancy prediction is an important task for the robustness of vision-centric autonomous driving, which aims to predict whether each point is occupied in the surrounding 3D space. Existing methods usually require 3D occupancy labels to…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Yuanhui Huang , Wenzhao Zheng , Borui Zhang , Jie Zhou , Jiwen Lu

3D occupancy-based perception pipeline has significantly advanced autonomous driving by capturing detailed scene descriptions and demonstrating strong generalizability across various object categories and shapes. Current methods…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Fangqiang Ding , Xiangyu Wen , Yunzhou Zhu , Yiming Li , Chris Xiaoxuan Lu

Accurate 3D perception is essential for understanding the environment in autonomous driving. Recent advancements in 3D semantic occupancy prediction have leveraged camera-LiDAR fusion to improve robustness and accuracy. However, current…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Minjae Seong , Jisong Kim , Geonho Bang , Hawook Jeong , Jun Won Choi

Occupancy estimation has become a prominent task in 3D computer vision, particularly within the autonomous driving community. In this paper, we present a novel approach to occupancy estimation, termed GaussianFlowOcc, which is inspired by…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Simon Boeder , Fabian Gigengack , Benjamin Risse

Occupancy is crucial for autonomous driving, providing essential geometric priors for perception and planning. However, existing methods predominantly rely on LiDAR-based occupancy annotations, which limits scalability and prevents…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Baijun Ye , Minghui Qin , Saining Zhang , Moonjun Gong , Shaoting Zhu , Zebang Shen , Luan Zhang , Lu Zhang , Hao Zhao , Hang Zhao

Semantic occupancy prediction enables dense 3D geometric and semantic understanding for autonomous driving. However, existing camera-based approaches implicitly assume complete surround-view observations, an assumption that rarely holds in…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Kaixin Lin , Kunyu Peng , Di Wen , Yufan Chen , Ruiping Liu , Kailun Yang

Camera-based occupancy prediction is a mainstream approach for 3D perception in autonomous driving, aiming to infer complete 3D scene geometry and semantics from 2D images. Almost existing methods focus on improving performance through…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Rongtao Xu , Jinzhou Lin , Jialei Zhou , Jiahua Dong , Changwei Wang , Ruisheng Wang , Li Guo , Shibiao Xu , Xiaodan Liang

The resolution of voxel queries significantly influences the quality of view transformation in camera-based 3D occupancy prediction. However, computational constraints and the practical necessity for real-time deployment require smaller…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Gyeongrok Oh , Sungjune Kim , Heeju Ko , Hyung-gun Chi , Jinkyu Kim , Dongwook Lee , Daehyun Ji , Sungjoon Choi , Sujin Jang , Sangpil Kim

Vision-based 3D occupancy prediction has made significant advancements, but its reliance on cameras alone struggles in challenging environments. This limitation has driven the adoption of sensor fusion, among which camera-radar fusion…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Chaehee Song , Sanmin Kim , Hyeonjun Jeong , Juyeb Shin , Joonhee Lim , Dongsuk Kum

3D occupancy prediction based on multi-sensor fusion,crucial for a reliable autonomous driving system, enables fine-grained understanding of 3D scenes. Previous fusion-based 3D occupancy predictions relied on depth estimation for processing…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Ji Zhang , Yiran Ding , Zixin Liu

Open-world 3D semantic occupancy prediction aims to generate a voxelized 3D representation from sensor inputs while recognizing both known and unknown objects. Transferring open-vocabulary knowledge from vision-language models (VLMs) offers…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Peizheng Li , Shuxiao Ding , You Zhou , Qingwen Zhang , Onat Inak , Larissa Triess , Niklas Hanselmann , Marius Cordts , Andreas Zell

LiDAR-based 3D occupancy prediction evolved rapidly alongside the emergence of large datasets. Nevertheless, the potential of existing diverse datasets remains underutilized as they kick in individually. Models trained on a specific dataset…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Zikun Xu , Jianqiang Wang , Shaobing Xu

3D semantic occupancy prediction is an essential part of autonomous driving, focusing on capturing the geometric details of scenes. Off-road environments are rich in geometric information, therefore it is suitable for 3D semantic occupancy…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Heng Zhai , Jilin Mei , Chen Min , Liang Chen , Fangzhou Zhao , Yu Hu

The 3D occupancy estimation task has become an important challenge in the area of vision-based autonomous driving recently. However, most existing camera-based methods rely on costly 3D voxel labels or LiDAR scans for training, limiting…

Computer Vision and Pattern Recognition · Computer Science 2024-07-26 Simon Boeder , Fabian Gigengack , Benjamin Risse