English
Related papers

Related papers: ALOcc: Adaptive Lifting-Based 3D Semantic Occupanc…

200 papers

Open-world 3D semantic occupancy prediction aims to generate a voxelized 3D representation from sensor inputs while recognizing both known and unknown objects. Transferring open-vocabulary knowledge from vision-language models (VLMs) offers…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Peizheng Li , Shuxiao Ding , You Zhou , Qingwen Zhang , Onat Inak , Larissa Triess , Niklas Hanselmann , Marius Cordts , Andreas Zell

Developing 3D semantic occupancy prediction models often relies on dense 3D annotations for supervised learning, a process that is both labor and resource-intensive, underscoring the need for label-efficient or even label-free approaches.…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Samuel Sze , Daniele De Martini , Lars Kunze

In recent years, autonomous driving has garnered escalating attention for its potential to relieve drivers' burdens and improve driving safety. Vision-based 3D occupancy prediction, which predicts the spatial occupancy status and semantics…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Yanan Zhang , Jinqing Zhang , Zengran Wang , Junhao Xu , Di Huang

Semantic occupancy prediction aims to infer dense geometry and semantics of surroundings for an autonomous agent to operate safely in the 3D environment. Existing occupancy prediction methods are almost entirely trained on human-annotated…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Zhiyu Tan , Zichao Dong , Cheng Zhang , Weikun Zhang , Hang Ji , Hao Li

3D occupancy prediction holds significant promise in the fields of robot perception and autonomous driving, which quantifies 3D scenes into grid cells with semantic labels. Recent works mainly utilize complete occupancy labels in 3D voxel…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Mingjie Pan , Jiaming Liu , Renrui Zhang , Peixiang Huang , Xiaoqi Li , Bing Wang , Hongwei Xie , Li Liu , Shanghang Zhang

Scene flow estimation is the task to predict the point-wise or pixel-wise 3D displacement vector between two consecutive frames of point clouds or images, which has important application in fields such as service robots and autonomous…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Guangming Wang , Yunzhe Hu , Xinrui Wu , Hesheng Wang

3D semantic occupancy prediction is an emerging perception paradigm in autonomous driving, providing a voxel-level representation of both geometric details and semantic categories. However, its effectiveness is inherently constrained in…

Computer Vision and Pattern Recognition · Computer Science 2026-01-19 Hanlin Wu , Pengfei Lin , Ehsan Javanmardi , Naren Bao , Bo Qian , Hao Si , Manabu Tsukada

Obtaining high-quality 3D semantic occupancy from raw sensor data remains an essential yet challenging task, often requiring extensive manual labeling. In this work, we propose AutoOcc, a vision-centric automated pipeline for open-ended…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Xiaoyu Zhou , Jingqi Wang , Yongtao Wang , Yufei Wei , Nan Dong , Ming-Hsuan Yang

Multi-sensor fusion significantly enhances the accuracy and robustness of 3D semantic occupancy prediction, which is crucial for autonomous driving and robotics. However, most existing approaches depend on high-resolution images and complex…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Zhen Yang , Yanpeng Dong , Jiayu Wang , Heng Wang , Lichao Ma , Zijian Cui , Qi Liu , Haoran Pei , Kexin Zhang , Chao Zhang

Given the capability of mitigating the long-tail deficiencies and intricate-shaped absence prevalent in 3D object detection, occupancy prediction has become a pivotal component in autonomous driving systems. However, the procession of…

Computer Vision and Pattern Recognition · Computer Science 2023-11-22 Zichen Yu , Changyong Shu , Jiajun Deng , Kangjie Lu , Zongdai Liu , Jiangyong Yu , Dawei Yang , Hui Li , Yan Chen

Holistic understanding and reasoning in 3D scenes are crucial for the success of autonomous driving systems. The evolution of 3D semantic occupancy prediction as a pretraining task for autonomous driving and robotic applications captures…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Sathira Silva , Savindu Bhashitha Wannigama , Gihan Jayatilaka , Muhammad Haris Khan , Roshan Ragel

The resolution of voxel queries significantly influences the quality of view transformation in camera-based 3D occupancy prediction. However, computational constraints and the practical necessity for real-time deployment require smaller…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Gyeongrok Oh , Sungjune Kim , Heeju Ko , Hyung-gun Chi , Jinkyu Kim , Dongwook Lee , Daehyun Ji , Sungjoon Choi , Sujin Jang , Sangpil Kim

3D occupancy prediction is an important task for the robustness of vision-centric autonomous driving, which aims to predict whether each point is occupied in the surrounding 3D space. Existing methods usually require 3D occupancy labels to…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Yuanhui Huang , Wenzhao Zheng , Borui Zhang , Jie Zhou , Jiwen Lu

Vision-based 3D semantic scene completion (SSC) describes autonomous driving scenes through 3D volume representations. However, the occlusion of invisible voxels by scene surfaces poses challenges to current SSC methods in hallucinating…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Xiao Zhao , Bo Chen , Mingyang Sun , Dingkang Yang , Youxing Wang , Xukun Zhang , Mingcheng Li , Dongliang Kou , Xiaoyi Wei , Lihua Zhang

3D occupancy prediction has become a key perception task in autonomous driving, as it enables comprehensive scene understanding. Recent methods enhance this understanding by incorporating spatiotemporal information through multi-frame…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Seokha Moon , Janghyun Baek , Giseop Kim , Jinkyu Kim , Sunwook Choi

3D occupancy prediction based on multi-sensor fusion,crucial for a reliable autonomous driving system, enables fine-grained understanding of 3D scenes. Previous fusion-based 3D occupancy predictions relied on depth estimation for processing…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Ji Zhang , Yiran Ding , Zixin Liu

While multi-modal 3D semantic occupancy prediction typically enhances robustness by fusing camera and LiDAR inputs, its effectiveness is fundamentally constrained by environmental variability. Specifically, camera sensors suffer from severe…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 A. Enes Doruk , Abdelaziz Hussein , Hasan F. Ates

As a novel 3D scene representation, semantic occupancy has gained much attention in autonomous driving. However, existing occupancy prediction methods mainly focus on designing better occupancy representations, such as tri-perspective view…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Zhiwei Lin , Hongbo Jin , Yongtao Wang , Yufei Wei , Nan Dong

3D semantic occupancy prediction, which seeks to provide accurate and comprehensive representations of environment scenes, is important to autonomous driving systems. For autonomous cars equipped with multi-camera and LiDAR, it is critical…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Zhuangwei Zhuang , Ziyin Wang , Sitao Chen , Lizhao Liu , Hui Luo , Mingkui Tan

Understanding 3D scenes semantically and spatially is crucial for the safe navigation of robots and autonomous vehicles, aiding obstacle avoidance and accurate trajectory planning. Camera-based 3D semantic occupancy prediction, which infers…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Junsu Kim , Junhee Lee , Ukcheol Shin , Jean Oh , Kyungdon Joo