English
Related papers

Related papers: QueryOcc: Query-based Self-Supervision for 3D Sema…

200 papers

3D semantic occupancy prediction is crucial for autonomous driving perception, offering comprehensive geometric scene understanding and semantic recognition. However, existing methods struggle with geometric misalignment in view…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Xubo Zhu , Haoyang Zhang , Fei He , Rui Wu , Yanhu Shan , Wen Yang , Huai Yu

Semantic occupancy has recently gained significant traction as a prominent 3D scene representation. However, most existing methods rely on large and costly datasets with fine-grained 3D voxel labels for training, which limits their…

Computer Vision and Pattern Recognition · Computer Science 2024-02-21 Simon Boeder , Fabian Gigengack , Benjamin Risse

3D reconstruction has been widely used in autonomous navigation fields of mobile robotics. However, the former research can only provide the basic geometry structure without the capability of open-world scene understanding, limiting…

Computer Vision and Pattern Recognition · Computer Science 2024-08-12 Haochen Jiang , Yueming Xu , Yihan Zeng , Hang Xu , Wei Zhang , Jianfeng Feng , Li Zhang

Self-supervised 3D occupancy prediction offers a promising solution for understanding complex driving scenes without requiring costly 3D annotations. However, training dense occupancy decoders to capture fine-grained geometry and semantics…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Fengyi Zhang , Xiangyu Sun , Huitong Yang , Zheng Zhang , Zi Huang , Yadan Luo

Semantic Scene Completion (SSC) aims to infer complete 3D geometry and semantics from monocular images, serving as a crucial capability for camera-based perception in autonomous driving. However, existing SSC methods relying on temporal…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Jinzhou Lin , Jie Zhou , Wenhao Xu , Rongtao Xu , Changwei Wang , Shunpeng Chen , Kexue Fu , Yihua Shao , Li Guo , Shibiao Xu

3D semantic occupancy prediction offers an intuitive and efficient scene understanding and has attracted significant interest in autonomous driving perception. Existing approaches either rely on full supervision, which demands costly…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Naiyu Fang , Zheyuan Zhou , Fayao Liu , Xulei Yang , Jiacheng Wei , Lemiao Qiu , Hongsheng Li , Guosheng Lin

Robust 3D semantic occupancy is crucial for legged/humanoid robots, yet most semantic scene completion (SSC) systems target wheeled platforms with forward-facing sensors. We present OneOcc, a vision-only panoramic SSC framework designed for…

Robotics · Computer Science 2026-03-17 Hao Shi , Ze Wang , Shangwei Guo , Mengfei Duan , Song Wang , Teng Chen , Kailun Yang , Lin Wang , Kaiwei Wang

The resolution of voxel queries significantly influences the quality of view transformation in camera-based 3D occupancy prediction. However, computational constraints and the practical necessity for real-time deployment require smaller…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Gyeongrok Oh , Sungjune Kim , Heeju Ko , Hyung-gun Chi , Jinkyu Kim , Dongwook Lee , Daehyun Ji , Sungjoon Choi , Sujin Jang , Sangpil Kim

Robotic perception requires the modeling of both 3D geometry and semantics. Existing methods typically focus on estimating 3D bounding boxes, neglecting finer geometric details and struggling to handle general, out-of-vocabulary objects. 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Xiaoyu Tian , Tao Jiang , Longfei Yun , Yucheng Mao , Huitong Yang , Yue Wang , Yilun Wang , Hang Zhao

3D semantic occupancy prediction is one of the crucial tasks of autonomous driving. It enables precise and safe interpretation and navigation in complex environments. Reliable predictions rely on effective sensor fusion, as different…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Tomislav Pavković , Mohammad-Ali Nikouei Mahani , Johannes Niedermayer , Johannes Betz

Crucial for autonomous exploration, online 3D occupancy prediction and mapping incrementally constructs dense spatial representations on the fly. However, recent Gaussian-centric methods struggle with structural boundary fidelity and rely…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Ruoyu Wang , Yong Liu , Sheng Tao , Yuhang Lin , Yukai Ma

Semantic occupancy perception is essential for autonomous driving, as automated vehicles require a fine-grained perception of the 3D urban structures. However, existing relevant benchmarks lack diversity in urban scenes, and they only…

Computer Vision and Pattern Recognition · Computer Science 2023-03-08 Xiaofeng Wang , Zheng Zhu , Wenbo Xu , Yunpeng Zhang , Yi Wei , Xu Chi , Yun Ye , Dalong Du , Jiwen Lu , Xingang Wang

Human driver can easily describe the complex traffic scene by visual system. Such an ability of precise perception is essential for driver's planning. To achieve this, a geometry-aware representation that quantizes the physical 3D scene…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Chonghao Sima , Wenwen Tong , Tai Wang , Li Chen , Silei Wu , Hanming Deng , Yi Gu , Lewei Lu , Ping Luo , Dahua Lin , Hongyang Li

Driven by autonomous driving's demands for precise 3D perception, 3D semantic occupancy prediction has become a pivotal research topic. Unlike bird's-eye-view (BEV) methods, which restrict scene representation to a 2D plane, occupancy…

Computer Vision and Pattern Recognition · Computer Science 2025-09-05 Han Huang , Han Sun , Ningzhong Liu , Huiyu Zhou , Jiaquan Shen

3D occupancy prediction has recently emerged as a new paradigm for holistic 3D scene understanding and provides valuable information for downstream planning in autonomous driving. Most existing methods, however, are computationally…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Yunxiao Shi , Hong Cai , Amin Ansari , Fatih Porikli

Semantic occupancy prediction enables dense 3D geometric and semantic understanding for autonomous driving. However, existing camera-based approaches implicitly assume complete surround-view observations, an assumption that rarely holds in…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Kaixin Lin , Kunyu Peng , Di Wen , Yufan Chen , Ruiping Liu , Kailun Yang

Visual grounding aims to identify objects or regions in a scene based on natural language descriptions, essential for spatially aware perception in autonomous driving. However, existing visual grounding tasks typically depend on bounding…

Computer Vision and Pattern Recognition · Computer Science 2025-09-04 Zhan Shi , Song Wang , Junbo Chen , Jianke Zhu

Accurate 3D perception is essential for understanding the environment in autonomous driving. Recent advancements in 3D semantic occupancy prediction have leveraged camera-LiDAR fusion to improve robustness and accuracy. However, current…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Minjae Seong , Jisong Kim , Geonho Bang , Hawook Jeong , Jun Won Choi

We propose a new self-supervised method for pre-training the backbone of deep perception models operating on point clouds. The core idea is to train the model on a pretext task which is the reconstruction of the surface on which the 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Alexandre Boulch , Corentin Sautier , Björn Michele , Gilles Puy , Renaud Marlet

The advancement of autonomous driving is increasingly reliant on high-quality annotated datasets, especially in the task of 3D occupancy prediction, where the occupancy labels require dense 3D annotation with significant human effort. In…

Computer Vision and Pattern Recognition · Computer Science 2024-10-02 Leheng Li , Weichao Qiu , Yingjie Cai , Xu Yan , Qing Lian , Bingbing Liu , Ying-Cong Chen