English
Related papers

Related papers: H3O: Hyper-Efficient 3D Occupancy Prediction with …

200 papers

Semantic occupancy has recently gained significant traction as a prominent 3D scene representation. However, most existing methods rely on large and costly datasets with fine-grained 3D voxel labels for training, which limits their…

Computer Vision and Pattern Recognition · Computer Science 2024-02-21 Simon Boeder , Fabian Gigengack , Benjamin Risse

Efficient and high-accuracy 3D occupancy prediction is vital for the performance of autonomous driving systems. However, existing methods struggle to balance precision and efficiency: high-accuracy approaches are often hindered by heavy…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Yuchen Zhou , Yan Luo , Xiaogang Wang , Xingjian Gu , Mingzhou Lu , Xiangbo Shu

3D semantic occupancy prediction has emerged as a critical perception task for autonomous driving due to its ability to offer voxel-level semantic and geometric understanding of the environment. However, such a refined representation for…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Hanlin Wu , Pengfei Lin , Ehsan Javanmardi , Naren Bao , Bo Qian , Hao Si , Manabu Tsukada

Accurately predicting 3D occupancy grids from visual inputs is critical for autonomous driving, but current discriminative methods struggle with noisy data, incomplete observations, and the complex structures inherent in 3D scenes. In this…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Yunshen Wang , Yicheng Liu , Tianyuan Yuan , Yingshi Liang , Xiuyu Yang , Honggang Zhang , Hang Zhao

The task of occupancy forecasting (OCF) involves utilizing past and present perception data to predict future occupancy states of autonomous vehicle surrounding environments, which is critical for downstream tasks such as obstacle avoidance…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Jingyi Xu , Xieyuanli Chen , Junyi Ma , Jiawei Huang , Jintao Xu , Yue Wang , Ling Pei

3D semantic occupancy prediction is crucial for finely representing the surrounding environment, which is essential for ensuring the safety in autonomous driving. Existing fusion-based occupancy methods typically involve performing a…

Computer Vision and Pattern Recognition · Computer Science 2024-11-07 Ji Zhang , Yiran Ding , Zixin Liu

3D semantic occupancy prediction is an essential part of autonomous driving, focusing on capturing the geometric details of scenes. Off-road environments are rich in geometric information, therefore it is suitable for 3D semantic occupancy…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Heng Zhai , Jilin Mei , Chen Min , Liang Chen , Fangzhou Zhao , Yu Hu

Visual-based 3D semantic occupancy perception is a key technology for robotics, including autonomous vehicles, offering an enhanced understanding of the environment by 3D. This approach, however, typically requires more computational…

Robotics · Computer Science 2024-05-21 Yupeng Jia , Jie He , Runze Chen , Fang Zhao , Haiyong Luo

Monocular Semantic Occupancy Prediction aims to infer the complete 3D geometry and semantic information of scenes from only 2D images. It has garnered significant attention, particularly due to its potential to enhance the 3D perception of…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Yupeng Zheng , Xiang Li , Pengfei Li , Yuhang Zheng , Bu Jin , Chengliang Zhong , Xiaoxiao Long , Hao Zhao , Qichao Zhang

Given the capability of mitigating the long-tail deficiencies and intricate-shaped absence prevalent in 3D object detection, occupancy prediction has become a pivotal component in autonomous driving systems. However, the procession of…

Computer Vision and Pattern Recognition · Computer Science 2023-11-22 Zichen Yu , Changyong Shu , Jiajun Deng , Kangjie Lu , Zongdai Liu , Jiangyong Yu , Dawei Yang , Hui Li , Yan Chen

Semantic occupancy prediction aims to infer dense geometry and semantics of surroundings for an autonomous agent to operate safely in the 3D environment. Existing occupancy prediction methods are almost entirely trained on human-annotated…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Zhiyu Tan , Zichao Dong , Cheng Zhang , Weikun Zhang , Hang Ji , Hao Li

Accurate perception of the dynamic environment is a fundamental task for autonomous driving and robot systems. This paper introduces Let Occ Flow, the first self-supervised work for joint 3D occupancy and occupancy flow prediction using…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Yili Liu , Linzhan Mou , Xuan Yu , Chenrui Han , Sitong Mao , Rong Xiong , Yue Wang

Autonomous driving perception faces significant challenges due to occlusions and incomplete scene data in the environment. To overcome these issues, the task of semantic occupancy prediction (SOP) is proposed, which aims to jointly infer…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Helin Cao , Sven Behnke

3D occupancy prediction enables the robots to obtain spatial fine-grained geometry and semantics of the surrounding scene, and has become an essential task for embodied perception. Existing methods based on 3D Gaussians instead of dense…

Robotics · Computer Science 2025-04-22 Zhang Zhang , Qiang Zhang , Wei Cui , Shuai Shi , Yijie Guo , Gang Han , Wen Zhao , Hengle Ren , Renjing Xu , Jian Tang

Learning 3D scene geometry and semantics from images is a core challenge in computer vision and a key capability for autonomous driving. Since large-scale 3D annotation is prohibitively expensive, recent work explores self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Adam Lilja , Ji Lan , Junsheng Fu , Lars Hammarstrand

3D semantic occupancy prediction is crucial for autonomous driving, providing a dense, semantically rich environmental representation. However, existing methods focus on in-distribution scenes, making them susceptible to Out-of-Distribution…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Yuheng Zhang , Mengfei Duan , Kunyu Peng , Yuhang Wang , Ruiping Liu , Fei Teng , Kai Luo , Zhiyong Li , Kailun Yang

Monocular 3D detection is a challenging task due to the lack of accurate 3D information. Existing approaches typically rely on geometry constraints and dense depth estimates to facilitate the learning, but often fail to fully exploit the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Liang Peng , Junkai Xu , Haoran Cheng , Zheng Yang , Xiaopei Wu , Wei Qian , Wenxiao Wang , Boxi Wu , Deng Cai

3D semantic occupancy and flow prediction are fundamental to spatiotemporal scene understanding. This paper proposes a vision-based framework with three targeted improvements. First, we introduce an occlusion-aware adaptive lifting…

Computer Vision and Pattern Recognition · Computer Science 2025-09-11 Dubing Chen , Jin Fang , Wencheng Han , Xinjing Cheng , Junbo Yin , Chenzhong Xu , Fahad Shahbaz Khan , Jianbing Shen

This paper introduces InverseMatrixVT3D, an efficient method for transforming multi-view image features into 3D feature volumes for 3D semantic occupancy prediction. Existing methods for constructing 3D volumes often rely on depth…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Zhenxing Ming , Julie Stephany Berrio , Mao Shan , Stewart Worrall

Autonomous driving has the potential to significantly enhance productivity and provide numerous societal benefits. Ensuring robustness in these safety-critical systems is essential, particularly when vehicles must navigate adverse weather…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Severin Heidrich , Till Beemelmanns , Alexey Nekrasov , Bastian Leibe , Lutz Eckstein