English
Related papers

Related papers: Stream and Query-guided Feature Aggregation for Ef…

200 papers

Efficient and high-accuracy 3D occupancy prediction is vital for the performance of autonomous driving systems. However, existing methods struggle to balance precision and efficiency: high-accuracy approaches are often hindered by heavy…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Yuchen Zhou , Yan Luo , Xiaogang Wang , Xingjian Gu , Mingzhou Lu , Xiangbo Shu

Semantic segmentation in autonomous driving has been undergoing an evolution from sparse point segmentation to dense voxel segmentation, where the objective is to predict the semantic occupancy of each voxel in the concerned 3D space. The…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Sicheng Zuo , Wenzhao Zheng , Yuanhui Huang , Jie Zhou , Jiwen Lu

Human driver can easily describe the complex traffic scene by visual system. Such an ability of precise perception is essential for driver's planning. To achieve this, a geometry-aware representation that quantizes the physical 3D scene…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Chonghao Sima , Wenwen Tong , Tai Wang , Li Chen , Silei Wu , Hanming Deng , Yi Gu , Lewei Lu , Ping Luo , Dahua Lin , Hongyang Li

Achieving highly accurate and real-time 3D occupancy prediction from cameras is a critical requirement for the safe and practical deployment of autonomous vehicles. While this shift to sparse 3D representations solves the encoding…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Suzeyu Chen , Leheng Li , Ying-Cong Chen

Monocular Semantic Occupancy Prediction aims to infer the complete 3D geometry and semantic information of scenes from only 2D images. It has garnered significant attention, particularly due to its potential to enhance the 3D perception of…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Yupeng Zheng , Xiang Li , Pengfei Li , Yuhang Zheng , Bu Jin , Chengliang Zhong , Xiaoxiao Long , Hao Zhao , Qichao Zhang

Occupancy prediction plays a pivotal role in autonomous driving (AD) due to the fine-grained geometric perception and general object recognition capabilities. However, existing methods often incur high computational costs, which contradicts…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Yulin He , Wei Chen , Tianci Xun , Yusong Tan

This paper introduces VLMFusionOcc3D, a robust multimodal framework for dense 3D semantic occupancy prediction in autonomous driving. Current voxel-based occupancy models often struggle with semantic ambiguity in sparse geometric grids and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 A. Enes Doruk , Hasan F. Ates

The field of autonomous driving is experiencing a surge of interest in world models, which aim to predict potential future scenarios based on historical observations. In this paper, we introduce DFIT-OccWorld, an efficient 3D occupancy…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Haiming Zhang , Ying Xue , Xu Yan , Jiacheng Zhang , Weichao Qiu , Dongfeng Bai , Bingbing Liu , Shuguang Cui , Zhen Li

Accurate perception of the dynamic environment is a fundamental task for autonomous driving and robot systems. This paper introduces Let Occ Flow, the first self-supervised work for joint 3D occupancy and occupancy flow prediction using…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Yili Liu , Linzhan Mou , Xuan Yu , Chenrui Han , Sitong Mao , Rong Xiong , Yue Wang

The 3D occupancy estimation task has become an important challenge in the area of vision-based autonomous driving recently. However, most existing camera-based methods rely on costly 3D voxel labels or LiDAR scans for training, limiting…

Computer Vision and Pattern Recognition · Computer Science 2024-07-26 Simon Boeder , Fabian Gigengack , Benjamin Risse

3D occupancy prediction based on multi-sensor fusion,crucial for a reliable autonomous driving system, enables fine-grained understanding of 3D scenes. Previous fusion-based 3D occupancy predictions relied on depth estimation for processing…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Ji Zhang , Yiran Ding , Zixin Liu

The safe operation of autonomous vehicles (AVs) is highly dependent on their understanding of the surroundings. For this, the task of 3D semantic occupancy prediction divides the space around the sensors into voxels, and labels each voxel…

Computer Vision and Pattern Recognition · Computer Science 2025-05-07 Zhenxing Ming , Julie Stephany Berrio , Mao Shan , Yaoqi Huang , Hongyu Lyu , Nguyen Hoang Khoi Tran , Tzu-Yun Tseng , Stewart Worrall

3D occupancy prediction (3DOcc) is a rapidly rising and challenging perception task in the field of autonomous driving. Existing 3D occupancy networks (OccNets) are both computationally heavy and label-hungry. In terms of model complexity,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Yining Shi , Kun Jiang , Jinyu Miao , Ke Wang , Kangan Qian , Yunlong Wang , Jiusi Li , Tuopu Wen , Mengmeng Yang , Yiliang Xu , Diange Yang

3D semantic occupancy prediction is crucial for finely representing the surrounding environment, which is essential for ensuring the safety in autonomous driving. Existing fusion-based occupancy methods typically involve performing a…

Computer Vision and Pattern Recognition · Computer Science 2024-11-07 Ji Zhang , Yiran Ding , Zixin Liu

3D semantic occupancy prediction is an essential part of autonomous driving, focusing on capturing the geometric details of scenes. Off-road environments are rich in geometric information, therefore it is suitable for 3D semantic occupancy…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Heng Zhai , Jilin Mei , Chen Min , Liang Chen , Fangzhou Zhao , Yu Hu

3D semantic occupancy and flow prediction are fundamental to spatiotemporal scene understanding. This paper proposes a vision-based framework with three targeted improvements. First, we introduce an occlusion-aware adaptive lifting…

Computer Vision and Pattern Recognition · Computer Science 2025-09-11 Dubing Chen , Jin Fang , Wencheng Han , Xinjing Cheng , Junbo Yin , Chenzhong Xu , Fahad Shahbaz Khan , Jianbing Shen

As a novel 3D scene representation, semantic occupancy has gained much attention in autonomous driving. However, existing occupancy prediction methods mainly focus on designing better occupancy representations, such as tri-perspective view…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Zhiwei Lin , Hongbo Jin , Yongtao Wang , Yufei Wei , Nan Dong

3D semantic occupancy has rapidly become a research focus in the fields of robotics and autonomous driving environment perception due to its ability to provide more realistic geometric perception and its closer integration with downstream…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Mu Chen , Wenyu Chen , Mingchuan Yang , Yuan Zhang , Tao Han , Xinchi Li , Yunlong Li , Huaici Zhao

Dense 3D semantic occupancy perception is critical for mobile robots operating in pedestrian-rich environments, yet it remains underexplored compared to its application in autonomous driving. To address this gap, we present MobileOcc, a…

Robotics · Computer Science 2025-11-24 Junseo Kim , Guido Dumont , Xinyu Gao , Gang Chen , Holger Caesar , Javier Alonso-Mora

Multimodal 3D occupancy prediction has garnered significant attention for its potential in autonomous driving. However, most existing approaches are single-modality: camera-based methods lack depth information, while LiDAR-based methods…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Zaipeng Duan , Chenxu Dang , Xuzhong Hu , Pei An , Junfeng Ding , Jie Zhan , Yunbiao Xu , Jie Ma