English
Related papers

Related papers: Semantic Scene Completion Combining Colour and Dep…

200 papers

RGB images differentiate from depth images as they carry more details about the color and texture information, which can be utilized as a vital complementary to depth for boosting the performance of 3D semantic scene completion (SSC). SSC…

Computer Vision and Pattern Recognition · Computer Science 2019-05-02 Jie Li , Yu Liu , Dong Gong , Qinfeng Shi , Xia Yuan , Chunxia Zhao , Ian Reid

Camera-based 3D Semantic Scene Completion (SSC) is a critical task for autonomous driving and robotic scene understanding. It aims to infer a complete 3D volumetric representation of both semantics and geometry from a single image. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Zaidao Han , Risa Higashita , Jiang Liu

3D Semantic Scene Completion (SSC) provides comprehensive scene geometry and semantics for autonomous driving perception, which is crucial for enabling accurate and reliable decision-making. However, existing SSC methods are limited to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Meng Wang , Fan Wu , Ruihui Li , Yunchuan Qin , Zhuo Tang , Kenli Li

Holistic scene understanding is pivotal for the performance of autonomous machines. In this paper we propose a new end-to-end model for performing semantic segmentation and depth completion jointly. The vast majority of recent approaches…

Computer Vision and Pattern Recognition · Computer Science 2024-03-07 Juan Pablo Lagos , Esa Rahtu

We introduce SLCF-Net, a novel approach for the Semantic Scene Completion (SSC) task that sequentially fuses LiDAR and camera data. It jointly estimates missing geometry and semantics in a scene from sequences of RGB images and sparse LiDAR…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Helin Cao , Sven Behnke

Camera-based 3D semantic scene completion (SSC) plays a crucial role in autonomous driving, enabling voxelized 3D scene understanding for effective scene perception and decision-making. Existing SSC methods have shown efficacy in improving…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Zhiwen Yang , Yuxin Peng

This paper presents an end-to-end 3D convolutional network named attention-based multi-modal fusion network (AMFNet) for the semantic scene completion (SSC) task of inferring the occupancy and semantic labels of a volumetric 3D scene from…

Computer Vision and Pattern Recognition · Computer Science 2020-04-17 Siqi Li , Changqing Zou , Yipeng Li , Xibin Zhao , Yue Gao

Semantic Scene Completion (SSC) aims to simultaneously predict the volumetric occupancy and semantic category of a 3D scene. In this paper, we propose a real-time semantic scene completion method with a feature aggregation strategy and…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Xiaokang Chen , Yajie Xing , Gang Zeng

Semantic scene completion (SSC) requires an accurate understanding of the geometric and semantic relationships between the objects in the 3D scene for reasoning the occluded objects. The popular SSC methods voxelize the 3D objects, allowing…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Haotian Dong , Enhui Ma , Lubo Wang , Miaohui Wang , Wuyuan Xie , Qing Guo , Ping Li , Lingyu Liang , Kairui Yang , Di Lin

3D semantic scene understanding is a fundamental challenge in computer vision. It enables mobile agents to autonomously plan and navigate arbitrary environments. SSC formalizes this challenge as jointly estimating dense geometry and…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Adrian Hayler , Felix Wimbauer , Dominik Muhle , Christian Rupprecht , Daniel Cremers

With the increasing reliance of self-driving and similar robotic systems on robust 3D vision, the processing of LiDAR scans with deep convolutional neural networks has become a trend in academia and industry alike. Prior attempts on the…

Computer Vision and Pattern Recognition · Computer Science 2023-11-20 Ran Cheng , Christopher Agia , Yuan Ren , Xinhai Li , Liu Bingbing

Semantic Scene Completion (SSC) refers to the task of inferring the 3D semantic segmentation of a scene while simultaneously completing the 3D shapes. We propose PALNet, a novel hybrid network for SSC based on single depth. PALNet utilizes…

Computer Vision and Pattern Recognition · Computer Science 2020-02-03 Yu Liu , Jie Li , Xia Yuan , Chunxia Zhao , Roland Siegwart , Ian Reid , Cesar Cadena

Semantic scene completion is the task of jointly estimating 3D geometry and semantics of objects and surfaces within a given extent. This is a particularly challenging task on real-world data that is sparse and occluded. We propose a scene…

Computer Vision and Pattern Recognition · Computer Science 2021-04-14 Christoph B. Rist , David Emmerichs , Markus Enzweiler , Dariu M. Gavrila

Real-time scene reconstruction from depth data inevitably suffers from occlusion, thus leading to incomplete 3D models. Partial reconstructions, in turn, limit the performance of algorithms that leverage them for applications in the context…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Shun-Cheng Wu , Keisuke Tateno , Nassir Navab , Federico Tombari

In this paper, a method for dense semantic 3D scene reconstruction from an RGB-D sequence is proposed to solve high-level scene understanding tasks. First, each RGB-D pair is consistently segmented into 2D semantic maps based on a camera…

Computer Vision and Pattern Recognition · Computer Science 2021-10-01 Yingcai Wan , Yanyan Li , Yingxuan You , Cheng Guo , Lijin Fang , Federico Tombari

Semantic Scene Completion (SSC) aims to jointly generate space occupancies and semantic labels for complex 3D scenes. Most existing SSC models focus on volumetric representations, which are memory-inefficient for large outdoor spaces. Point…

Computer Vision and Pattern Recognition · Computer Science 2024-03-08 Yuxiang Yan , Boda Liu , Jianfei Ai , Qinbu Li , Ru Wan , Jian Pu

This paper focuses on visual semantic navigation, the task of producing actions for an active agent to navigate to a specified target object category in an unknown environment. To complete this task, the algorithm should simultaneously…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Yiqing Liang , Boyuan Chen , Shuran Song

We introduce a new approach for multiscale 3Dsemantic scene completion from voxelized sparse 3D LiDAR scans. As opposed to the literature, we use a 2D UNet backbone with comprehensive multiscale skip connections to enhance feature flow,…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Luis Roldão , Raoul de Charette , Anne Verroust-Blondet

The vision-based semantic scene completion task aims to predict dense geometric and semantic 3D scene representations from 2D images. However, the presence of dynamic objects in the scene seriously affects the accuracy of the model…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Meng Wang , Fan Wu , Yunchuan Qin , Ruihui Li , Zhuo Tang , Kenli Li

We introduce Spatial Group Convolution (SGC) for accelerating the computation of 3D dense prediction tasks. SGC is orthogonal to group convolution, which works on spatial dimensions rather than feature channel dimension. It divides input…

Computer Vision and Pattern Recognition · Computer Science 2019-07-12 Jiahui Zhang , Hao Zhao , Anbang Yao , Yurong Chen , Li Zhang , Hongen Liao