English
Related papers

Related papers: Semantic Scene Completion from a Single Depth Imag…

200 papers

This paper presents an end-to-end 3D convolutional network named attention-based multi-modal fusion network (AMFNet) for the semantic scene completion (SSC) task of inferring the occupancy and semantic labels of a volumetric 3D scene from…

Computer Vision and Pattern Recognition · Computer Science 2020-04-17 Siqi Li , Changqing Zou , Yipeng Li , Xibin Zhao , Yue Gao

MonoScene proposes a 3D Semantic Scene Completion (SSC) framework, where the dense geometry and semantics of a scene are inferred from a single monocular RGB image. Different from the SSC literature, relying on 2.5 or 3D input, we solve the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Anh-Quan Cao , Raoul de Charette

3D semantic scene understanding is a fundamental challenge in computer vision. It enables mobile agents to autonomously plan and navigate arbitrary environments. SSC formalizes this challenge as jointly estimating dense geometry and…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Adrian Hayler , Felix Wimbauer , Dominik Muhle , Christian Rupprecht , Daniel Cremers

We address the task of 3D semantic scene completion, i.e. , given a single depth image, we predict the semantic labels and occupancy of voxels in a 3D grid representing the scene. In light of the recently introduced generative adversarial…

Computer Vision and Pattern Recognition · Computer Science 2019-05-16 Yueh-Tung Chen , Martin Garbade , Juergen Gall

Semantic scene completion (SSC) is a challenging Computer Vision task with many practical applications, from robotics to assistive computing. Its goal is to infer the 3D geometry in a field of view of a scene and the semantic labels of…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Aloisio Dourado , Frederico Guth , Teofilo de Campos

Semantic scene completion is the task of jointly estimating 3D geometry and semantics of objects and surfaces within a given extent. This is a particularly challenging task on real-world data that is sparse and occluded. We propose a scene…

Computer Vision and Pattern Recognition · Computer Science 2021-04-14 Christoph B. Rist , David Emmerichs , Markus Enzweiler , Dariu M. Gavrila

We introduce SLCF-Net, a novel approach for the Semantic Scene Completion (SSC) task that sequentially fuses LiDAR and camera data. It jointly estimates missing geometry and semantics in a scene from sequences of RGB images and sparse LiDAR…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Helin Cao , Sven Behnke

We introduce a new approach for multiscale 3Dsemantic scene completion from voxelized sparse 3D LiDAR scans. As opposed to the literature, we use a 2D UNet backbone with comprehensive multiscale skip connections to enhance feature flow,…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Luis Roldão , Raoul de Charette , Anne Verroust-Blondet

As a voxel-wise labeling task, semantic scene completion (SSC) tries to simultaneously infer the occupancy and semantic labels for a scene from a single depth and/or RGB image. The key challenge for SSC is how to effectively take advantage…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Jie Li , Kai Han , Peng Wang , Yu Liu , Xia Yuan

Camera-based 3D semantic scene completion (SSC) plays a crucial role in autonomous driving, enabling voxelized 3D scene understanding for effective scene perception and decision-making. Existing SSC methods have shown efficacy in improving…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Zhiwen Yang , Yuxin Peng

We introduce Spatial Group Convolution (SGC) for accelerating the computation of 3D dense prediction tasks. SGC is orthogonal to group convolution, which works on spatial dimensions rather than feature channel dimension. It divides input…

Computer Vision and Pattern Recognition · Computer Science 2019-07-12 Jiahui Zhang , Hao Zhao , Anbang Yao , Yurong Chen , Li Zhang , Hongen Liao

We propose a novel approach for 3D shape completion by synthesizing multi-view depth maps. While previous work for shape completion relies on volumetric representations, meshes, or point clouds, we propose to use multi-view depth maps from…

Computer Vision and Pattern Recognition · Computer Science 2019-09-24 Tao Hu , Zhizhong Han , Abhinav Shrivastava , Matthias Zwicker

Camera-based 3D Semantic Scene Completion (SSC) is a critical task for autonomous driving and robotic scene understanding. It aims to infer a complete 3D volumetric representation of both semantics and geometry from a single image. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Zaidao Han , Risa Higashita , Jiang Liu

This paper tackles the problem of data fusion in the semantic scene completion (SSC) task, which can simultaneously deal with semantic labeling and scene completion. RGB images contain texture details of the object(s) which are vital for…

Computer Vision and Pattern Recognition · Computer Science 2020-02-19 Yu Liu , Jie Li , Qingsen Yan , Xia Yuan , Chunxia Zhao , Ian Reid , Cesar Cadena

Holistic scene understanding is pivotal for the performance of autonomous machines. In this paper we propose a new end-to-end model for performing semantic segmentation and depth completion jointly. The vast majority of recent approaches…

Computer Vision and Pattern Recognition · Computer Science 2024-03-07 Juan Pablo Lagos , Esa Rahtu

We propose a method to reconstruct, complete and semantically label a 3D scene from a single input depth image. We improve the accuracy of the regressed semantic 3D maps by a novel architecture based on adversarial learning. In particular,…

Computer Vision and Pattern Recognition · Computer Science 2022-05-10 Yida Wang , David Joseph Tan , Nassir Navab , Federico Tombari

3D Semantic Scene Completion (SSC) provides comprehensive scene geometry and semantics for autonomous driving perception, which is crucial for enabling accurate and reliable decision-making. However, existing SSC methods are limited to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Meng Wang , Fan Wu , Ruihui Li , Yunchuan Qin , Zhuo Tang , Kenli Li

Real-time scene reconstruction from depth data inevitably suffers from occlusion, thus leading to incomplete 3D models. Partial reconstructions, in turn, limit the performance of algorithms that leverage them for applications in the context…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Shun-Cheng Wu , Keisuke Tateno , Nassir Navab , Federico Tombari

Semantic Scene Completion (SSC) aims to jointly estimate the complete geometry and semantics of a scene, assuming partial sparse input. In the last years following the multiplication of large-scale 3D datasets, SSC has gained significant…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Luis Roldao , Raoul de Charette , Anne Verroust-Blondet

The vision-based semantic scene completion task aims to predict dense geometric and semantic 3D scene representations from 2D images. However, the presence of dynamic objects in the scene seriously affects the accuracy of the model…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Meng Wang , Fan Wu , Yunchuan Qin , Ruihui Li , Zhuo Tang , Kenli Li