English
Related papers

Related papers: Semantic Scene Completion Combining Colour and Dep…

200 papers

Semantic scene completion, also known as semantic occupancy prediction, can provide dense geometric and semantic information for autonomous vehicles, which attracts the increasing attention of both academia and industry. Unfortunately,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Song Wang , Jiawei Yu , Wentong Li , Wenyu Liu , Xiaolu Liu , Junbo Chen , Jianke Zhu

We study a new problem of semantic complete scene forecasting (SCSF) in this work. Given a 4D dynamic point cloud sequence, our goal is to forecast the complete scene corresponding to the future next frame along with its semantic labels. To…

Computer Vision and Pattern Recognition · Computer Science 2023-12-18 Zifan Wang , Zhuorui Ye , Haoran Wu , Junyu Chen , Li Yi

In recent years, visual 3D Semantic Scene Completion (SSC) has emerged as a critical perception task for autonomous driving due to its ability to infer complete 3D scene layouts and semantics from single 2D images. However, in real-world…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 Haoang Lu , Yuanqi Su , Xiaoning Zhang , Hao Hu

Camera-based 3D semantic scene completion (SSC) provides dense geometric and semantic perception for autonomous driving. However, images provide limited information making the model susceptible to geometric ambiguity caused by occlusion and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Meng Wang , Huilong Pi , Ruihui Li , Yunchuan Qin , Zhuo Tang , Kenli Li

Most deep learning approaches to comprehensive semantic modeling of 3D indoor spaces require costly dense annotations in the 3D domain. In this work, we explore a central 3D scene modeling task, namely, semantic scene reconstruction without…

Computer Vision and Pattern Recognition · Computer Science 2024-06-06 Junwen Huang , Alexey Artemov , Yujin Chen , Shuaifeng Zhi , Kai Xu , Matthias Nießner

MonoScene proposes a 3D Semantic Scene Completion (SSC) framework, where the dense geometry and semantics of a scene are inferred from a single monocular RGB image. Different from the SSC literature, relying on 2.5 or 3D input, we solve the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Anh-Quan Cao , Raoul de Charette

As a voxel-wise labeling task, semantic scene completion (SSC) tries to simultaneously infer the occupancy and semantic labels for a scene from a single depth and/or RGB image. The key challenge for SSC is how to effectively take advantage…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Jie Li , Kai Han , Peng Wang , Yu Liu , Xia Yuan

We present a deep reinforcement learning method of progressive view inpainting for colored semantic point cloud scene completion under volume guidance, achieving high-quality scene reconstruction from only a single RGB-D image with severe…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Zhaoxuan Zhang , Xiaoguang Han , Bo Dong , Tong Li , Baocai Yin , Xin Yang

Outdoor scene completion is a challenging issue in 3D scene understanding, which plays an important role in intelligent robotics and autonomous driving. Due to the sparsity of LiDAR acquisition, it is far more complex for 3D scene…

Computer Vision and Pattern Recognition · Computer Science 2021-09-24 Xuemeng Yang , Hao Zou , Xin Kong , Tianxin Huang , Yong Liu , Wanlong Li , Feng Wen , Hongbo Zhang

Monocular Semantic Scene Completion (SSC) aims to reconstruct complete 3D semantic scenes from a single RGB image, offering a cost-effective solution for autonomous driving and robotics. However, the inherently imbalanced nature of voxel…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Yu Xue , Longjun Gao , Yuanqi Su , HaoAng Lu , Xiaoning Zhang

Semantic scene completion (SSC) aims to predict complete 3D voxel occupancy and semantics from a single-view RGB-D image, and recent SSC methods commonly adopt multi-modal inputs. However, our investigation reveals two limitations:…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Fengyun Wang , Qianru Sun , Dong Zhang , Jinhui Tang

Semantic scene completion (SSC) jointly predicts the semantics and geometry of the entire 3D scene, which plays an essential role in 3D scene understanding for autonomous driving systems. SSC has achieved rapid progress with the help of…

Computer Vision and Pattern Recognition · Computer Science 2023-06-28 Jianbiao Mei , Yu Yang , Mengmeng Wang , Tianxin Huang , Xuemeng Yang , Yong Liu

This work studies Semantic Scene Completion which aims to predict a 3D semantic segmentation of our surroundings, even though some areas are occluded. For this we construct a Bayesian Convolutional Neural Network (BCNN), which is not only…

Computer Vision and Pattern Recognition · Computer Science 2020-10-19 David Gillsjö , Kalle Åström

Vision-based Semantic Scene Completion (SSC) has gained much attention due to its widespread applications in various 3D perception tasks. Existing sparse-to-dense approaches typically employ shared context-independent queries across various…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Zhu Yu , Runmin Zhang , Jiacheng Ying , Junchen Yu , Xiaohai Hu , Lun Luo , Si-Yuan Cao , Hui-Liang Shen

3D semantic scene graphs are a powerful holistic representation as they describe the individual objects and depict the relation between them. They are compact high-level graphs that enable many tasks requiring scene reasoning. In real-world…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Shun-Cheng Wu , Keisuke Tateno , Nassir Navab , Federico Tombari

Semantic scene completion aims to infer the 3D geometric structures with semantic classes from camera or LiDAR, which provide essential occupancy information in autonomous driving. Prior endeavors concentrate on constructing the network or…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Song Wang , Jiawei Yu , Wentong Li , Hao Shi , Kailun Yang , Junbo Chen , Jianke Zhu

Camera-based 3D Semantic Scene Completion (SSC) is a critical task in autonomous driving systems, assessing voxel-level geometry and semantics for holistic scene perception. While existing voxel-based and plane-based SSC methods have…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Zhiwen Yang , Yuxin Peng

3D Semantic Scene Completion (SSC) can provide dense geometric and semantic scene representations, which can be applied in the field of autonomous driving and robotic systems. It is challenging to estimate the complete geometry and…

Computer Vision and Pattern Recognition · Computer Science 2023-02-28 Ruihang Miao , Weizhou Liu , Mingrui Chen , Zheng Gong , Weixin Xu , Chen Hu , Shuchang Zhou

3D semantic scene completion (SSC) is an ill-posed perception task that requires inferring a dense 3D scene from limited observations. Previous camera-based methods struggle to predict accurate semantic scenes due to inherent geometric…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Bohan Li , Yasheng Sun , Zhujin Liang , Dalong Du , Zhuanghui Zhang , Xiaofeng Wang , Yunnan Wang , Xin Jin , Wenjun Zeng

We tackle a new problem of semantic view synthesis -- generating free-viewpoint rendering of a synthesized scene using a semantic label map as input. We build upon recent advances in semantic image synthesis and view synthesis for handling…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Hsin-Ping Huang , Hung-Yu Tseng , Hsin-Ying Lee , Jia-Bin Huang