English
Related papers

Related papers: Monocular Semantic Scene Completion via Masked Rec…

200 papers

Semantic scene completion (SSC) aims to predict complete 3D voxel occupancy and semantics from a single-view RGB-D image, and recent SSC methods commonly adopt multi-modal inputs. However, our investigation reveals two limitations:…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Fengyun Wang , Qianru Sun , Dong Zhang , Jinhui Tang

Scene segmentation and classification (SSC) serve as a critical step towards the field of video structuring analysis. Intuitively, jointly learning of these two tasks can promote each other by sharing common information. However, scene…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Ye Liu , Lingfeng Qiao , Di Yin , Zhuoxuan Jiang , Xinghua Jiang , Deqiang Jiang , Bo Ren

Monocular depth prediction is an important task in scene understanding. It aims to predict the dense depth of a single RGB image. With the development of deep learning, the performance of this task has made great improvements. However, two…

Computer Vision and Pattern Recognition · Computer Science 2021-04-14 Feng Xue , Junfeng Cao , Yu Zhou , Fei Sheng , Yankai Wang , Anlong Ming

Monocular Indoor Semantic Scene Completion (SSC) aims to reconstruct a 3D semantic occupancy map from a single RGB image of an indoor scene, inferring spatial layout and object categories from 2D image cues. The challenge of this task…

Computer Vision and Pattern Recognition · Computer Science 2025-03-10 Anith Selvakumar , Manasa Bharadwaj

We revisit Semantic Scene Completion (SSC), a useful task to predict the semantic and occupancy representation of 3D scenes, in this paper. A number of methods for this task are always based on voxelized scene representations for keeping…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Xiaokang Chen , Jiaxiang Tang , Jingbo Wang , Gang Zeng

Despite the recent success of deep learning in continuous sign language recognition (CSLR), deep models typically focus on the most discriminative features, ignoring other potentially non-trivial and informative contents. Such…

Computer Vision and Pattern Recognition · Computer Science 2020-02-11 Hao Zhou , Wengang Zhou , Yun Zhou , Houqiang Li

This paper focuses on semantic scene completion, a task for producing a complete 3D voxel representation of volumetric occupancy and semantic labels for a scene from a single-view depth map observation. Previous work has considered scene…

Computer Vision and Pattern Recognition · Computer Science 2016-11-29 Shuran Song , Fisher Yu , Andy Zeng , Angel X. Chang , Manolis Savva , Thomas Funkhouser

Self-attention is of vital importance in semantic segmentation as it enables modeling of long-range context, which translates into improved performance. We argue that it is equally important to model short-range context, especially to…

Computer Vision and Pattern Recognition · Computer Science 2022-12-29 Hasib Zunair , A. Ben Hamza

Semantic Scene Completion (SSC) aims to simultaneously predict the volumetric occupancy and semantic category of a 3D scene. In this paper, we propose a real-time semantic scene completion method with a feature aggregation strategy and…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Xiaokang Chen , Yajie Xing , Gang Zeng

This study introduces an efficacious approach, Masked Collaborative Contrast (MCC), to highlight semantic regions in weakly supervised semantic segmentation. MCC adroitly draws inspiration from masked image modeling and contrastive learning…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Fangwen Wu , Jingxuan He , Yufei Yin , Yanbin Hao , Gang Huang , Lechao Cheng

The goal of the Semantic Scene Completion (SSC) task is to simultaneously predict a completed 3D voxel representation of volumetric occupancy and semantic labels of objects in the scene from a single-view observation. Since the…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Xiaokang Chen , Kwan-Yee Lin , Chen Qian , Gang Zeng , Hongsheng Li

Few-Shot Remote Sensing Scene Classification (FSRSSC) is an important task, which aims to recognize novel scene classes with few examples. Recently, several studies attempt to address the FSRSSC problem by following few-shot natural image…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Baoquan Zhang , Shanshan Feng , Xutao Li , Yunming Ye , Rui Ye

We introduce Spatial Group Convolution (SGC) for accelerating the computation of 3D dense prediction tasks. SGC is orthogonal to group convolution, which works on spatial dimensions rather than feature channel dimension. It divides input…

Computer Vision and Pattern Recognition · Computer Science 2019-07-12 Jiahui Zhang , Hao Zhao , Anbang Yao , Yurong Chen , Li Zhang , Hongen Liao

Semantic Scene Completion (SSC) transforms an image of single-view depth and/or RGB 2D pixels into 3D voxels, each of whose semantic labels are predicted. SSC is a well-known ill-posed problem as the prediction model has to "imagine" what…

Computer Vision and Pattern Recognition · Computer Science 2023-03-20 Fengyun Wang , Dong Zhang , Hanwang Zhang , Jinhui Tang , Qianru Sun

As a pioneering work, PointContrast conducts unsupervised 3D representation learning via leveraging contrastive learning over raw RGB-D frames and proves its effectiveness on various downstream tasks. However, the trend of large-scale…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Xiaoyang Wu , Xin Wen , Xihui Liu , Hengshuang Zhao

3D semantic scene completion (SSC) is an ill-posed perception task that requires inferring a dense 3D scene from limited observations. Previous camera-based methods struggle to predict accurate semantic scenes due to inherent geometric…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Bohan Li , Yasheng Sun , Zhujin Liang , Dalong Du , Zhuanghui Zhang , Xiaofeng Wang , Yunnan Wang , Xin Jin , Wenjun Zeng

3D Semantic Scene Completion (SSC) provides comprehensive scene geometry and semantics for autonomous driving perception, which is crucial for enabling accurate and reliable decision-making. However, existing SSC methods are limited to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Meng Wang , Fan Wu , Ruihui Li , Yunchuan Qin , Zhuo Tang , Kenli Li

Vision-based 3D Semantic Scene Completion (SSC) has received growing attention due to its potential in autonomous driving. While most existing approaches follow an ego-centric paradigm by aggregating and diffusing features over the entire…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Weihua Wang , Yubo Cui , Xiangru Lin , Zhiheng Li , Zheng Fang

Camera-based 3D Semantic Scene Completion (SSC) is a critical task for autonomous driving and robotic scene understanding. It aims to infer a complete 3D volumetric representation of both semantics and geometry from a single image. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Zaidao Han , Risa Higashita , Jiang Liu

The recent success of implicit neural scene representations has presented a viable new method for how we capture and store 3D scenes. Unlike conventional 3D representations, such as point clouds, which explicitly store scene properties in…

Computer Vision and Pattern Recognition · Computer Science 2021-01-19 Amit Kohli , Vincent Sitzmann , Gordon Wetzstein