English
Related papers

Related papers: SPHERE: Semantic-PHysical Engaged REpresentation f…

200 papers

We revisit Semantic Scene Completion (SSC), a useful task to predict the semantic and occupancy representation of 3D scenes, in this paper. A number of methods for this task are always based on voxelized scene representations for keeping…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Xiaokang Chen , Jiaxiang Tang , Jingbo Wang , Gang Zeng

The vision-based semantic scene completion task aims to predict dense geometric and semantic 3D scene representations from 2D images. However, the presence of dynamic objects in the scene seriously affects the accuracy of the model…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Meng Wang , Fan Wu , Yunchuan Qin , Ruihui Li , Zhuo Tang , Kenli Li

We present \emph{GaussianSSC}, a two-stage, grid-native and triplane-guided approach to semantic scene completion (SSC) that injects the benefits of Gaussians without replacing the voxel grid or maintaining a separate Gaussian set. We…

Robotics · Computer Science 2026-03-24 Ruiqi Xian , Jing Liang , He Yin , Xuewei Qi , Dinesh Manocha

Semantic scene completion (SSC) is a challenging Computer Vision task with many practical applications, from robotics to assistive computing. Its goal is to infer the 3D geometry in a field of view of a scene and the semantic labels of…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Aloisio Dourado , Frederico Guth , Teofilo de Campos

Current vision-language models may grasp basic spatial cues and simple directions (e.g. left, right, front, back), but struggle with the multi-dimensional spatial reasoning necessary for human-like understanding and real-world applications.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Wenyu Zhang , Wei En Ng , Lixin Ma , Yuwen Wang , Junqi Zhao , Allison Koenecke , Boyang Li , Lu Wang

Semantic scene completion (SSC) is essential for achieving comprehensive perception in autonomous driving systems. However, existing SSC methods often overlook the high deployment costs in real-world applications. Traditional architectures,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Yansong Qu , Zixuan Xu , Zilin Huang , Zihao Sheng , Tiantian Chen , Sikai Chen

Monocular Semantic Scene Completion (SSC) aims to reconstruct complete 3D semantic scenes from a single RGB image, offering a cost-effective solution for autonomous driving and robotics. However, the inherently imbalanced nature of voxel…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Yu Xue , Longjun Gao , Yuanqi Su , HaoAng Lu , Xiaoning Zhang

`3D Semantic Scene Completion (SSC) has emerged as a nascent and pivotal undertaking in autonomous driving, aiming to predict voxel occupancy within volumetric scenes. However, prevailing methodologies primarily focus on voxel-wise feature…

Computer Vision and Pattern Recognition · Computer Science 2023-11-23 Haoyi Jiang , Tianheng Cheng , Naiyu Gao , Haoyang Zhang , Tianwei Lin , Wenyu Liu , Xinggang Wang

Semantic Scene Completion aims at reconstructing a complete 3D scene with precise voxel-wise semantics from a single-view depth or RGBD image. It is a crucial but challenging problem for indoor scene understanding. In this work, we present…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Yingjie Cai , Xuesong Chen , Chao Zhang , Kwan-Yee Lin , Xiaogang Wang , Hongsheng Li

We present \emph{SPHEAR}, an accurate, differentiable parametric statistical 3D human head model, enabled by a novel 3D registration method based on spherical embeddings. We shift the paradigm away from the classical Non-Rigid Registration…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Eduard Gabriel Bazavan , Andrei Zanfir , Thiemo Alldieck , Teodor Alexandru Szente , Mihai Zanfir , Cristian Sminchisescu

Camera-based 3D semantic scene completion (SSC) provides dense geometric and semantic perception for autonomous driving. However, images provide limited information making the model susceptible to geometric ambiguity caused by occlusion and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Meng Wang , Huilong Pi , Ruihui Li , Yunchuan Qin , Zhuo Tang , Kenli Li

Semantic Scene Completion (SSC) aims to jointly generate space occupancies and semantic labels for complex 3D scenes. Most existing SSC models focus on volumetric representations, which are memory-inefficient for large outdoor spaces. Point…

Computer Vision and Pattern Recognition · Computer Science 2024-03-08 Yuxiang Yan , Boda Liu , Jianfei Ai , Qinbu Li , Ru Wan , Jian Pu

Camera-based 3D semantic scene completion (SSC) offers a cost-effective solution for assessing the geometric occupancy and semantic labels of each voxel in the surrounding 3D scene with image inputs, providing a voxel-level scene perception…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Zhiwen Yang , Yuxin Peng

Outdoor scene completion is a challenging issue in 3D scene understanding, which plays an important role in intelligent robotics and autonomous driving. Due to the sparsity of LiDAR acquisition, it is far more complex for 3D scene…

Computer Vision and Pattern Recognition · Computer Science 2021-09-24 Xuemeng Yang , Hao Zou , Xin Kong , Tianxin Huang , Yong Liu , Wanlong Li , Feng Wen , Hongbo Zhang

Semantic Scene Completion (SSC) is essential for 3D perception in mobile robotics, as it enables holistic scene understanding by jointly estimating dense volumetric occupancy and per-voxel semantics. Although SSC has been widely studied in…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Markus Gross , Sai B. Matha , Aya Fahmy , Rui Song , Daniel Cremers , Henri Meess

Semantic Scene Completion (SSC) aims to infer complete 3D geometry and semantics from monocular images, serving as a crucial capability for camera-based perception in autonomous driving. However, existing SSC methods relying on temporal…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Jinzhou Lin , Jie Zhou , Wenhao Xu , Rongtao Xu , Changwei Wang , Shunpeng Chen , Kexue Fu , Yihua Shao , Li Guo , Shibiao Xu

Open-vocabulary 3D scene understanding presents a significant challenge in computer vision, with wide-ranging applications in embodied agents and augmented reality systems. Existing methods adopt neurel rendering methods as 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-08-26 Jun Guo , Xiaojian Ma , Yue Fan , Huaping Liu , Qing Li

Semantic Scene Completion (SSC) aims to simultaneously predict the volumetric occupancy and semantic category of a 3D scene. It helps intelligent devices to understand and interact with the surrounding scenes. Due to the high-memory…

Computer Vision and Pattern Recognition · Computer Science 2019-08-02 Pingping Zhang , Wei Liu , Yinjie Lei , Huchuan Lu , Xiaoyun Yang

Vision-based 3D Semantic Scene Completion (SSC) has received growing attention due to its potential in autonomous driving. While most existing approaches follow an ego-centric paradigm by aggregating and diffusing features over the entire…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Weihua Wang , Yubo Cui , Xiangru Lin , Zhiheng Li , Zheng Fang

Recently, camera-based solutions have been extensively explored for scene semantic completion (SSC). Despite their success in visible areas, existing methods struggle to capture complete scene semantics due to frequent visual occlusions. To…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Xiyue Guo , Jiarui Hu , Junjie Hu , Hujun Bao , Guofeng Zhang