English
Related papers

Related papers: Exploiting Semantic Scene Reconstruction for Estim…

200 papers

Reconstruction of indoor surfaces with limited texture information or with repeated textures, a situation common in walls and ceilings, may be difficult with a monocular Structure from Motion system. We propose a Semantic Room Wireframe…

Computer Vision and Pattern Recognition · Computer Science 2022-06-02 David Gillsjö , Gabrielle Flood , Kalle Åström

We present FlowNet3D++, a deep scene flow estimation network. Inspired by classical methods, FlowNet3D++ incorporates geometric constraints in the form of point-to-plane distance and angular alignment between individual vectors in the flow…

Computer Vision and Pattern Recognition · Computer Science 2021-04-27 Zirui Wang , Shuda Li , Henry Howard-Jenkins , Victor Adrian Prisacariu , Min Chen

In addition to color and textural information, geometry provides important cues for 3D scene reconstruction. However, current reconstruction methods only include geometry at the feature level thus not fully exploiting the geometric…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Ruihong Yin , Sezer Karaoglu , Theo Gevers

In this paper, we propose a geometric neural network with edge-aware refinement (GeoNet++) to jointly predict both depth and surface normal maps from a single image. Building on top of two-stream CNNs, GeoNet++ captures the geometric…

Computer Vision and Pattern Recognition · Computer Science 2020-12-15 Xiaojuan Qi , Zhengzhe Liu , Renjie Liao , Philip H. S. Torr , Raquel Urtasun , Jiaya Jia

This paper addresses the challenge of reconstructing 3D indoor scenes from multi-view images. Many previous works have shown impressive reconstruction results on textured objects, but they still have difficulty in handling low-textured…

Computer Vision and Pattern Recognition · Computer Science 2022-05-19 Haoyu Guo , Sida Peng , Haotong Lin , Qianqian Wang , Guofeng Zhang , Hujun Bao , Xiaowei Zhou

Renovating existing buildings is essential for climate impact. Early-phase renovation planning requires simulations based on thermal 3D models at Level of Detail (LoD) 3, which include features like windows. However, scalable and accurate…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Yinan Yu , Alex Gonzalez-Caceres , Samuel Scheidegger , Sanjay Somanath , Alexander Hollberg

Obtaining high-quality 3D reconstructions of room-scale scenes is of paramount importance for upcoming applications in AR or VR. These range from mixed reality applications for teleconferencing, virtual measuring, virtual room planing, to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Dejan Azinović , Ricardo Martin-Brualla , Dan B Goldman , Matthias Nießner , Justus Thies

Online reconstructing and rendering of large-scale indoor scenes is a long-standing challenge. SLAM-based methods can reconstruct 3D scene geometry progressively in real time but can not render photorealistic results. While NeRF-based…

Computer Vision and Pattern Recognition · Computer Science 2023-04-19 Yiming Gao , Yan-Pei Cao , Ying Shan

Recent progress in neural implicit functions has set new state-of-the-art in reconstructing high-fidelity 3D shapes from a collection of images. However, these approaches are limited to closed surfaces as they require the surface to be…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Xiaoxu Meng , Weikai Chen , Bo Yang

3D geometry is a very informative cue when interacting with and navigating an environment. This writing proposes a new approach to 3D reconstruction and scene understanding, which implicitly learns 3D geometry from depth maps pairing a deep…

Computer Vision and Pattern Recognition · Computer Science 2018-08-22 Dario Rethage , Federico Tombari , Felix Achilles , Nassir Navab

The precise reconstruction of 3D objects from a single RGB image in complex scenes presents a critical challenge in virtual reality, autonomous driving, and robotics. Existing neural implicit 3D representation methods face significant…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Luoxi Zhang , Pragyan Shrestha , Yu Zhou , Chun Xie , Itaru Kitahara

In the field of computer vision, the numerical encoding of 3D surfaces is crucial. It is classical to represent surfaces with their Signed Distance Functions (SDFs) or Unsigned Distance Functions (UDFs). For tasks like representation…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Virgile Foy , Fabrice Gamboa , Reda Chhaibi

Semantic Scene Completion aims at reconstructing a complete 3D scene with precise voxel-wise semantics from a single-view depth or RGBD image. It is a crucial but challenging problem for indoor scene understanding. In this work, we present…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Yingjie Cai , Xuesong Chen , Chao Zhang , Kwan-Yee Lin , Xiaogang Wang , Hongsheng Li

We represent the ResNeRF, a novel geometry-guided two-stage framework for indoor scene novel view synthesis. Be aware of that a good geometry would greatly boost the performance of novel view synthesis, and to avoid the geometry ambiguity…

Computer Vision and Pattern Recognition · Computer Science 2023-07-12 Yuting Xiao , Yiqun Zhao , Yanyu Xu , Shenghua Gao

3D semantic segmentation plays a fundamental and crucial role to understand 3D scenes. While contemporary state-of-the-art techniques predominantly concentrate on elevating the overall performance of 3D semantic segmentation based on…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Weiguang Zhao , Rui Zhang , Qiufeng Wang , Guangliang Cheng , Kaizhu Huang

We present a novel neural surface reconstruction method called NeuralRoom for reconstructing room-sized indoor scenes directly from a set of 2D images. Recently, implicit neural representations have become a promising way to reconstruct…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Yusen Wang , Zongcheng Li , Yu Jiang , Kaixuan Zhou , Tuo Cao , Yanping Fu , Chunxia Xiao

In crowded urban environments where traffic is dense, current technologies struggle to oversee tight navigation, but surface-level understanding allows autonomous vehicles to safely assess proximity to surrounding obstacles. 3D or 2D scene…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Akarshani Ramanayake , Nihal Kodikara

The ultimate goal of this indoor mapping research is to automatically reconstruct a floorplan simply by walking through a house with a smartphone in a pocket. This paper tackles this problem by proposing FloorNet, a novel deep neural…

Computer Vision and Pattern Recognition · Computer Science 2018-04-03 Chen Liu , Jiaye Wu , Yasutaka Furukawa

3D reconstruction of large scenes is a challenging problem due to the high-complexity nature of the solution space, in particular for generative neural networks. In contrast to traditional generative learned models which encode the full…

Computer Vision and Pattern Recognition · Computer Science 2021-08-11 Yawar Siddiqui , Justus Thies , Fangchang Ma , Qi Shan , Matthias Nießner , Angela Dai

Automatic 3D reconstruction of indoor spaces from 2D floor plans necessitates high-precision semantic segmentation of structural elements, particularly walls. However, existing methods often struggle with detecting thin structures and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Dmitriy Parashchuk , Alexey Kaspshitskiy , Yuriy Karyakin