English
Related papers

Related papers: DynamicSurf: Dynamic Neural RGB-D Surface Reconstr…

200 papers

In this work, we present a new method for 3D face reconstruction from sparse-view RGB images. Unlike previous methods which are built upon 3D morphable models (3DMMs) with limited details, we leverage an implicit representation to encode…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Moran Li , Haibin Huang , Yi Zheng , Mengtian Li , Nong Sang , Chongyang Ma

Recent years have witnessed significant progress in the field of neural surface reconstruction. While the extensive focus was put on volumetric and implicit approaches, a number of works have shown that explicit graphics primitives such as…

Computer Vision and Pattern Recognition · Computer Science 2023-04-07 Sergey Prokudin , Qianli Ma , Maxime Raafat , Julien Valentin , Siyu Tang

In recent years, neural implicit surface reconstruction methods have become popular for multi-view 3D reconstruction. In contrast to traditional multi-view stereo methods, these approaches tend to produce smoother and more complete…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Zehao Yu , Songyou Peng , Michael Niemeyer , Torsten Sattler , Andreas Geiger

Recovery of an underlying scene geometry from multiview images stands as a long-time challenge in computer vision research. The recent promise leverages neural implicit surface learning and differentiable volume rendering, and achieves both…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Zhihao Liang , Zhangjin Huang , Changxing Ding , Kui Jia

We present Hybrid-CSR, a geometric deep-learning model that combines explicit and implicit shape representations for cortical surface reconstruction. Specifically, Hybrid-CSR begins with explicit deformations of template meshes to obtain…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Shanlin Sun , Thanh-Tung Le , Chenyu You , Hao Tang , Kun Han , Haoyu Ma , Deying Kong , Xiangyi Yan , Xiaohui Xie

This paper presents a novel approach 4DRecons that takes a single camera RGB-D sequence of a dynamic subject as input and outputs a complete textured deforming 3D model over time. 4DRecons encodes the output as a 4D neural implicit surface…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Xiaoyan Cong , Haitao Yang , Liyan Chen , Kaifeng Zhang , Li Yi , Chandrajit Bajaj , Qixing Huang

Neural implicit surfaces have become an important technique for multi-view 3D reconstruction but their accuracy remains limited. In this paper, we argue that this comes from the difficulty to learn and render high frequency textures with…

Computer Vision and Pattern Recognition · Computer Science 2022-05-10 François Darmon , Bénédicte Bascle , Jean-Clément Devaux , Pascal Monasse , Mathieu Aubry

Recent progress in human shape learning, shows that neural implicit models are effective in generating 3D human surfaces from limited number of views, and even from a single RGB image. However, existing monocular approaches still struggle…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Marco Pesavento , Yuanlu Xu , Nikolaos Sarafianos , Robert Maier , Ziyan Wang , Chun-Han Yao , Marco Volino , Edmond Boyer , Adrian Hilton , Tony Tung

Monocular depth reconstruction of complex and dynamic scenes is a highly challenging problem. While for rigid scenes learning-based methods have been offering promising results even in unsupervised cases, there exists little to no…

Computer Vision and Pattern Recognition · Computer Science 2021-10-29 Ayça Takmaz , Danda Pani Paudel , Thomas Probst , Ajad Chhatkuli , Martin R. Oswald , Luc Van Gool

Recently, methods for neural surface representation and rendering, for example NeuS, have shown that learning neural implicit surfaces through volume rendering is becoming increasingly popular and making good progress. However, these…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Hanqi Jiang , Cheng Zeng , Runnan Chen , Shuai Liang , Yinhe Han , Yichao Gao , Conglin Wang

We propose a fast and accurate surface reconstruction algorithm for unorganized point clouds using an implicit representation. Recent learning methods are either single-object representations with small neural models that allow for high…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Siddhant Ranade , Gonçalo Dias Pais , Ross Tyler Whitaker , Jacinto C. Nascimento , Pedro Miraldo , Srikumar Ramalingam

We present a novel framework named NeuralRecon for real-time 3D scene reconstruction from a monocular video. Unlike previous methods that estimate single-view depth maps separately on each key-frame and fuse them later, we propose to…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Jiaming Sun , Yiming Xie , Linghao Chen , Xiaowei Zhou , Hujun Bao

Applying data-driven approaches to non-rigid 3D reconstruction has been difficult, which we believe can be attributed to the lack of a large-scale training corpus. Unfortunately, this method fails for important cases such as highly…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Aljaž Božič , Michael Zollhöfer , Christian Theobalt , Matthias Nießner

Neural implicit surface reconstruction using volume rendering techniques has recently achieved significant advancements in creating high-fidelity surfaces from multiple 2D images. However, current methods primarily target scenes with…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Lintao Xiang , Hongpei Zheng , Bailin Deng , Hujun Yin

Obtaining high-quality 3D reconstructions of room-scale scenes is of paramount importance for upcoming applications in AR or VR. These range from mixed reality applications for teleconferencing, virtual measuring, virtual room planing, to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Dejan Azinović , Ricardo Martin-Brualla , Dan B Goldman , Matthias Nießner , Justus Thies

Structural coloration is commonly modeled using wave optics for reliable and photorealistic rendering of natural, quasi-periodic and complex nanostructures. Such models often rely on dense, preliminary or preprocessed data to accurately…

Graphics · Computer Science 2025-07-03 Narayan Kandel , Daljit Singh J. S. Dhillon

A long-standing goal in scene understanding is to obtain interpretable and editable representations that can be directly constructed from a raw monocular RGB-D video, without requiring specialized hardware setup or priors. The problem is…

Computer Vision and Pattern Recognition · Computer Science 2023-06-22 Yu-Shiang Wong , Niloy J. Mitra

Three-dimensional (3D) object reconstruction based on differentiable rendering (DR) is an active research topic in computer vision. DR-based methods minimize the difference between the rendered and target images by optimizing both the shape…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Chunyu Li , Taisuke Hashimoto , Eiichi Matsumoto , Hiroharu Kato

Neural scene representations, such as Neural Radiance Fields (NeRF), are based on training a multilayer perceptron (MLP) using a set of color images with known poses. An increasing number of devices now produce RGB-D(color + depth)…

Computer Vision and Pattern Recognition · Computer Science 2022-11-08 Arnab Dey , Yassine Ahmine , Andrew I. Comport

Recent advances in 3D deep learning have shown that it is possible to train highly effective deep models for 3D shape generation, directly from 2D images. This is particularly interesting since the availability of 3D models is still limited…

Computer Vision and Pattern Recognition · Computer Science 2019-11-05 Shichen Liu , Shunsuke Saito , Weikai Chen , Hao Li