English
Related papers

Related papers: NeuralNetwork Based 3D Surface Reconstruction

200 papers

Designing a network on 3D surface for non-rigid shape analysis is a challenging task. In this work, we propose a novel spectral transform network on 3D surface to learn shape descriptors. The proposed network architecture consists of four…

Computer Vision and Pattern Recognition · Computer Science 2018-10-23 Ruixuan Yu , Jian Sun , Huibin Li

Reconstructing a 3D surface from colonoscopy video is challenging due to illumination and reflectivity variation in the video frame that can cause defective shape predictions. Aiming to overcome this challenge, we utilize the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Shuxian Wang , Yubo Zhang , Sarah K. McGill , Julian G. Rosenman , Jan-Michael Frahm , Soumyadip Sengupta , Stephen M. Pizer

We present Neural Kernel Fields: a novel method for reconstructing implicit 3D shapes based on a learned kernel ridge regression. Our technique achieves state-of-the-art results when reconstructing 3D objects and large scenes from sparse…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Francis Williams , Zan Gojcic , Sameh Khamis , Denis Zorin , Joan Bruna , Sanja Fidler , Or Litany

Neural surface reconstruction has been shown to be powerful for recovering dense 3D surfaces via image-based neural rendering. However, current methods struggle to recover detailed structures of real-world scenes. To address the issue, we…

Computer Vision and Pattern Recognition · Computer Science 2023-06-14 Zhaoshuo Li , Thomas Müller , Alex Evans , Russell H. Taylor , Mathias Unberath , Ming-Yu Liu , Chen-Hsuan Lin

In this work we present a method to train a plane-aware convolutional neural network for dense depth and surface normal estimation as well as plane boundaries from a single indoor $360^\circ$ image. Using our proposed loss function, our…

Computer Vision and Pattern Recognition · Computer Science 2020-02-25 Marc Eder , Pierre Moulon , Li Guan

This paper introduces a versatile paradigm for integrating multi-view reflectance (optional) and normal maps acquired through photometric stereo. Our approach employs a pixel-wise joint re-parameterization of reflectance and normal,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Baptiste Brument , Robin Bruneau , Yvain Quéau , Jean Mélou , François Bernard Lauze , Jean-Denis , Jean-Denis Durou , Lilian Calvet

Neural Radiance Fields (NeRF) have constituted a remarkable breakthrough in image-based 3D reconstruction. However, their implicit volumetric representations differ significantly from the widely-adopted polygonal meshes and lack support…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Jiaxiang Tang , Hang Zhou , Xiaokang Chen , Tianshu Hu , Errui Ding , Jingdong Wang , Gang Zeng

Recovering the shape and appearance of real-world objects from natural 2D images is a long-standing and challenging inverse rendering problem. In this paper, we introduce a novel hybrid differentiable rendering method to efficiently…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Xiangyang Zhu , Yiling Pan , Bailin Deng , Bin Wang

Traditional 3D shape reconstruction techniques from multi-view images, such as structure from motion and multi-view stereo, face challenges in reconstructing transparent objects. Recent advances in neural radiance fields and its variants…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Haoran Zhang , Junkai Deng , Xuhui Chen , Fei Hou , Wencheng Wang , Hong Qin , Chen Qian , Ying He

Recent learning approaches that implicitly represent surface geometry using coordinate-based neural representations have shown impressive results in the problem of multi-view 3D reconstruction. The effectiveness of these techniques is,…

Computer Vision and Pattern Recognition · Computer Science 2021-07-28 Eduard Ramon , Gil Triginer , Janna Escur , Albert Pumarola , Jaime Garcia , Xavier Giro-i-Nieto , Francesc Moreno-Noguer

Super-resolution reconstruction techniques entail the utilization of software algorithms to transform one or more sets of low-resolution images captured from the same scene into high-resolution images. In recent years, considerable…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Hao Yan , Zixiang Wang , Zhengjia Xu , Zhuoyue Wang , Zhizhong Wu , Ranran Lyu

We present a novel method for reconstructing a 3D implicit surface from a large-scale, sparse, and noisy point cloud. Our approach builds upon the recently introduced Neural Kernel Fields (NKF) representation. It enjoys similar…

Computer Vision and Pattern Recognition · Computer Science 2023-06-12 Jiahui Huang , Zan Gojcic , Matan Atzmon , Or Litany , Sanja Fidler , Francis Williams

Using neural networks to represent 3D objects has become popular. However, many previous works employ neural networks with fixed architecture and size to represent different 3D objects, which lead to excessive network parameters for simple…

Computer Vision and Pattern Recognition · Computer Science 2022-08-05 Yongdong Huang , Yuanzhan Li , Xulong Cao , Siyu Zhang , Shen Cai , Ting Lu , Jie Wang , Yuqi Liu

This paper presents an uncalibrated deep neural network framework for the photometric stereo problem. For training models to solve the problem, existing neural network-based methods either require exact light directions or ground-truth…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Berk Kaya , Suryansh Kumar , Carlos Oliveira , Vittorio Ferrari , Luc Van Gool

Recent neural rendering methods have demonstrated accurate view interpolation by predicting volumetric density and color with a neural network. Although such volumetric representations can be supervised on static and dynamic scenes,…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Julian Knodt , Joe Bartusek , Seung-Hwan Baek , Felix Heide

Recent advances in implicit neural representations and differentiable rendering make it possible to simultaneously recover the geometry and materials of an object from multi-view RGB images captured under unknown static illumination.…

Computer Vision and Pattern Recognition · Computer Science 2022-04-15 Yuanqing Zhang , Jiaming Sun , Xingyi He , Huan Fu , Rongfei Jia , Xiaowei Zhou

With the growing popularity of neural rendering, there has been an increasing number of neural implicit multi-view reconstruction methods. While many models have been enhanced in terms of positional encoding, sampling, rendering, and other…

Computer Vision and Pattern Recognition · Computer Science 2023-05-15 Weikun Zhang , Jianke Zhu

This paper presents Neural Mesh Fusion (NMF), an efficient approach for joint optimization of polygon mesh from multi-view image observations and unsupervised 3D planar-surface parsing of the scene. In contrast to implicit neural…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Farhad G. Zanjani , Hong Cai , Yinhao Zhu , Leyla Mirvakhabova , Fatih Porikli

We propose a Transformer-based framework for 3D human texture estimation from a single image. The proposed Transformer is able to effectively exploit the global information of the input image, overcoming the limitations of existing methods…

Computer Vision and Pattern Recognition · Computer Science 2021-09-07 Xiangyu Xu , Chen Change Loy

Neural 3D scene representations have shown great potential for 3D reconstruction from 2D images. However, reconstructing real-world captures of complex scenes still remains a challenge. Existing generic 3D reconstruction methods often…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Fangjinhua Wang , Marie-Julie Rakotosaona , Michael Niemeyer , Richard Szeliski , Marc Pollefeys , Federico Tombari