English
Related papers

Related papers: Deep Interpretable Non-Rigid Structure from Motion

200 papers

Much progress has been made in the supervised learning of 3D reconstruction of rigid objects from multi-view images or a video. However, it is more challenging to reconstruct severely deformed objects from a single-view RGB image in an…

Computer Vision and Pattern Recognition · Computer Science 2022-01-25 Jie Mei , Jingxi Yu , Suzanne Romain , Craig Rose , Kelsey Magrane , Graeme LeeSon , Jenq-Neng Hwang

We propose MHR-Net, a novel method for recovering Non-Rigid Shapes from Motion (NRSfM). MHR-Net aims to find a set of reasonable reconstructions for a 2D view, and it also selects the most likely reconstruction from the set. To deal with…

Computer Vision and Pattern Recognition · Computer Science 2023-01-13 Haitian Zeng , Xin Yu , Jiaxu Miao , Yi Yang

Even though Non-rigid Structure-from-Motion (NRSfM) has been extensively studied and great progress has been made, there are still key challenges that hinder their broad real-world applications: 1) the inherent motion/rotation ambiguity…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Jiawei Shi , Hui Deng , Yuchao Dai

In this paper, we study the problem of 3D scene geometry decomposition and manipulation from 2D views. By leveraging the recent implicit neural representation techniques, particularly the appealing neural radiance fields, we introduce an…

Computer Vision and Pattern Recognition · Computer Science 2023-03-13 Bing Wang , Lu Chen , Bo Yang

Non-Rigid Structure-from-Motion (NRSfM) reconstructs a deformable 3D object from the correspondences established between monocular 2D images. Current NRSfM methods lack statistical robustness, which is the ability to cope with…

Computer Vision and Pattern Recognition · Computer Science 2021-06-03 Shaifali Parashar , Adrien Bartoli , Daniel Pizarro

Image-based 3D reconstruction is one of the most important tasks in Computer Vision with many solutions proposed over the last few decades. The objective is to extract metric information i.e. the geometry of scene objects directly from…

Computer Vision and Pattern Recognition · Computer Science 2022-09-16 Qiao Chen , Charalambos Poullis

Non-rigid structure-from-motion (NRSfM) has so far been mostly studied for recovering 3D structure of a single non-rigid/deforming object. To handle the real world challenging multiple deforming objects scenarios, existing methods either…

Computer Vision and Pattern Recognition · Computer Science 2017-05-16 Suryansh Kumar , Yuchao Dai , Hongdong Li

Recovery of articulated 3D structure from 2D observations is a challenging computer vision problem with many applications. Current learning-based approaches achieve state-of-the-art accuracy on public benchmarks but are restricted to…

Computer Vision and Pattern Recognition · Computer Science 2019-11-13 Onorina Kovalenko , Vladislav Golyanik , Jameel Malik , Ahmed Elhayek , Didier Stricker

We introduce a novel, data-driven approach for reconstructing temporally coherent 3D motion from unstructured and potentially partial observations of non-rigidly deforming shapes. Our goal is to achieve high-fidelity motion reconstructions…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Aymen Merrouche , Stefanie Wuhrer , Edmond Boyer

Recovering structure and motion parameters given a image pair or a sequence of images is a well studied problem in computer vision. This is often achieved by employing Structure from Motion (SfM) or Simultaneous Localization and Mapping…

Computer Vision and Pattern Recognition · Computer Science 2018-11-07 Thanuja Dharmasiri , Andrew Spek , Tom Drummond

Recovering the 3D shape of transparent objects using a small number of unconstrained natural images is an ill-posed problem. Complex light paths induced by refraction and reflection have prevented both traditional and deep multiview stereo…

Computer Vision and Pattern Recognition · Computer Science 2020-07-24 Zhengqin Li , Yu-Ying Yeh , Manmohan Chandraker

Inspired by the recent success of methods that employ shape priors to achieve robust 3D reconstructions, we propose a novel recurrent neural network architecture that we call the 3D Recurrent Reconstruction Neural Network (3D-R2N2). The…

Computer Vision and Pattern Recognition · Computer Science 2016-04-05 Christopher B. Choy , Danfei Xu , JunYoung Gwak , Kevin Chen , Silvio Savarese

We introduce a novel learning-based method to reconstruct the high-quality geometry and complex, spatially-varying BRDF of an arbitrary object from a sparse set of only six images captured by wide-baseline cameras under collocated point…

Computer Vision and Pattern Recognition · Computer Science 2020-07-07 Sai Bi , Zexiang Xu , Kalyan Sunkavalli , David Kriegman , Ravi Ramamoorthi

We present a new method for 3D shape reconstruction from a single image, in which a deep neural network directly maps an image to a vector of network weights. The network \textcolor{black}{parametrized by} these weights represents a 3D…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Gidi Littwin , Lior Wolf

Neural implicit functions have achieved impressive results for reconstructing 3D shapes from single images. However, the image features for describing 3D point samplings of implicit functions are less effective when significant variations…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Yixin Zhuang , Yunzhe Liu , Yujie Wang , Baoquan Chen

Neural Radiance Fields (NeRF) and 3D Gaussian Splatting (3DGS) have emerged as powerful tools for 3D reconstruction and SLAM tasks. However, their performance depends heavily on accurate camera pose priors. Existing approaches attempt to…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Qingsong Yan , Qiang Wang , Kaiyong Zhao , Jie Chen , Bo Li , Xiaowen Chu , Fei Deng

Active-stereo-based 3D shape measurement is crucial for various purposes, such as industrial inspection, reverse engineering, and medical systems, due to its strong ability to accurately acquire the shape of textureless objects. Active…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Ryo Furukawa , Kota Nishihara , Hiroshi Kawasaki

Recently, the reconstruction of high-fidelity 3D head models from static portrait image has made great progress. However, most methods require multi-view or multi-illumination information, which therefore put forward high requirements for…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Xueying Wang , Juyong Zhang

In this work, we present a new method for 3D face reconstruction from sparse-view RGB images. Unlike previous methods which are built upon 3D morphable models (3DMMs) with limited details, we leverage an implicit representation to encode…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Moran Li , Haibin Huang , Yi Zheng , Mengtian Li , Nong Sang , Chongyang Ma

We present a novel convolutional neural network architecture for photometric stereo (Woodham, 1980), a problem of recovering 3D object surface normals from multiple images observed under varying illuminations. Despite its long history in…

Computer Vision and Pattern Recognition · Computer Science 2018-05-30 Tatsunori Taniai , Takanori Maehara