English
Related papers

Related papers: LASR: Learning Articulated Shape Reconstruction fr…

200 papers

From a single image, humans are able to perceive the full 3D shape of an object by exploiting learned shape priors from everyday life. Contemporary single-image 3D reconstruction algorithms aim to solve this task in a similar fashion, but…

Computer Vision and Pattern Recognition · Computer Science 2018-12-31 Xiuming Zhang , Zhoutong Zhang , Chengkai Zhang , Joshua B. Tenenbaum , William T. Freeman , Jiajun Wu

We propose an efficient method for non-rigid surface tracking from monocular RGB videos. Given a video and a template mesh, our algorithm sequentially registers the template non-rigidly to each frame. We formulate the per-frame registration…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Marc Habermann , Weipeng Xu , Helge Rhodin , Michael Zollhoefer , Gerard Pons-Moll , Christian Theobalt

This paper describes how to obtain accurate 3D body models and texture of arbitrary people from a single, monocular video in which a person is moving. Based on a parametric body model, we present a robust processing pipeline achieving 3D…

Computer Vision and Pattern Recognition · Computer Science 2018-04-17 Thiemo Alldieck , Marcus Magnor , Weipeng Xu , Christian Theobalt , Gerard Pons-Moll

We present a method for learning a generative 3D model based on neural radiance fields, trained solely from data with only single views of each object. While generating realistic images is no longer a difficult task, producing the…

Computer Vision and Pattern Recognition · Computer Science 2022-04-27 Daniel Rebain , Mark Matthews , Kwang Moo Yi , Dmitry Lagun , Andrea Tagliasacchi

We present a novel method to learn temporally consistent 3D reconstruction of clothed people from a monocular video. Recent methods for 3D human reconstruction from monocular video using volumetric, implicit or parametric human shape…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Akin Caliskan , Armin Mustafa , Adrian Hilton

Monocular image-based 3D reconstruction of faces is a long-standing problem in computer vision. Since image data is a 2D projection of a 3D face, the resulting depth ambiguity makes the problem ill-posed. Most existing methods rely on…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Ayush Tewari , Florian Bernard , Pablo Garrido , Gaurav Bharaj , Mohamed Elgharib , Hans-Peter Seidel , Patrick Pérez , Michael Zollhöfer , Christian Theobalt

We present a learning framework for recovering the 3D shape, camera, and texture of an object from a single image. The shape is represented as a deformable 3D mesh model of an object category where a shape is parameterized by a learned mean…

Computer Vision and Pattern Recognition · Computer Science 2018-08-01 Angjoo Kanazawa , Shubham Tulsiani , Alexei A. Efros , Jitendra Malik

We present a self-supervised learning-based pipeline for dense 3D reconstruction from full-length monocular endoscopic videos without a priori modeling of anatomy or shading. Our method only relies on unlabeled monocular endoscopic videos…

Computer Vision and Pattern Recognition · Computer Science 2019-09-10 Xingtong Liu , Ayushi Sinha , Masaru Ishii , Gregory D. Hager , Russell H. Taylor , Mathias Unberath

This paper presents an approach that reconstructs a hand-held object from a monocular video. In contrast to many recent methods that directly predict object geometry by a trained network, the proposed approach does not require any learned…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Di Huang , Xiaopeng Ji , Xingyi He , Jiaming Sun , Tong He , Qing Shuai , Wanli Ouyang , Xiaowei Zhou

Monocular depth reconstruction of complex and dynamic scenes is a highly challenging problem. While for rigid scenes learning-based methods have been offering promising results even in unsupervised cases, there exists little to no…

Computer Vision and Pattern Recognition · Computer Science 2021-10-29 Ayça Takmaz , Danda Pani Paudel , Thomas Probst , Ajad Chhatkuli , Martin R. Oswald , Luc Van Gool

Articulated 3D reconstruction has valuable applications in various domains, yet it remains costly and demands intensive work from domain experts. Recent advancements in template-free learning methods show promising results with monocular…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Tao Tu , Ming-Feng Li , Chieh Hubert Lin , Yen-Chi Cheng , Min Sun , Ming-Hsuan Yang

We present a method to learn single-view reconstruction of the 3D shape, pose, and texture of objects from categorized natural images in a self-supervised manner. Since this is a severely ill-posed problem, carefully designing a training…

Computer Vision and Pattern Recognition · Computer Science 2019-11-21 Hiroharu Kato , Tatsuya Harada

We introduce REDO, a class-agnostic framework to REconstruct the Dynamic Objects from RGBD or calibrated videos. Compared to prior work, our problem setting is more realistic yet more challenging for three reasons: 1) due to occlusion or…

Computer Vision and Pattern Recognition · Computer Science 2021-12-06 Zhongzheng Ren , Xiaoming Zhao , Alexander G. Schwing

We investigate the problem of learning category-specific 3D shape reconstruction from a variable number of RGB views of previously unobserved object instances. Most approaches for multiview shape reconstruction operate on sparse shape…

Computer Vision and Pattern Recognition · Computer Science 2019-12-10 Srinath Sridhar , Davis Rempe , Julien Valentin , Sofien Bouaziz , Leonidas J. Guibas

We present the first marker-less approach for temporally coherent 3D performance capture of a human with general clothing from monocular video. Our approach reconstructs articulated human skeleton motion as well as medium-scale non-rigid…

Computer Vision and Pattern Recognition · Computer Science 2018-02-26 Weipeng Xu , Avishek Chatterjee , Michael Zollhöfer , Helge Rhodin , Dushyant Mehta , Hans-Peter Seidel , Christian Theobalt

Estimating 3D articulated shapes like animal bodies from monocular images is inherently challenging due to the ambiguities of camera viewpoint, pose, texture, lighting, etc. We propose ARTIC3D, a self-supervised framework to reconstruct…

Computer Vision and Pattern Recognition · Computer Science 2023-06-08 Chun-Han Yao , Amit Raj , Wei-Chih Hung , Yuanzhen Li , Michael Rubinstein , Ming-Hsuan Yang , Varun Jampani

Monocular dense 3D reconstruction of deformable objects is a hard ill-posed problem in computer vision. Current techniques either require dense correspondences and rely on motion and deformation cues, or assume a highly accurate…

Computer Vision and Pattern Recognition · Computer Science 2019-08-07 Vladislav Golyanik , Soshi Shimada , Kiran Varanasi , Didier Stricker

This paper shows that it is possible to learn models for monocular 3D reconstruction of articulated objects (e.g., horses, cows, sheep), using as few as 50-150 images labeled with 2D keypoints. Our proposed approach involves training…

Computer Vision and Pattern Recognition · Computer Science 2023-04-28 Anastasis Stathopoulos , Georgios Pavlakos , Ligong Han , Dimitris Metaxas

Reconstructing dynamic objects from monocular videos is a severely underconstrained and challenging problem, and recent work has approached it in various directions. However, owing to the ill-posed nature of this problem, there has been no…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Devikalyan Das , Christopher Wewer , Raza Yunus , Eddy Ilg , Jan Eric Lenssen

We present Vid2Avatar, a method to learn human avatars from monocular in-the-wild videos. Reconstructing humans that move naturally from monocular in-the-wild videos is difficult. Solving it requires accurately separating humans from…

Computer Vision and Pattern Recognition · Computer Science 2023-02-23 Chen Guo , Tianjian Jiang , Xu Chen , Jie Song , Otmar Hilliges