English
Related papers

Related papers: Monocular 3D Object Reconstruction with GAN Invers…

200 papers

Monocular 3D reconstruction of articulated object categories is challenging due to the lack of training data and the inherent ill-posedness of the problem. In this work we use video self-supervision, forcing the consistency of consecutive…

Computer Vision and Pattern Recognition · Computer Science 2021-04-28 Filippos Kokkinos , Iasonas Kokkinos

With the support of Virtual Reality (VR) and Augmented Reality (AR) technologies, the 3D virtual eyeglasses try-on application is well on its way to becoming a new trending solution that offers a "try on" option to select the perfect pair…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Fan Zhang , Ziyue Ji , Weiguang Kang , Weiqing Li , Zhiyong Su

High-fidelity 3D scene reconstruction from monocular videos continues to be challenging, especially for complete and fine-grained geometry reconstruction. The previous 3D reconstruction approaches with neural implicit representations have…

Computer Vision and Pattern Recognition · Computer Science 2022-10-03 Zi-Xin Zou , Shi-Sheng Huang , Yan-Pei Cao , Tai-Jiang Mu , Ying Shan , Hongbo Fu

Monocular 3D reconstruction of deformable objects, such as human body parts, has been typically approached by predicting parameters of heavyweight linear models. In this paper, we demonstrate an alternative solution that is based on the…

Computer Vision and Pattern Recognition · Computer Science 2019-08-06 Dominik Kulon , Haoyang Wang , Riza Alp Güler , Michael Bronstein , Stefanos Zafeiriou

3D object detection from monocular images is an ill-posed problem due to the projective entanglement of depth and scale. To overcome this ambiguity, we present a novel self-supervised method for textured 3D shape reconstruction and pose…

Computer Vision and Pattern Recognition · Computer Science 2020-10-01 Deniz Beker , Hiroharu Kato , Mihai Adrian Morariu , Takahiro Ando , Toru Matsuoka , Wadim Kehl , Adrien Gaidon

Generative Adversarial Networks (GANs) are currently the method of choice for generating visual data. Certain GAN architectures and training methods have demonstrated exceptional performance in generating realistic synthetic images (in…

Computer Vision and Pattern Recognition · Computer Science 2019-03-26 Shiyang Cheng , Michael Bronstein , Yuxiang Zhou , Irene Kotsia , Maja Pantic , Stefanos Zafeiriou

In this paper, we introduce a novel 3D mesh convolution-based autoencoder for geometry compression, able to deal with irregular mesh data without requiring neither preprocessing nor manifold/watertightness conditions. The proposed approach…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Germain Bregeon , Marius Preda , Radu Ispas , Titus Zaharia

Recovering 3D human mesh from monocular images is a popular topic in computer vision and has a wide range of applications. This paper aims to estimate 3D mesh of multiple body parts (e.g., body, hands) with large-scale differences from a…

Computer Vision and Pattern Recognition · Computer Science 2020-10-28 Yu Sun , Qian Bao , Wu Liu , Wenpeng Gao , Yili Fu , Chuang Gan , Tao Mei

Recently, learning frameworks have shown the capability of inferring the accurate shape, pose, and texture of an object from a single RGB image. However, current methods are trained on image collections of a single category in order to…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Alessandro Simoni , Stefano Pini , Roberto Vezzani , Rita Cucchiara

Capturing the 3D geometry of transparent objects is a challenging task, ill-suited for general-purpose scanning and reconstruction techniques, since these cannot handle specular light transport phenomena. Existing state-of-the-art methods,…

Graphics · Computer Science 2020-09-22 Jiahui Lyu , Bojian Wu , Dani Lischinski , Daniel Cohen-Or , Hui Huang

We revisit the role of texture in monocular 3D hand reconstruction, not as an afterthought for photorealism, but as a dense, spatially grounded cue that can actively support pose and shape estimation. Our observation is simple: even in…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Giorgos Karvounas , Nikolaos Kyriazis , Iason Oikonomidis , Georgios Pavlakos , Antonis A. Argyros

We present a novel framework to reconstruct complete 3D human shapes from a given target image by leveraging monocular unconstrained images. The objective of this work is to reproduce high-quality details in regions of the reconstructed…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Marco Pesavento , Marco Volino , Adrian Hilton

This paper presents an algorithm to reconstruct temporally consistent 3D meshes of deformable object instances from videos in the wild. Without requiring annotations of 3D mesh, 2D keypoints, or camera pose for each video frame, we pose…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Xueting Li , Sifei Liu , Shalini De Mello , Kihwan Kim , Xiaolong Wang , Ming-Hsuan Yang , Jan Kautz

DreamFusion established a new paradigm for unsupervised 3D reconstruction from virtual views by combining advances in generative models and differentiable rendering. However, the underlying multi-view rendering, along with supervision from…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Ananta R. Bhattarai , Xingzhe He , Alla Sheffer , Helge Rhodin

GAN inversion aims to invert a given image back into the latent space of a pretrained GAN model, for the image to be faithfully reconstructed from the inverted code by the generator. As an emerging technique to bridge the real and fake…

Computer Vision and Pattern Recognition · Computer Science 2022-03-24 Weihao Xia , Yulun Zhang , Yujiu Yang , Jing-Hao Xue , Bolei Zhou , Ming-Hsuan Yang

Recent advancements in 3D robotic manipulation have improved grasping of everyday objects, but transparent and specular materials remain challenging due to depth sensing limitations. While several 3D reconstruction and depth completion…

Robotics · Computer Science 2025-06-23 Mingxu Zhang , Xiaoqi Li , Jiahui Xu , Kaichen Zhou , Hojin Bae , Yan Shen , Chuyan Xiong , Hao Dong

Existing multi-view 3D object reconstruction methods heavily rely on sufficient overlap between input views, where occlusions and sparse coverage in practice frequently yield severe reconstruction incompleteness. Recent advancements in…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Jiahao Chang , Chongjie Ye , Yushuang Wu , Yuantao Chen , Yidan Zhang , Zhongjin Luo , Chenghong Li , Yihao Zhi , Xiaoguang Han

Reconstructing 3D objects from a single image is an intriguing but challenging problem. One promising solution is to utilize multi-view (MV) 3D reconstruction to fuse generated MV images into consistent 3D objects. However, the generated…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Yizheng Chen , Rengan Xie , Qi Ye , Sen Yang , Zixuan Xie , Tianxiao Chen , Rong Li , Yuchi Huo

We propose DiMeR, a novel geometry-texture disentangled feed-forward model with 3D supervision for sparse-view mesh reconstruction. Existing methods confront two persistent obstacles: (i) textures can conceal geometric errors, i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Lutao Jiang , Jiantao Lin , Kanghao Chen , Wenhang Ge , Xin Yang , Yifan Jiang , Yuanhuiyi Lyu , Xu Zheng , Yinchuan Li , Yingcong Chen

In the past few years, a lot of work has been done towards reconstructing the 3D facial structure from single images by capitalizing on the power of Deep Convolutional Neural Networks (DCNNs). In the most recent works, differentiable…

Computer Vision and Pattern Recognition · Computer Science 2020-09-09 Baris Gecer , Stylianos Ploumpis , Irene Kotsia , Stefanos Zafeiriou