English
Related papers

Related papers: 2D GANs Meet Unsupervised Single-view 3D Reconstru…

200 papers

3D-aware image synthesis aims at learning a generative model that can render photo-realistic 2D images while capturing decent underlying 3D shapes. A popular solution is to adopt the generative adversarial network (GAN) and replace the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-03 Zifan Shi , Yinghao Xu , Yujun Shen , Deli Zhao , Qifeng Chen , Dit-Yan Yeung

Human perceive the 3D world through 2D observations from limited viewpoints. While recent feed-forward generalizable 3D reconstruction models excel at recovering 3D structures from sparse images, their representations are often confined to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Mochu Xiang , Zhelun Shen , Xuesong Li , Jiahui Ren , Jing Zhang , Chen Zhao , Shanshan Liu , Haocheng Feng , Jingdong Wang , Yuchao Dai

We propose a learned image-guided rendering technique that combines the benefits of image-based rendering and GAN-based image synthesis. The goal of our method is to generate photo-realistic re-renderings of reconstructed objects for…

Computer Vision and Pattern Recognition · Computer Science 2020-01-16 Justus Thies , Michael Zollhöfer , Christian Theobalt , Marc Stamminger , Matthias Nießner

Inspired by the recent success of methods that employ shape priors to achieve robust 3D reconstructions, we propose a novel recurrent neural network architecture that we call the 3D Recurrent Reconstruction Neural Network (3D-R2N2). The…

Computer Vision and Pattern Recognition · Computer Science 2016-04-05 Christopher B. Choy , Danfei Xu , JunYoung Gwak , Kevin Chen , Silvio Savarese

The recent success of implicit neural scene representations has presented a viable new method for how we capture and store 3D scenes. Unlike conventional 3D representations, such as point clouds, which explicitly store scene properties in…

Computer Vision and Pattern Recognition · Computer Science 2021-01-19 Amit Kohli , Vincent Sitzmann , Gordon Wetzstein

3D-consistent image generation from a single 2D semantic label is an important and challenging research topic in computer graphics and computer vision. Although some related works have made great progress in this field, most of the existing…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Bo Li , Yi-ke Li , Zhi-fen He , Bin Liu , Yun-Kun Lai

Recent progress in NeRF-based GANs has introduced a number of approaches for high-resolution and high-fidelity generative modeling of human heads with a possibility for novel view rendering. At the same time, one must solve an inverse…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Ananta R. Bhattarai , Matthias Nießner , Artem Sevastopolsky

Generative Adversarial Networks are used for generating the data using a generator and a discriminator, GANs usually produce high-quality images, but training GANs in an adversarial setting is a difficult task. GANs require high computation…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Md Nurul Muttakin , Malik Shahid Sultan , Robert Hoehndorf , Hernando Ombao

Generative Adversarial Networks (GANs) have emerged as powerful tools for high-quality image generation and real image editing by manipulating their latent spaces. Recent advancements in GANs include 3D-aware models such as EG3D, which…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Bahri Batuhan Bilecen , Yigit Yalin , Ning Yu , Aysegul Dundar

We present a method to learn single-view reconstruction of the 3D shape, pose, and texture of objects from categorized natural images in a self-supervised manner. Since this is a severely ill-posed problem, carefully designing a training…

Computer Vision and Pattern Recognition · Computer Science 2019-11-21 Hiroharu Kato , Tatsuya Harada

Conditional GANs are at the forefront of natural image synthesis. The main drawback of such models is the necessity for labeled data. In this work we exploit two popular unsupervised learning techniques, adversarial training and…

Machine Learning · Computer Science 2019-04-10 Ting Chen , Xiaohua Zhai , Marvin Ritter , Mario Lucic , Neil Houlsby

Neural volume rendering techniques, such as NeRF, have revolutionized 3D-aware image synthesis by enabling the generation of images of a single scene or object from various camera poses. However, the high computational cost of NeRF presents…

Computer Vision and Pattern Recognition · Computer Science 2025-01-20 Peng Zheng , Linzhi Huang , Yizhou Yu , Yi Chang , Yilin Wang , Rui Ma

Generative Adversarial Networks (GANs) are an arrange of two neural networks -- the generator and the discriminator -- that are jointly trained to generate artificial data, such as images, from random inputs. The quality of these generated…

Computer Vision and Pattern Recognition · Computer Science 2021-01-05 Manel Mateos , Alejandro González , Xavier Sevillano

Deep learning-solutions for hand-object 3D pose and shape estimation are now very effective when an annotated dataset is available to train them to handle the scenarios and lighting conditions they will encounter at test time.…

Computer Vision and Pattern Recognition · Computer Science 2020-12-22 Mengshi Qi , Edoardo Remelli , Mathieu Salzmann , Pascal Fua

The emerging trend in computer vision emphasizes developing universal models capable of simultaneously addressing multiple diverse tasks. Such universality typically requires joint training across multi-domain datasets to ensure effective…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Eunsoo Im , Changhyun Jee , Jung Kwon Lee

With great progress in the development of Generative Adversarial Networks (GANs), in recent years, the quest for insights in understanding and manipulating the latent space of GAN has gained more and more attention due to its wide range of…

Machine Learning · Computer Science 2021-02-25 Toan Pham Van , Tam Minh Nguyen , Ngoc N. Tran , Hoai Viet Nguyen , Linh Bao Doan , Huy Quang Dao , Thanh Ta Minh

Prior works for reconstructing hand-held objects from a single image train models on images paired with 3D shapes. Such data is challenging to gather in the real world at scale. Consequently, these approaches do not generalize well when…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Aditya Prakash , Matthew Chang , Matthew Jin , Ruisen Tu , Saurabh Gupta

Neural 3D scene reconstruction methods have achieved impressive performance when reconstructing complex geometry and low-textured regions in indoor scenes. However, these methods heavily rely on 3D data which is costly and time-consuming to…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Yi Guo , Che Sun , Yunde Jia , Yuwei Wu

We propose SparseFusion, a sparse view 3D reconstruction approach that unifies recent advances in neural rendering and probabilistic image generation. Existing approaches typically build on neural rendering with re-projected features but…

Computer Vision and Pattern Recognition · Computer Science 2023-02-17 Zhizhuo Zhou , Shubham Tulsiani

Pose-conditioned convolutional generative models struggle with high-quality 3D-consistent image generation from single-view datasets, due to their lack of sufficient 3D priors. Recently, the integration of Neural Radiance Fields (NeRFs) and…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Mohamad Shahbazi , Evangelos Ntavelis , Alessio Tonioni , Edo Collins , Danda Pani Paudel , Martin Danelljan , Luc Van Gool