English
Related papers

Related papers: 3D-aware Image Synthesis via Learning Structural a…

200 papers

Recent advances in 3D-aware generative models (3D-aware GANs) combined with Neural Radiance Fields (NeRF) have achieved impressive results. However no prior works investigate 3D-aware GANs for 3D consistent multi-class image-to-image…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Senmao Li , Joost van de Weijer , Yaxing Wang , Fahad Shahbaz Khan , Meiqin Liu , Jian Yang

Generative Adversarial Networks (GANs) have gained significant attention in several computer vision tasks for generating high-quality synthetic data. Various medical applications including diagnostic imaging and radiation therapy can…

Image and Video Processing · Electrical Eng. & Systems 2022-07-25 Sanaz Mohammadjafari , Mucahit Cevik , Ayse Basar

We present a novel method for performing flexible, 3D-aware image content manipulation while enabling high-quality novel view synthesis. While NeRF-based approaches are effective for novel view synthesis, such models memorize the radiance…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Verica Lazova , Vladimir Guzov , Kyle Olszewski , Sergey Tulyakov , Gerard Pons-Moll

Domain scientists often face I/O and storage challenges when keeping raw data from large-scale simulations. Saving visualization images, albeit practical, is limited to preselected viewpoints, transfer functions, and simulation parameters.…

Graphics · Computer Science 2025-02-25 Siyuan Yao , Yunfei Lu , Chaoli Wang

We present a method that achieves state-of-the-art results for synthesizing novel views of complex scenes by optimizing an underlying continuous volumetric scene function using a sparse set of input views. Our algorithm represents a scene…

Computer Vision and Pattern Recognition · Computer Science 2020-08-05 Ben Mildenhall , Pratul P. Srinivasan , Matthew Tancik , Jonathan T. Barron , Ravi Ramamoorthi , Ren Ng

NeRF-based 3D-aware Generative Adversarial Networks (GANs) like EG3D or GIRAFFE have shown very high rendering quality under large representational variety. However, rendering with Neural Radiance Fields poses challenges for 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Florian Barthel , Arian Beckmann , Wieland Morgenstern , Anna Hilsmann , Peter Eisert

Neural Radiance Fields (NeRF) have shown impressive novel view synthesis results; nonetheless, even thorough recordings yield imperfections in reconstructions, for instance due to poorly observed areas or minor lighting changes. Our goal is…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Barbara Roessle , Norman Müller , Lorenzo Porzi , Samuel Rota Bulò , Peter Kontschieder , Matthias Nießner

Generative models have shown great promise in synthesizing photorealistic 3D objects, but they require large amounts of training data. We introduce SinGRAF, a 3D-aware generative model that is trained with a few input images of a single…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Minjung Son , Jeong Joon Park , Leonidas Guibas , Gordon Wetzstein

We present a technique to synthesize and analyze volume-rendered images using generative models. We use the Generative Adversarial Network (GAN) framework to compute a model from a large collection of volume renderings, conditioned on (1)…

Graphics · Computer Science 2019-07-18 Matthew Berger , Jixian Li , Joshua A. Levine

Neural Radiance Field (NeRF) is a framework that represents a 3D scene in the weights of a fully connected neural network, known as the Multi-Layer Perception(MLP). The method was introduced for the task of novel view synthesis and is able…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Mohamed Debbagh

Neural Radiance Fields (NeRFs) have demonstrated remarkable potential in capturing complex 3D scenes with high fidelity. However, one persistent challenge that hinders the widespread adoption of NeRFs is the computational bottleneck due to…

Computer Vision and Pattern Recognition · Computer Science 2024-02-16 Joo Chan Lee , Daniel Rho , Xiangyu Sun , Jong Hwan Ko , Eunbyung Park

Novel view synthesis is an essential functionality for enabling immersive experiences in various Augmented- and Virtual-Reality (AR/VR) applications, for which generalizable Neural Radiance Fields (NeRFs) have gained increasing popularity…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Yonggan Fu , Zhifan Ye , Jiayi Yuan , Shunyao Zhang , Sixu Li , Haoran You , Yingyan Celine Lin

We address the problem of photorealistic 3D face avatar synthesis from sparse images. Existing Parametric models for face avatar reconstruction struggle to generate details that originate from inputs. Meanwhile, although current NeRF-based…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Weichen Zhang , Xiang Zhou , Yukang Cao , Wensen Feng , Chun Yuan

In advanced mission concepts with high levels of autonomy, spacecraft need to internally model the pose and shape of nearby orbiting objects. Recent works in neural scene representations show promising results for inferring generic…

Computer Vision and Pattern Recognition · Computer Science 2021-05-14 Anne Mergy , Gurvan Lecuyer , Dawa Derksen , Dario Izzo

Unsupervised learning of 3D-aware generative adversarial networks (GANs) using only collections of single-view 2D photographs has very recently made much progress. These 3D GANs, however, have not been demonstrated for human bodies and the…

Computer Vision and Pattern Recognition · Computer Science 2023-01-10 Alexander W. Bergman , Petr Kellnhofer , Wang Yifan , Eric R. Chan , David B. Lindell , Gordon Wetzstein

Generative Neural Radiance Fields (NeRFs) have demonstrated remarkable proficiency in synthesizing multi-view images by learning the distribution of a set of unposed images. Despite the aptitude of existing generative NeRFs in generating…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Kanghyeok Ko , Minhyeok Lee

Generating realistic 3D faces is of high importance for computer graphics and computer vision applications. Generally, research on 3D face generation revolves around linear statistical models of the facial surface. Nevertheless, these…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Baris Gecer , Alexander Lattas , Stylianos Ploumpis , Jiankang Deng , Athanasios Papaioannou , Stylianos Moschoglou , Stefanos Zafeiriou

This paper presents BioNeRF, a biologically plausible architecture that models scenes in a 3D representation and synthesizes new views through radiance fields. Since NeRF relies on the network weights to store the scene's 3-dimensional…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Leandro A. Passos , Douglas Rodrigues , Danilo Jodas , Kelton A. P. Costa , Ahsan Adeel , João Paulo Papa

Simultaneously achieving 3D reconstruction and new view synthesis for indoor environments has widespread applications but is technically very challenging. State-of-the-art methods based on implicit neural functions can achieve excellent 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Zhenyu Bao , Guibiao Liao , Zhongyuan Zhao , Kanglin Liu , Qing Li , Guoping Qiu

With dense inputs, Neural Radiance Fields (NeRF) is able to render photo-realistic novel views under static conditions. Although the synthesis quality is excellent, existing NeRF-based methods fail to obtain moderate three-dimensional (3D)…

Computer Vision and Pattern Recognition · Computer Science 2024-02-21 Shu Chen , Junyao Li , Yang Zhang , Beiji Zou