中文
相关论文

相关论文: Benchmarking and Analyzing 3D-aware Image Synthesi…

200 篇论文

Differentiable rendering has paved the way to training neural networks to perform "inverse graphics" tasks such as predicting 3D geometry from monocular photographs. To train high performing models, most of the current approaches rely on…

计算机视觉与模式识别 · 计算机科学 2021-04-22 Yuxuan Zhang , Wenzheng Chen , Huan Ling , Jun Gao , Yinan Zhang , Antonio Torralba , Sanja Fidler

Collecting accurate camera poses of training images has been shown to well serve the learning of 3D-aware generative adversarial networks (GANs) yet can be quite expensive in practice. This work targets learning 3D-aware GANs from unposed…

计算机视觉与模式识别 · 计算机科学 2024-09-27 Xinya Chen , Hanlei Guo , Yanrui Bin , Shangzhan Zhang , Yuanbo Yang , Yue Wang , Yujun Shen , Yiyi Liao

Generative models have emerged as an essential building block for many image synthesis and editing tasks. Recent advances in this field have also enabled high-quality 3D or video content to be generated that exhibits either multi-view or…

计算机视觉与模式识别 · 计算机科学 2023-08-10 Sherwin Bahmani , Jeong Joon Park , Despoina Paschalidou , Hao Tang , Gordon Wetzstein , Leonidas Guibas , Luc Van Gool , Radu Timofte

The style-based GAN (StyleGAN) architecture achieved state-of-the-art results for generating high-quality images, but it lacks explicit and precise control over camera poses. The recently proposed NeRF-based GANs made great progress towards…

计算机视觉与模式识别 · 计算机科学 2021-10-20 Peng Zhou , Lingxi Xie , Bingbing Ni , Qi Tian

The adversarial methods showed advanced performance by producing synthetic images to mitigate the domain shift, a common problem due to the hardship of acquiring labelled data in medical field. Most existing studies focus on modifying the…

图像与视频处理 · 电气工程与系统科学 2023-05-09 Xinwen Zhang , Chaoyi Zhang , Dongnan Liu , Qianbi Yu , Weidong Cai

In recent years, Generative Adversarial Networks have achieved impressive results in photorealistic image synthesis. This progress nurtures hopes that one day the classical rendering pipeline can be replaced by efficient models that are…

计算机视觉与模式识别 · 计算机科学 2020-03-25 Yiyi Liao , Katja Schwarz , Lars Mescheder , Andreas Geiger

Recent years have seen remarkable progress in deep learning powered visual content creation. This includes deep generative 3D-aware image synthesis, which produces high-idelity images in a 3D-consistent manner while simultaneously capturing…

计算机视觉与模式识别 · 计算机科学 2023-10-04 Weihao Xia , Jing-Hao Xue

Generative Adversarial Networks (GANs) have been extremely successful in various application domains such as computer vision, medicine, and natural language processing. Moreover, transforming an object or person to a desired shape become a…

计算机视觉与模式识别 · 计算机科学 2020-12-29 Pourya Shamsolmoali , Masoumeh Zareapoor , Eric Granger , Huiyu Zhou , Ruili Wang , M. Emre Celebi , Jie Yang

Recent work on 3D-aware image synthesis has achieved compelling results using advances in neural rendering. However, 3D-aware synthesis of face dynamics hasn't received much attention. Here, we study how to explicitly control generative…

计算机视觉与模式识别 · 计算机科学 2022-10-13 Peiye Zhuang , Liqian Ma , Oluwasanmi Koyejo , Alexander G. Schwing

Generative Neural Radiance Field (GNeRF) models, which extract implicit 3D representations from 2D images, have recently been shown to produce realistic images representing rigid/semi-rigid objects, such as human faces or cars. However,…

计算机视觉与模式识别 · 计算机科学 2022-07-19 Jichao Zhang , Enver Sangineto , Hao Tang , Aliaksandr Siarohin , Zhun Zhong , Nicu Sebe , Wei Wang

In this work, we build a modular-designed codebase, formulate strong training recipes, design an error diagnosis toolbox, and discuss current methods for image-based 3D object detection. In particular, different from other highly mature…

计算机视觉与模式识别 · 计算机科学 2023-10-12 Xinzhu Ma , Yongtao Wang , Yinmin Zhang , Zhiyi Xia , Yuan Meng , Zhihui Wang , Haojie Li , Wanli Ouyang

Existing methods for multi-domain image-to-image translation (or generation) attempt to directly map an input image (or a random vector) to an image in one of the output domains. However, most existing methods have limited scalability and…

计算机视觉与模式识别 · 计算机科学 2018-04-11 Bo Zhao , Bo Chang , Zequn Jie , Leonid Sigal

The interest of the deep learning community in image synthesis has grown massively in recent years. Nowadays, deep generative methods, and especially Generative Adversarial Networks (GANs), are leading to state-of-the-art performance,…

计算机视觉与模式识别 · 计算机科学 2022-05-16 Roy Ganz , Michael Elad

3D-consistent image generation from a single 2D semantic label is an important and challenging research topic in computer graphics and computer vision. Although some related works have made great progress in this field, most of the existing…

计算机视觉与模式识别 · 计算机科学 2024-03-12 Bo Li , Yi-ke Li , Zhi-fen He , Bin Liu , Yun-Kun Lai

We have witnessed rapid progress on 3D-aware image synthesis, leveraging recent advances in generative visual models and neural rendering. Existing approaches however fall short in two ways: first, they may lack an underlying 3D…

计算机视觉与模式识别 · 计算机科学 2021-04-07 Eric R. Chan , Marco Monteiro , Petr Kellnhofer , Jiajun Wu , Gordon Wetzstein

The remarkable progress in neural-network-driven visual data generation, especially with neural rendering techniques like Neural Radiance Fields and 3D Gaussian splatting, offers a powerful alternative to GANs and diffusion models. These…

计算机视觉与模式识别 · 计算机科学 2024-11-14 Chengdong Dong , Vijayakumar Bhagavatula , Zhenyu Zhou , Ajay Kumar

Neural Radiance Fields (NeRF) have significantly advanced the field of novel view synthesis, yet their generalization across diverse scenes and conditions remains challenging. Addressing this, we propose the integration of a novel…

计算机视觉与模式识别 · 计算机科学 2025-05-13 Ahmed Qazi , Abdul Basit , Asim Iqbal

The neural radiance field (NERF) advocates learning the continuous representation of 3D geometry through a multilayer perceptron (MLP). By integrating this into a generative model, the generative neural radiance field (GRAF) is capable of…

计算机视觉与模式识别 · 计算机科学 2024-12-03 Jian Liu , Zhen Yu

In medical imaging, image synthesis is the estimation process of one image (sequence, modality) from another image (sequence, modality). Since images with different modalities provide diverse biomarkers and capture various features,…

图像与视频处理 · 电气工程与系统科学 2023-05-26 Firoozeh Shomal Zadeh , Sevda Molani , Maysam Orouskhani , Marziyeh Rezaei , Mehrzad Shafiei , Hossein Abbasi

Unsupervised generation of high-quality multi-view-consistent images and 3D shapes using only collections of single-view 2D photographs has been a long-standing challenge. Existing 3D GANs are either compute-intensive or make approximations…