English
Related papers

Related papers: Next3D: Generative Neural Texture Rasterization fo…

200 papers

Previous portrait image generation methods roughly fall into two categories: 2D GANs and 3D-aware GANs. 2D GANs can generate high fidelity portraits but with low view consistency. 3D-aware GAN methods can maintain view consistency but their…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Jingxiang Sun , Xuan Wang , Yong Zhang , Xiaoyu Li , Qi Zhang , Yebin Liu , Jue Wang

3D-aware Generative Adversarial Networks (GANs) have shown remarkable progress in learning to generate multi-view-consistent images and 3D geometries of scenes from collections of 2D images via neural volume rendering. Yet, the significant…

Computer Vision and Pattern Recognition · Computer Science 2024-01-05 Alex Trevithick , Matthew Chan , Towaki Takikawa , Umar Iqbal , Shalini De Mello , Manmohan Chandraker , Ravi Ramamoorthi , Koki Nagano

Predominant techniques on talking head generation largely depend on 2D information, including facial appearances and motions from input face images. Nevertheless, dense 3D facial geometry, such as pixel-wise depth, plays a critical role in…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Fa-Ting Hong , Li Shen , Dan Xu

Recent advances in differentiable rendering have sparked an interest in learning generative models of textured 3D meshes from image collections. These models natively disentangle pose and appearance, enable downstream applications in…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Dario Pavllo , Jonas Kohler , Thomas Hofmann , Aurelien Lucchi

Generative Neural Radiance Fields (GNeRF)-based 3D-aware GANs have showcased remarkable prowess in crafting high-fidelity images while upholding robust 3D consistency, particularly face generation. However, specific existing models…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Jichao Zhang , Aliaksandr Siarohin , Yahui Liu , Hao Tang , Nicu Sebe , Wei Wang

Synthesis and reconstruction of 3D human head has gained increasing interests in computer vision and computer graphics recently. Existing state-of-the-art 3D generative adversarial networks (GANs) for 3D human head synthesis are either…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Sizhe An , Hongyi Xu , Yichun Shi , Guoxian Song , Umit Ogras , Linjie Luo

This paper aims to introduce 3D Gaussian for efficient, expressive, and editable digital avatar generation. This task faces two major challenges: (1) The unstructured nature of 3D Gaussian makes it incompatible with current generation…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Weitian Zhang , Yichao Yan , Yunhui Liu , Xingdong Sheng , Xiaokang Yang

Fast and accurate simulations of the non-linear evolution of the cosmic density field are a major component of many cosmological analyses, but the computational time and storage required to run them can be exceedingly large. For this…

Cosmology and Nongalactic Astrophysics · Physics 2020-11-17 Richard M. Feder , Philippe Berger , George Stein

Medical image processing has been highlighted as an area where deep learning-based models have the greatest potential. However, in the medical field in particular, problems of data availability and privacy are hampering research progress…

Image and Video Processing · Electrical Eng. & Systems 2023-10-27 Christoph Angermann , Johannes Bereiter-Payr , Kerstin Stock , Markus Haltmeier , Gerald Degenhart

Recent advances in convolutional neural networks have shown promising results in 3D shape completion. But due to GPU memory limitations, these methods can only produce low-resolution outputs. To inpaint 3D models with semantic plausibility…

Computer Vision and Pattern Recognition · Computer Science 2017-11-20 Weiyue Wang , Qiangui Huang , Suya You , Chao Yang , Ulrich Neumann

Generation and transformation of images and videos using artificial intelligence have flourished over the past few years. Yet, there are only a few works aiming to produce creative 3D shapes, such as sculptures. Here we show a novel…

Machine Learning · Computer Science 2020-07-08 Luca Stornaiuolo , Nima Dehmamy , Albert-László Barabási , Mauro Martino

We address the challenging problem of generating facial attributes using a single image in an unconstrained pose. In contrast to prior works that largely consider generation on 2D near-frontal images, we propose a GAN-based framework to…

Computer Vision and Pattern Recognition · Computer Science 2019-07-25 Feng-Ju Chang , Xiang Yu , Ram Nevatia , Manmohan Chandraker

Given a monocular face image as input, 3D face geometry reconstruction aims to recover a corresponding 3D face mesh. Recently, both optimization-based and learning-based face reconstruction methods have taken advantage of the emerging…

Computer Vision and Pattern Recognition · Computer Science 2021-05-11 Jingtan Piao , Keqiang Sun , KwanYee Lin , Quan Wang , Hongsheng Li

Recent work has shown the ability to learn generative models for 3D shapes from only unstructured 2D images. However, training such models requires differentiating through the rasterization step of the rendering process, therefore past work…

Computer Vision and Pattern Recognition · Computer Science 2020-03-02 Sebastian Lunz , Yingzhen Li , Andrew Fitzgibbon , Nate Kushman

The recent advancements in image-text diffusion models have stimulated research interest in large-scale 3D generative models. Nevertheless, the limited availability of diverse 3D resources presents significant challenges to learning. In…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Chi Zhang , Yiwen Chen , Yijun Fu , Zhenglin Zhou , Gang YU , Billzb Wang , Bin Fu , Tao Chen , Guosheng Lin , Chunhua Shen

Recent advances in generative adversarial networks (GANs) have led to remarkable achievements in face image synthesis. While methods that use style-based GANs can generate strikingly photorealistic face images, it is often difficult to…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Safa C. Medin , Bernhard Egger , Anoop Cherian , Ye Wang , Joshua B. Tenenbaum , Xiaoming Liu , Tim K. Marks

Generative Adversarial Networks (GAN) have many potential medical imaging applications, including data augmentation, domain adaptation, and model explanation. Due to the limited memory of Graphical Processing Units (GPUs), most current 3D…

Image and Video Processing · Electrical Eng. & Systems 2022-09-13 Li Sun , Junxiang Chen , Yanwu Xu , Mingming Gong , Ke Yu , Kayhan Batmanghelich

This paper introduces a 3D shape generative model based on deep neural networks. A new image-like (i.e., tensor) data representation for genus-zero 3D shapes is devised. It is based on the observation that complicated shapes can be well…

Computer Vision and Pattern Recognition · Computer Science 2019-03-05 Heli Ben-Hamu , Haggai Maron , Itay Kezurer , Gal Avineri , Yaron Lipman

3D-consistent image generation from a single 2D semantic label is an important and challenging research topic in computer graphics and computer vision. Although some related works have made great progress in this field, most of the existing…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Bo Li , Yi-ke Li , Zhi-fen He , Bin Liu , Yun-Kun Lai

We study the problem of 3D-aware full-body human generation, aiming at creating animatable human avatars with high-quality textures and geometries. Generally, two challenges remain in this field: i) existing methods struggle to generate…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Xuanmeng Zhang , Jianfeng Zhang , Rohan Chacko , Hongyi Xu , Guoxian Song , Yi Yang , Jiashi Feng