English
Related papers

Related papers: 3D-Aware Semantic-Guided Generative Model for Huma…

200 papers

Recent years have seen remarkable progress in deep learning powered visual content creation. This includes deep generative 3D-aware image synthesis, which produces high-idelity images in a 3D-consistent manner while simultaneously capturing…

Computer Vision and Pattern Recognition · Computer Science 2023-10-04 Weihao Xia , Jing-Hao Xue

Inverse graphics aims to recover 3D models from 2D observations. Utilizing differentiable rendering, recent 3D-aware generative models have shown impressive results of rigid object generation using 2D images. However, it remains challenging…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Fangzhou Hong , Zhaoxi Chen , Yushi Lan , Liang Pan , Ziwei Liu

StyleGAN has demonstrated the ability of GANs to synthesize highly-realistic faces of imaginary people from random noise. One limitation of GAN-based image generation is the difficulty of controlling the features of the generated image, due…

Computer Vision and Pattern Recognition · Computer Science 2025-04-25 Zhuo He , Paul Henderson , Nicolas Pugeault

Neural implicit representation of visual scenes has attracted a lot of attention in recent research of computer vision and graphics. Most prior methods focus on how to reconstruct 3D scene representation from a set of images. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Wenpu Li , Pian Wan , Peng Wang , Jinghang Li , Yi Zhou , Peidong Liu

Existing 3D-aware facial generation methods face a dilemma in quality versus editability: they either generate editable results in low resolution or high-quality ones with no editing flexibility. In this work, we propose a new approach that…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Jingxiang Sun , Xuan Wang , Yichun Shi , Lizhen Wang , Jue Wang , Yebin Liu

Novel view synthesis is an essential functionality for enabling immersive experiences in various Augmented- and Virtual-Reality (AR/VR) applications, for which generalizable Neural Radiance Fields (NeRFs) have gained increasing popularity…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Yonggan Fu , Zhifan Ye , Jiayi Yuan , Shunyao Zhang , Sixu Li , Haoran You , Yingyan Celine Lin

We introduce a highly robust GAN-based framework for digitizing a normalized 3D avatar of a person from a single unconstrained photo. While the input image can be of a smiling person or taken in extreme lighting conditions, our method can…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Huiwen Luo , Koki Nagano , Han-Wei Kung , Mclean Goldwhite , Qingguo Xu , Zejian Wang , Lingyu Wei , Liwen Hu , Hao Li

Manipulating latent code in generative adversarial networks (GANs) for facial image synthesis mainly focuses on continuous attribute synthesis (e.g., age, pose and emotion), while discrete attribute synthesis (like face mask and eyeglasses)…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Zhou Kangneng , Zhu Xiaobin , Gao Daiheng , Lee Kai , Li Xinjie , Yin Xu-Cheng

Generative models have emerged as an essential building block for many image synthesis and editing tasks. Recent advances in this field have also enabled high-quality 3D or video content to be generated that exhibits either multi-view or…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Sherwin Bahmani , Jeong Joon Park , Despoina Paschalidou , Hao Tang , Gordon Wetzstein , Leonidas Guibas , Luc Van Gool , Radu Timofte

Contemporary registration devices for 3D visual information, such as LIDARs and various depth cameras, capture data as 3D point clouds. In turn, such clouds are challenging to be processed due to their size and complexity. Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Dominik Zimny , Joanna Waczyńska , Tomasz Trzciński , Przemysław Spurek

Several variants of Neural Radiance Fields (NeRFs) have significantly improved the accuracy of synthesized images and surface reconstruction of 3D scenes/objects. In all of these methods, a key characteristic is that none can train the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Gonçalo Dias Pais , Valter Piedade , Moitreya Chatterjee , Marcus Greiff , Pedro Miraldo

Recent advances in differentiable rendering have sparked an interest in learning generative models of textured 3D meshes from image collections. These models natively disentangle pose and appearance, enable downstream applications in…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Dario Pavllo , Jonas Kohler , Thomas Hofmann , Aurelien Lucchi

Artificial data synthesis is currently a well studied topic with useful applications in data science, computer vision, graphics and many other fields. Generating realistic data is especially challenging since human perception is highly…

Computational Geometry · Computer Science 2019-01-23 Gil Shamai , Ron Slossberg , Ron Kimmel

We present a novel animatable 3D Gaussian model for rendering high-fidelity free-view human motions in real time. Compared to existing NeRF-based methods, the model owns better capability in synthesizing high-frequency details without the…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Keyang Ye , Tianjia Shao , Kun Zhou

Recent research that combines implicit 3D representation with semantic information, like Semantic-NeRF, has proven that NeRF model could perform excellently in rendering 3D structures with semantic labels. This research aims to extend the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Ruibo Wang , Song Zhang , Ping Huang , Donghai Zhang , Wei Yan

The entertainment industry relies on 3D visual content to create immersive experiences, but traditional methods for creating textured 3D models can be time-consuming and subjective. Generative networks such as StyleGAN have advanced image…

Computer Vision and Pattern Recognition · Computer Science 2024-02-09 Yi-Ting Pan , Chai-Rong Lee , Shu-Ho Fan , Jheng-Wei Su , Jia-Bin Huang , Yung-Yu Chuang , Hung-Kuo Chu

The remarkable progress in neural-network-driven visual data generation, especially with neural rendering techniques like Neural Radiance Fields and 3D Gaussian splatting, offers a powerful alternative to GANs and diffusion models. These…

Computer Vision and Pattern Recognition · Computer Science 2024-11-14 Chengdong Dong , Vijayakumar Bhagavatula , Zhenyu Zhou , Ajay Kumar

Recent research has shown that controllable image generation based on pre-trained GANs can benefit a wide range of computer vision tasks. However, less attention has been devoted to 3D vision tasks. In light of this, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Feng Liu , Xiaoming Liu

Neural volumetric representations such as Neural Radiance Fields (NeRF) have emerged as a compelling technique for learning to represent 3D scenes from images with the goal of rendering photorealistic images of the scene from unobserved…

Computer Vision and Pattern Recognition · Computer Science 2021-03-29 Peter Hedman , Pratul P. Srinivasan , Ben Mildenhall , Jonathan T. Barron , Paul Debevec

The success of various applications including robotics, digital content creation, and visualization demand a structured and abstract representation of the 3D world from limited sensor data. Inspired by the nature of human perception of 3D…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Chuhang Zou , Ersin Yumer , Jimei Yang , Duygu Ceylan , Derek Hoiem