English
Related papers

Related papers: StyleRig: Rigging StyleGAN for 3D Control over Por…

200 papers

We present an invert-and-edit framework to automatically transform facial weight of an input face image to look thinner or heavier by leveraging semantic facial attributes encoded in the latent space of Generative Adversarial Networks…

Computer Vision and Pattern Recognition · Computer Science 2020-11-06 V N S Rama Krishna Pinnimty , Matt Zhao , Palakorn Achananuparp , Ee-Peng Lim

In this paper, we present an integrated system for automatically generating and editing face images through face swapping, attribute-based editing, and random face parts synthesis. The proposed system is based on a deep neural network that…

Computer Vision and Pattern Recognition · Computer Science 2022-07-07 Ryota Natsume , Tatsuya Yatagawa , Shigeo Morishima

This work integrates StyleGAN, DragGAN and Principal Component Analysis (PCA) to enhance the latent space efficiency and controllability of GAN-generated images. Style-GAN provides a structured latent space, DragGAN enables intuitive image…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Kirsten Odendaal , Neela Kaushik , Spencer Halverson

In this paper, we propose an approach to obtain a personalized generative prior with explicit control over a set of attributes. We build upon MyStyle, a recently introduced method, that tunes the weights of a pre-trained StyleGAN face…

Computer Vision and Pattern Recognition · Computer Science 2023-10-12 Libing Zeng , Lele Chen , Yi Xu , Nima Kalantari

Manipulating latent code in generative adversarial networks (GANs) for facial image synthesis mainly focuses on continuous attribute synthesis (e.g., age, pose and emotion), while discrete attribute synthesis (like face mask and eyeglasses)…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Zhou Kangneng , Zhu Xiaobin , Gao Daiheng , Lee Kai , Li Xinjie , Yin Xu-Cheng

We propose an end-to-end deep-learning approach for automatic rigging and retargeting of 3D models of human faces in the wild. Our approach, called Neural Face Rigging (NFR), holds three key properties: (i) NFR's expression space maintains…

Graphics · Computer Science 2023-05-16 Dafei Qin , Jun Saito , Noam Aigerman , Thibault Groueix , Taku Komura

In this research work, we proposed a novel ChildGAN, a pair of GAN networks for generating synthetic boys and girls facial data derived from StyleGAN2. ChildGAN is built by performing smooth domain transfer using transfer learning. It…

Computer Vision and Pattern Recognition · Computer Science 2023-10-11 Muhammad Ali Farooq , Wang Yao , Gabriel Costache , Peter Corcoran

Existing neural rendering-based text-to-3D-portrait generation methods typically make use of human geometry prior and diffusion models to obtain guidance. However, relying solely on geometry information introduces issues such as the Janus…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Yiqian Wu , Hao Xu , Xiangjun Tang , Xien Chen , Siyu Tang , Zhebin Zhang , Chen Li , Xiaogang Jin

Despite recent advances in face recognition using deep learning, severe accuracy drops are observed for large pose variations in unconstrained environments. Learning pose-invariant features is one solution, but needs expensively labeled…

Computer Vision and Pattern Recognition · Computer Science 2017-08-21 Xi Yin , Xiang Yu , Kihyuk Sohn , Xiaoming Liu , Manmohan Chandraker

While current talking head models are capable of generating photorealistic talking head videos, they provide limited pose controllability. Most methods require specific video sequences that should exactly contain the head pose desired,…

Computer Vision and Pattern Recognition · Computer Science 2023-05-19 Kwangho Lee , Patrick Kwon , Myung Ki Lee , Namhyuk Ahn , Junsoo Lee

Movie productions use high resolution 3d characters with complex proprietary rigs to create the highest quality images possible for large displays. Unfortunately, these 3d assets are typically not compatible with real-time graphics engines…

Graphics · Computer Science 2020-03-24 Dominik Borer , Lu Yuhang , Laura Wuelfroth , Jakob Buhmann , Martin Guay

We present a single-image 3D face synthesis technique that can handle challenging facial expressions while recovering fine geometric details. Our technique employs expression analysis for proxy face geometry generation and combines…

Computer Vision and Pattern Recognition · Computer Science 2019-12-04 Anpei Chen , Zhang Chen , Guli Zhang , Ziheng Zhang , Kenny Mitchell , Jingyi Yu

Generative models for 2D images has recently seen tremendous progress in quality, resolution and speed as a result of the efficiency of 2D convolutional architectures. However it is difficult to extend this progress into the 3D domain since…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 Hassan Abu Alhaija , Alara Dirik , André Knörig , Sanja Fidler , Maria Shugrina

We present 3DHumanGAN, a 3D-aware generative adversarial network that synthesizes photorealistic images of full-body humans with consistent appearances under different view-angles and body-poses. To tackle the representational and…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Zhuoqian Yang , Shikai Li , Wayne Wu , Bo Dai

We develop a new method for portrait image editing, which supports fine-grained editing of geometries, colors, lights and shadows using a single neural network model. We adopt a novel asymmetric conditional GAN architecture: the generators…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Linlin Liu , Qian Fu , Fei Hou , Ying He

In this paper, we present an approach for combining non-rigid structure-from-motion (NRSfM) with deep generative models,and propose an efficient framework for discovering trajectories in the latent space of 2D GANs corresponding to changes…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 René Haas , Stella Graßhof , Sami S. Brandt

Efficiently generating a freestyle 3D portrait with high quality and 3D-consistency is a promising yet challenging task. The portrait styles generated by most existing methods are usually restricted by their 3D generators, which are learned…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Tianxiang Ma , Kang Zhao , Jianxin Sun , Yingya Zhang , Jing Dong

The ability of Generative Adversarial Networks to encode rich semantics within their latent space has been widely adopted for facial image editing. However, replicating their success with videos has proven challenging. Sets of high-quality…

Computer Vision and Pattern Recognition · Computer Science 2022-01-24 Rotem Tzaban , Ron Mokady , Rinon Gal , Amit H. Bermano , Daniel Cohen-Or

Existing methods like Neural Radiation Fields (NeRF) and 3D Gaussian Splatting (3DGS) have made significant strides in facial attribute control such as facial animation and components editing, yet they struggle with fine-grained…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Pinxin Liu , Luchuan Song , Daoan Zhang , Hang Hua , Yunlong Tang , Huaijin Tu , Jiebo Luo , Chenliang Xu

The estimation of 3D face shape from a single image must be robust to variations in lighting, head pose, expression, facial hair, makeup, and occlusions. Robustness requires a large training set of in-the-wild images, which by construction,…

Computer Vision and Pattern Recognition · Computer Science 2019-05-17 Soubhik Sanyal , Timo Bolkart , Haiwen Feng , Michael J. Black