English
Related papers

Related papers: PVP: Personalized Video Prior for Editable Dynamic…

200 papers

The one-shot talking-head synthesis task aims to animate a source image to another pose and expression, which is dictated by a driving frame. Recent methods rely on warping the appearance feature extracted from the source, by using motion…

Computer Vision and Pattern Recognition · Computer Science 2023-05-01 Kangning Liu , Yu-Chuan Su , Wei , Hong , Ruijin Cang , Xuhui Jia

This paper introduces the Attribute-Decomposed GAN, a novel generative model for controllable person image synthesis, which can produce realistic person images with desired human attributes (e.g., pose, head, upper clothes and pants)…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Yifang Men , Yiming Mao , Yuning Jiang , Wei-Ying Ma , Zhouhui Lian

Human image generation is a very challenging task since it is affected by many factors. Many human image generation methods focus on generating human images conditioned on a given pose, while the generated backgrounds are often blurred.In…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Dong Liang , Rui Wang , Xiaowei Tian , Cong Zou

We present PEGASUS, a method for constructing a personalized generative 3D face avatar from monocular video sources. Our generative 3D avatar enables disentangled controls to selectively alter the facial attributes (e.g., hair or nose)…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Hyunsoo Cha , Byungjun Kim , Hanbyul Joo

Unconditional video generation is a challenging task that involves synthesizing high-quality videos that are both coherent and of extended duration. To address this challenge, researchers have used pretrained StyleGAN image generators for…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Yuhan Wang , Liming Jiang , Chen Change Loy

StyleGAN2 is a state-of-the-art network in generating realistic images. Besides, it was explicitly trained to have disentangled directions in latent space, which allows efficient image manipulation by varying latent factors. Editing…

Computer Vision and Pattern Recognition · Computer Science 2020-10-23 Yuri Viazovetskyi , Vladimir Ivashkin , Evgeny Kashin

We present a one-shot method to infer and render a photorealistic 3D representation from a single unposed image (e.g., face portrait) in real-time. Given a single RGB input, our image encoder directly predicts a canonical triplane…

Computer Vision and Pattern Recognition · Computer Science 2023-05-04 Alex Trevithick , Matthew Chan , Michael Stengel , Eric R. Chan , Chao Liu , Zhiding Yu , Sameh Khamis , Manmohan Chandraker , Ravi Ramamoorthi , Koki Nagano

Visual persuasion, which uses visual elements to influence cognition and behaviors, is crucial in fields such as advertising and political communication. With recent advancements in artificial intelligence, there is growing potential to…

Computation and Language · Computer Science 2025-10-29 Junseo Kim , Jongwook Han , Dongmin Choi , Jongwook Yoon , Eun-Ju Lee , Yohan Jo

In this work, we propose TediGAN, a novel framework for multi-modal image generation and manipulation with textual descriptions. The proposed method consists of three components: StyleGAN inversion module, visual-linguistic similarity…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Weihao Xia , Yujiu Yang , Jing-Hao Xue , Baoyuan Wu

Diffusion-based video generation techniques have significantly improved zero-shot talking-head avatar generation, enhancing the naturalness of both head motion and facial expressions. However, existing methods suffer from poor…

Graphics · Computer Science 2025-04-24 Lingzhou Mu , Baiji Liu , Ruonan Zhang , Guiming Mo , Jiawei Jin , Kai Zhang , Haozhi Huang

Predominant techniques on talking head generation largely depend on 2D information, including facial appearances and motions from input face images. Nevertheless, dense 3D facial geometry, such as pixel-wise depth, plays a critical role in…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Fa-Ting Hong , Li Shen , Dan Xu

This paper studies the problem of StyleGAN inversion, which plays an essential role in enabling the pretrained StyleGAN to be used for real image editing tasks. The goal of StyleGAN inversion is to find the exact latent code of the given…

Computer Vision and Pattern Recognition · Computer Science 2022-05-11 Tianyi Wei , Dongdong Chen , Wenbo Zhou , Jing Liao , Weiming Zhang , Lu Yuan , Gang Hua , Nenghai Yu

Feedforward monocular face capture methods seek to reconstruct posed faces from a single image of a person. Current state of the art approaches have the ability to regress parametric 3D face models in real-time across a wide range of…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Kelian Baert , Shrisha Bharadwaj , Fabien Castan , Benoit Maujean , Marc Christie , Victoria Abrevaya , Adnane Boukhayma

To the best of our knowledge, we first present a live system that generates personalized photorealistic talking-head animation only driven by audio signals at over 30 fps. Our system contains three stages. The first stage is a deep neural…

Graphics · Computer Science 2021-09-27 Yuanxun Lu , Jinxiang Chai , Xun Cao

We propose VecGAN, an image-to-image translation framework for facial attribute editing with interpretable latent directions. Facial attribute editing task faces the challenges of precise attribute editing with controllable strength and…

Computer Vision and Pattern Recognition · Computer Science 2022-07-08 Yusuf Dalva , Said Fahri Altindis , Aysegul Dundar

Facial recognition using deep convolutional neural networks relies on the availability of large datasets of face images. Many examples of identities are needed, and for each identity, a large variety of images are needed in order for the…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Richard T. Marriott , Sami Romdhani , Liming Chen

We introduce VIVE3D, a novel approach that extends the capabilities of image-based 3D GANs to video editing and is able to represent the input video in an identity-preserving and temporally consistent way. We propose two new building…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Anna Frühstück , Nikolaos Sarafianos , Yuanlu Xu , Peter Wonka , Tony Tung

Recent advances in deep learning methods have increased the performance of face detection and recognition systems. The accuracy of these models relies on the range of variation provided in the training data. Creating a dataset that…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Shubhajit Basak , Hossein Javidnia , Faisal Khan , Rachel McDonnell , Michael Schukat

The image synthesis technique is relatively well established which can generate facial images that are indistinguishable even by human beings. However, all of these approaches uses gradients to condition the output, resulting in the…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Feng Liu , HanYang Wang , Jiahao Zhang , Ziwang Fu , Aimin Zhou , Jiayin Qi , Zhibin Li

Face synthesis is an important problem in computer vision with many applications. In this work, we describe a new method, namely LandmarkGAN, to synthesize faces based on facial landmarks as input. Facial landmarks are a natural, intuitive,…

Computer Vision and Pattern Recognition · Computer Science 2021-02-09 Pu Sun , Yuezun Li , Honggang Qi , Siwei Lyu