English
Related papers

Related papers: Depth-Aware Generative Adversarial Network for Tal…

200 papers

Face is one of the most important things for communication with the world around us. It also forms our identity and expressions. Estimating the face structure is a fundamental task in computer vision with applications in different areas…

Computer Vision and Pattern Recognition · Computer Science 2019-10-07 Kimia Dinashi , Ramin Toosi , Mohammad Ali Akhaee

We propose the first approach to automatically and jointly synthesize both the synchronous 3D conversational body and hand gestures, as well as 3D face and head animations, of a virtual character from speech input. Our algorithm uses a CNN…

Computer Vision and Pattern Recognition · Computer Science 2021-02-16 Ikhsanul Habibie , Weipeng Xu , Dushyant Mehta , Lingjie Liu , Hans-Peter Seidel , Gerard Pons-Moll , Mohamed Elgharib , Christian Theobalt

Recent works have shown how realistic talking face images can be obtained under the supervision of geometry guidance, e.g., facial landmark or boundary. To alleviate the demand for manual annotations, in this paper, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Xianfang Zeng , Yusu Pan , Mengmeng Wang , Jiangning Zhang , Yong Liu

Recent advances in deep convolutional neural networks (DCNNs) have shown impressive performance improvements on thermal to visible face synthesis and matching problems. However, current DCNN-based synthesis models do not perform well on…

Computer Vision and Pattern Recognition · Computer Science 2022-01-14 Xing Di , Shuowen Hu , Vishal M. Patel

We present LR-GAN: an adversarial image generation model which takes scene structure and context into account. Unlike previous generative adversarial networks (GANs), the proposed GAN learns to generate image background and foregrounds…

Computer Vision and Pattern Recognition · Computer Science 2017-08-03 Jianwei Yang , Anitha Kannan , Dhruv Batra , Devi Parikh

We propose a novel framework for simultaneously generating and manipulating the face images with desired attributes. While the state-of-the-art attribute editing technique has achieved the impressive performance for creating realistic…

Computer Vision and Pattern Recognition · Computer Science 2018-10-01 Kyungjune Baek , Duhyeon Bang , Hyunjung Shim

Talking head video generation aims to animate a human face in a still image with dynamic poses and expressions using motion information derived from a target-driving video, while maintaining the person's identity in the source image.…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Fa-Ting Hong , Dan Xu

Recent advances in deep learning have significantly pushed the state-of-the-art in photorealistic video animation given a single image. In this paper, we extrapolate those advances to the 3D domain, by studying 3D image-to-video translation…

Computer Vision and Pattern Recognition · Computer Science 2020-07-22 Rolandos Alexandros Potamias , Jiali Zheng , Stylianos Ploumpis , Giorgos Bouritsas , Evangelos Ververas , Stefanos Zafeiriou

Although Generative Adversarial Network (GAN) can be used to generate the realistic image, improper use of these technologies brings hidden concerns. For example, GAN can be used to generate a tampered video for specific people and…

Multimedia · Computer Science 2018-10-19 Chih-Chung Hsu , Chia-Yen Lee , Yi-Xiu Zhuang

NeRF-based 3D-aware Generative Adversarial Networks (GANs) like EG3D or GIRAFFE have shown very high rendering quality under large representational variety. However, rendering with Neural Radiance Fields poses challenges for 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Florian Barthel , Arian Beckmann , Wieland Morgenstern , Anna Hilsmann , Peter Eisert

Advances in face rotation, along with other face-based generative tasks, are more frequent as we advance further in topics of deep learning. Even as impressive milestones are achieved in synthesizing faces, the importance of preserving…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Yu Yin , Joseph P. Robinson , Songyao Jiang , Yue Bai , Can Qin , Yun Fu

Radiance fields have demonstrated impressive performance in synthesizing lifelike 3D talking heads. However, due to the difficulty in fitting steep appearance changes, the prevailing paradigm that presents facial motions by directly…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Jiahe Li , Jiawei Zhang , Xiao Bai , Jin Zheng , Xin Ning , Jun Zhou , Lin Gu

Recent work has shown significant progress in the direction of synthetic data generation using Generative Adversarial Networks (GANs). GANs have been applied in many fields of computer vision including text-to-image conversion, domain…

Computer Vision and Pattern Recognition · Computer Science 2019-03-07 Mkhuseli Ngxande , Jules-Raymond Tapamo , Michael Burke

Modern 3D generation methods can rapidly create shapes from sparse or single views, but their outputs often lack geometric detail due to computational constraints. We present DetailGen3D, a generative approach specifically designed to…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Ken Deng , Yuan-Chen Guo , Jingxiang Sun , Zi-Xin Zou , Yangguang Li , Xin Cai , Yan-Pei Cao , Yebin Liu , Ding Liang

Recent advances in generative adversarial networks (GANs) have demonstrated the capabilities of generating stunning photo-realistic portrait images. While some prior works have applied such image GANs to unconditional 2D portrait video…

Computer Vision and Pattern Recognition · Computer Science 2023-06-22 Zhongcong Xu , Jianfeng Zhang , Jun Hao Liew , Wenqing Zhang , Song Bai , Jiashi Feng , Mike Zheng Shou

Head avatar reenactment focuses on creating animatable personal avatars from monocular videos, serving as a foundational element for applications like social signal understanding, gaming, human-machine interaction, and computer vision.…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Wei Liang , Hui Yu , Derui Ding , Rachael E. Jack , Philippe G. Schyns

Significant progress has been made in talking-face video generation research; however, precise lip-audio synchronization and high visual quality remain challenging in editing lip shapes based on input audio. This paper introduces JoyGen, a…

Computer Vision and Pattern Recognition · Computer Science 2025-01-06 Qili Wang , Dajiang Wu , Zihang Xu , Junshi Huang , Jun Lv

Automatic 3D facial texture generation has gained significant interest recently. Existing approaches may not support the traditional physically based rendering pipeline or rely on 3D data captured by Light Stage. Our key contribution is a…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Chi Wang , Junming Huang , Rong Zhang , Qi Wang , Haotian Yang , Haibin Huang , Chongyang Ma , Weiwei Xu

The recent surge in popularity of deep generative models for 3D objects has highlighted the need for more efficient training methods, particularly given the difficulties associated with training with conventional 3D representations, such as…

Computer Vision and Pattern Recognition · Computer Science 2024-08-23 Adam Kania , Artur Kasymov , Jakub Kościukiewicz , Artur Górak , Marcin Mazur , Maciej Zięba , Przemysław Spurek

Generative adversarial network (GAN) has been shown to be useful in various applications, such as image recognition, text processing and scientific computing, due its strong ability to learn complex data distributions. In this study, a…

Geophysics · Physics 2021-09-14 Tianhao He , Dongxiao Zhang