English
Related papers

Related papers: Facial Expression Video Generation Based-On Spatio…

200 papers

Video diffusion models are able to generate high-quality videos by learning strong spatial-temporal priors on large-scale datasets. In this paper, we aim to investigate whether such priors derived from a generative process are suitable for…

Computer Vision and Pattern Recognition · Computer Science 2024-11-13 Zejia Weng , Xitong Yang , Zhen Xing , Zuxuan Wu , Yu-Gang Jiang

We propose a novel single face image super-resolution method, which named Face Conditional Generative Adversarial Network(FCGAN), based on boundary equilibrium generative adversarial networks. Without taking any facial prior information,…

Computer Vision and Pattern Recognition · Computer Science 2017-07-05 Huang Bin , Chen Weihai , Wu Xingming , Lin Chun-Liang

Fine-grained facial expression manipulation is a challenging problem, as fine-grained expression details are difficult to be captured. Most existing expression manipulation methods resort to discrete expression labels, which mainly edit…

Computer Vision and Pattern Recognition · Computer Science 2020-06-16 Junshu Tang , Zhiwen Shao , Lizhuang Ma

Recent advances in deep learning have significantly pushed the state-of-the-art in photorealistic video animation given a single image. In this paper, we extrapolate those advances to the 3D domain, by studying 3D image-to-video translation…

Computer Vision and Pattern Recognition · Computer Science 2020-07-22 Rolandos Alexandros Potamias , Jiali Zheng , Stylianos Ploumpis , Giorgos Bouritsas , Evangelos Ververas , Stefanos Zafeiriou

Advances in technology have led to the development of methods that can create desired visual multimedia. In particular, image generation using deep learning has been extensively studied across diverse fields. In comparison, video…

Computer Vision and Pattern Recognition · Computer Science 2021-06-29 Doyeon Kim , Donggyu Joo , Junmo Kim

In face-related applications with a public available dataset, synthesizing non-linear facial variations (e.g., facial expression, head-pose, illumination, etc.) through a generative model is helpful in addressing the lack of training data.…

Computer Vision and Pattern Recognition · Computer Science 2018-01-01 Geonmo Gu , Seong Tae Kim , Kihyun Kim , Wissam J. Baddar , Yong Man Ro

Deep generative models have recently presented impressive results in generating realistic face images of random synthetic identities. To generate multiple samples of a certain synthetic identity, previous works proposed to disentangle the…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Fadi Boutros , Marcel Klemt , Meiling Fang , Arjan Kuijper , Naser Damer

Facial expression recognition (FER) aims to analyze emotional states from static images and dynamic sequences, which is pivotal in enhancing anthropomorphic communication among humans, robots, and digital avatars by leveraging AI…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Yan Wang , Shaoqi Yan , Yang Liu , Wei Song , Jing Liu , Yang Chang , Xinji Mai , Xiping Hu , Wenqiang Zhang , Zhongxue Gan

There are many applications of Generative Adversarial Networks (GANs) in fields like computer vision, natural language processing, speech synthesis, and more. Undoubtedly the most notable results have been in the area of image synthesis and…

Computer Vision and Pattern Recognition · Computer Science 2020-11-12 Simranjeet Singh , Rajneesh Sharma , Alan F. Smeaton

While objects from different categories can be reliably decoded from fMRI brain response patterns, it has proved more difficult to distinguish visually similar inputs, such as different instances of the same category. Here, we apply a…

Human-Computer Interaction · Computer Science 2021-02-23 Rufin VanRullen , Leila Reddy

Talking face generation aims to synthesize a sequence of face images that correspond to a clip of speech. This is a challenging task because face appearance variation and semantics of speech are coupled together in the subtle movements of…

Computer Vision and Pattern Recognition · Computer Science 2019-04-24 Hang Zhou , Yu Liu , Ziwei Liu , Ping Luo , Xiaogang Wang

Age progression/regression is a challenging task due to the complicated and non-linear transformation in human aging process. Many researches have shown that both global and local facial features are essential for face representation, but…

Computer Vision and Pattern Recognition · Computer Science 2018-01-26 Peipei Li , Yibo Hu , Qi Li , Ran He , Zhenan Sun

Video generation has achieved rapid progress benefiting from high-quality renderings provided by powerful image generators. We regard the video synthesis task as generating a sequence of images sharing the same contents but varying in…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Jingyuan Zhu , Huimin Ma , Jiansheng Chen , Jian Yuan

In this paper, we propose a talking face generation method that takes an audio signal as input and a short target video clip as reference, and synthesizes a photo-realistic video of the target face with natural lip motions, head poses, and…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Chenxu Zhang , Yifan Zhao , Yifei Huang , Ming Zeng , Saifeng Ni , Madhukar Budagavi , Xiaohu Guo

This work seeks the possibility of generating the human face from voice solely based on the audio-visual data without any human-labeled annotations. To this end, we propose a multi-modal learning framework that links the inference stage and…

Audio and Speech Processing · Electrical Eng. & Systems 2020-04-14 Hyeong-Seok Choi , Changdae Park , Kyogu Lee

The ability to accurately capture and express emotions is a critical aspect of creating believable characters in video games and other forms of entertainment. Traditionally, this animation has been achieved with artistic effort or…

Graphics · Computer Science 2023-07-19 Jack Saunders , Steven Caulkin , Vinay Namboodiri

This paper proposes a talking face generation method named "CP-EB" that takes an audio signal as input and a person image as reference, to synthesize a photo-realistic people talking video with head poses controlled by a short video clip…

Computer Vision and Pattern Recognition · Computer Science 2023-11-16 Jianzong Wang , Yimin Deng , Ziqi Liang , Xulong Zhang , Ning Cheng , Jing Xiao

The field of automatic video generation has received a boost thanks to the recent Generative Adversarial Networks (GANs). However, most existing methods cannot control the contents of the generated video using a text caption, losing their…

Computer Vision and Pattern Recognition · Computer Science 2018-12-06 Shohei Yamamoto , Antonio Tejero-de-Pablos , Yoshitaka Ushiku , Tatsuya Harada

Manipulating facial expressions is a challenging task due to fine-grained shape changes produced by facial muscles and the lack of input-output pairs for supervised learning. Unlike previous methods using Generative Adversarial Networks…

Computer Vision and Pattern Recognition · Computer Science 2020-10-01 Rumeysa Bodur , Binod Bhattarai , Tae-Kyun Kim

The task of face attribute manipulation has found increasing applications, but still remains challenging with the requirement of editing the attributes of a face image while preserving its unique details. In this paper, we choose to combine…

Computer Vision and Pattern Recognition · Computer Science 2021-05-07 Ruoqi Sun , Chen Huang , Jianping Shi , Lizhuang Ma