中文
相关论文

相关论文: Controlled AutoEncoders to Generate Faces from Voi…

200 篇论文

We present a wav-to-wav generative model for the task of singing voice conversion from any identity. Our method utilizes both an acoustic model, trained for the task of automatic speech recognition, together with melody extracted features…

音频与语音处理 · 电气工程与系统科学 2020-08-10 Adam Polyak , Lior Wolf , Yossi Adi , Yaniv Taigman

Talking face generation has been extensively investigated owing to its wide applicability. The two primary frameworks used for talking face generation comprise a text-driven framework, which generates synchronized speech and talking faces…

计算机视觉与模式识别 · 计算机科学 2023-05-22 Kentaro Mitsui , Yukiya Hono , Kei Sawada

Attribute guided face image synthesis aims to manipulate attributes on a face image. Most existing methods for image-to-image translation can either perform a fixed translation between any two image domains using a single attribute or…

计算机视觉与模式识别 · 计算机科学 2019-05-02 Behzad Bozorgtabar , Mohammad Saeed Rad , Hazım Kemal Ekenel , Jean-Philippe Thiran

The face reenactment is a popular facial animation method where the person's identity is taken from the source image and the facial motion from the driving image. Recent works have demonstrated high quality results by combining the facial…

计算机视觉与模式识别 · 计算机科学 2020-11-10 Soumya Tripathy , Juho Kannala , Esa Rahtu

Animating a static face image with target facial expressions and movements is important in the area of image editing and movie production. This face reenactment process is challenging due to the complex geometry and movement of human faces.…

计算机视觉与模式识别 · 计算机科学 2020-05-14 Hanxiang Hao , Sriram Baireddy , Amy R. Reibman , Edward J. Delp

Despite the significant progress in recent years, very few of the AI-based talking face generation methods attempt to render natural emotions. Moreover, the scope of the methods is majorly limited to the characteristics of the training…

计算机视觉与模式识别 · 计算机科学 2022-05-04 Sanjana Sinha , Sandika Biswas , Ravindra Yadav , Brojeshwar Bhowmick

We propose VecGAN, an image-to-image translation framework for facial attribute editing with interpretable latent directions. Facial attribute editing task faces the challenges of precise attribute editing with controllable strength and…

计算机视觉与模式识别 · 计算机科学 2022-07-08 Yusuf Dalva , Said Fahri Altindis , Aysegul Dundar

We present a new method for improving the performances of variational autoencoder (VAE). In addition to enforcing the deep feature consistent principle thus ensuring the VAE output and its corresponding input images to have similar deep…

计算机视觉与模式识别 · 计算机科学 2019-06-06 Xianxu Hou , Ke Sun , Linlin Shen , Guoping Qiu

Inspired by the impressive performance of recent face image editing methods, several studies have been naturally proposed to extend these methods to the face video editing task. One of the main challenges here is temporal consistency among…

计算机视觉与模式识别 · 计算机科学 2023-03-28 Gyeongman Kim , Hajin Shim , Hyunsu Kim , Yunjey Choi , Junho Kim , Eunho Yang

Blind face restoration is a highly ill-posed problem that often requires auxiliary guidance to 1) improve the mapping from degraded inputs to desired outputs, or 2) complement high-quality details lost in the inputs. In this paper, we…

计算机视觉与模式识别 · 计算机科学 2022-11-02 Shangchen Zhou , Kelvin C. K. Chan , Chongyi Li , Chen Change Loy

This contribution gives an overview of face recogni-tion algorithms, their implementation and practical uses. First, a training set of different persons' faces has to be collected and used to train a face recognizer. The resulting face…

计算机视觉与模式识别 · 计算机科学 2017-07-05 Johannes Reschke , Armin Sehr

The appearances of children are inherited from their parents, which makes it feasible to predict them. Predicting realistic children's faces may help settle many social problems, such as age-invariant face recognition, kinship verification,…

计算机视觉与模式识别 · 计算机科学 2022-04-22 Yuzhi Zhao , Lai-Man Po , Xuehui Wang , Qiong Yan , Wei Shen , Yujia Zhang , Wei Liu , Chun-Kit Wong , Chiu-Sing Pang , Weifeng Ou , Wing-Yin Yu , Buhua Liu

We propose a novel framework for simultaneously generating and manipulating the face images with desired attributes. While the state-of-the-art attribute editing technique has achieved the impressive performance for creating realistic…

计算机视觉与模式识别 · 计算机科学 2018-10-01 Kyungjune Baek , Duhyeon Bang , Hyunjung Shim

Here we present a novel approach to conditioning the SampleRNN generative model for voice conversion (VC). Conventional methods for VC modify the perceived speaker identity by converting between source and target acoustic features. Our…

声音 · 计算机科学 2018-10-30 Cong Zhou , Michael Horgan , Vivek Kumar , Cristina Vasco , Dan Darcy

Generating realistic talking faces is an interesting and long-standing topic in the field of computer vision. Although significant progress has been made, it is still challenging to generate high-quality dynamic faces with personalized…

计算机视觉与模式识别 · 计算机科学 2023-12-06 Bo Ding , Zhenfeng Fan , Shuang Yang , Shihong Xia

Speech-driven facial animation is the process which uses speech signals to automatically synthesize a talking character. The majority of work in this domain creates a mapping from audio features to visual features. This often requires…

音频与语音处理 · 电气工程与系统科学 2018-07-20 Konstantinos Vougioukas , Stavros Petridis , Maja Pantic

Emotional voice conversion (EVC) traditionally targets the transformation of spoken utterances from one emotional state to another, with previous research mainly focusing on discrete emotion categories. This paper departs from the norm by…

音频与语音处理 · 电气工程与系统科学 2023-09-19 Kun Zhou , Berrak Sisman , Carlos Busso , Bin Ma , Haizhou Li

Generating and manipulating human facial images using high-level attributal controls are important and interesting problems. The models proposed in previous work can solve one of these two problems (generation or manipulation), but not both…

计算机视觉与模式识别 · 计算机科学 2017-04-10 Weidong Yin , Yanwei Fu , Leonid Sigal , Xiangyang Xue

We propose an approach to generate images of people given a desired appearance and pose. Disentangled representations of pose and appearance are necessary to handle the compound variability in the resulting generated images. Hence, we…

计算机视觉与模式识别 · 计算机科学 2021-04-27 Mengyao Zhai , Ruizhi Deng , Jiacheng Chen , Lei Chen , Zhiwei Deng , Greg Mori

Recent methods for audio-driven talking head synthesis often optimize neural radiance fields (NeRF) on a monocular talking portrait video, leveraging its capability to render high-fidelity and 3D-consistent novel-view frames. However, they…

计算机视觉与模式识别 · 计算机科学 2024-04-01 Jaehoon Ko , Kyusun Cho , Joungbin Lee , Heeji Yoon , Sangmin Lee , Sangjun Ahn , Seungryong Kim