English
Related papers

Related papers: Reconstructing faces from voices

200 papers

Voice Conversion (VC) emerged as a significant domain of research in the field of speech synthesis in recent years due to its emerging application in voice-assisting technology, automated movie dubbing, and speech-to-singing conversion to…

Sound · Computer Science 2021-04-27 Sandipan Dhar , Nanda Dulal Jana , Swagatam Das

Facial landmarks constitute the most compressed representation of faces and are known to preserve information such as pose, gender and facial structure present in the faces. Several works exist that attempt to perform high-level…

Computer Vision and Pattern Recognition · Computer Science 2019-01-07 Xing Di , Vishwanath A. Sindagi , Vishal M. Patel

Thanks to the growing availability of spoofing databases and rapid advances in using them, systems for detecting voice spoofing attacks are becoming more and more capable, and error rates close to zero are being reached for the ASVspoof2015…

Audio and Speech Processing · Electrical Eng. & Systems 2018-03-05 Jaime Lorenzo-Trueba , Fuming Fang , Xin Wang , Isao Echizen , Junichi Yamagishi , Tomi Kinnunen

Generative Adversarial Networks (GANs) are now capable of producing synthetic face images of exceptionally high visual quality. In parallel to the development of GANs themselves, efforts have been made to develop metrics to objectively…

Computer Vision and Pattern Recognition · Computer Science 2020-12-22 Richard T. Marriott , Safa Madiouni , Sami Romdhani , Stéphane Gentric , Liming Chen

Given an arbitrary face image and an arbitrary speech clip, the proposed work attempts to generating the talking face video with accurate lip synchronization while maintaining smooth transition of both lip and facial movement over the…

Computer Vision and Pattern Recognition · Computer Science 2019-07-29 Yang Song , Jingwen Zhu , Dawei Li , Xiaolong Wang , Hairong Qi

Automatic synthesis of faces from visual attributes is an important problem in computer vision and has wide applications in law enforcement and entertainment. With the advent of deep generative convolutional neural networks (CNNs), attempts…

Computer Vision and Pattern Recognition · Computer Science 2021-04-08 Xing Di , Vishal M. Patel

Voice conversion (VC) consists of digitally altering the voice of an individual to manipulate part of its content, primarily its identity, while maintaining the rest unchanged. Research in neural VC has accomplished considerable…

Sound · Computer Science 2021-07-28 Laurent Benaroya , Nicolas Obin , Axel Roebel

One of the most significant challenges in statistical signal processing and machine learning is how to obtain a generative model that can produce samples of large-scale data distribution, such as images and speeches. Generative Adversarial…

Computer Vision and Pattern Recognition · Computer Science 2020-05-28 Pegah Salehi , Abdolah Chalechale , Maryam Taghizadeh

In recent years, Generative Adversarial Networks (GANs) have become a hot topic among researchers and engineers that work with deep learning. It has been a ground-breaking technique which can generate new pieces of content of data in a…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Parthak Mehta , Sarthak Mishra , Nikhil Chouhan , Neel Pethani , Ishani Saha

Recent advances in brain-computer interface (BCI) technology, particularly based on generative adversarial networks (GAN), have shown great promise for improving decoding performance for BCI. Within the realm of Brain-Computer Interfaces…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-01 Young-Eun Lee , Seo-Hyun Lee , Soowon Kim , Jung-Sun Lee , Deok-Seon Kim , Seong-Whan Lee

Classical parametric speech coding techniques provide a compact representation for speech signals. This affords a very low transmission rate but with a reduced perceptual quality of the reconstructed signals. Recently, autoregressive deep…

Audio and Speech Processing · Electrical Eng. & Systems 2019-07-02 Ahmed Mustafa , Arijit Biswas , Christian Bergler , Julia Schottenhamml , Andreas Maier

Generative adversary network (GAN) generated high-realistic human faces have been used as profile images for fake social media accounts and are visually challenging to discern from real ones. In this work, we show that GAN-generated faces…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Hui Guo , Shu Hu , Xin Wang , Ming-Ching Chang , Siwei Lyu

As more and more data is collected in various settings across organizations, companies, and countries, there has been an increase in the demand of user privacy. Developing privacy preserving methods for data analytics is thus an important…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-18 David Ericsson , Adam Östberg , Edvin Listo Zec , John Martinsson , Olof Mogren

Designing face recognition systems that are capable of matching face images obtained in the thermal spectrum with those obtained in the visible spectrum is a challenging problem. In this work, we propose the use of semantic-guided…

Computer Vision and Pattern Recognition · Computer Science 2019-03-05 Cunjian Chen , Arun Ross

Face synthesis, including face aging, in particular, has been one of the major topics that witnessed a substantial improvement in image fidelity by using generative adversarial networks (GANs). Most existing face aging approaches divide the…

Computer Vision and Pattern Recognition · Computer Science 2021-05-04 Zeqi Li , Ruowei Jiang , Parham Aarabi

Although Generative Adversarial Networks (GANs) have made significant progress in face synthesis, there lacks enough understanding of what GANs have learned in the latent representation to map a random code to a photo-realistic image. In…

Computer Vision and Pattern Recognition · Computer Science 2020-10-30 Yujun Shen , Ceyuan Yang , Xiaoou Tang , Bolei Zhou

This paper presents an adversarial learning method for recognition-synthesis based non-parallel voice conversion. A recognizer is used to transform acoustic features into linguistic representations while a synthesizer recovers output…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-07 Jing-Xuan Zhang , Zhen-Hua Ling , Li-Rong Dai

Generative Adversarial Networks are proved to be efficient on various kinds of image generation tasks. However, it is still a challenge if we want to generate images precisely. Many researchers focus on how to generate images with one…

Computer Vision and Pattern Recognition · Computer Science 2017-11-30 Ziqiang Zheng , Zhibin Yu , Haiyong Zheng , Chao Wang , Nan Wang

Face synthesis is an important problem in computer vision with many applications. In this work, we describe a new method, namely LandmarkGAN, to synthesize faces based on facial landmarks as input. Facial landmarks are a natural, intuitive,…

Computer Vision and Pattern Recognition · Computer Science 2021-02-09 Pu Sun , Yuezun Li , Honggang Qi , Siwei Lyu

The large domain discrepancy between faces captured in polarimetric (or conventional) thermal and visible domain makes cross-domain face recognition quite a challenging problem for both human-examiners and computer vision algorithms.…

Computer Vision and Pattern Recognition · Computer Science 2017-08-10 He Zhang , Vishal M. Patel , Benjamin S. Riggan , Shuowen Hu