English
Related papers

Related papers: Voice Impersonation using Generative Adversarial N…

200 papers

Speech enhancement involves the distinction of a target speech signal from an intrusive background. Although generative approaches using Variational Autoencoders or Generative Adversarial Networks (GANs) have increasingly been used in…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-17 Martin Strauss , Bernd Edler

Packet loss is a major cause of voice quality degradation in VoIP transmissions with serious impact on intelligibility and user experience. This paper describes a system based on a generative adversarial approach, which aims to repair the…

Audio and Speech Processing · Electrical Eng. & Systems 2023-07-31 Carlo Aironi , Samuele Cornell , Luca Serafini , Stefano Squartini

Recent improvements in Generative Adversarial Neural Networks (GANs) have shown their ability to generate higher quality samples as well as to learn good representations for transfer learning. Most of the representation learning methods…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-02 Kazi Nazmul Haque , Rajib Rana , John H. L. Hansen , Björn Schuller

To improve the experiences of face-to-face conversation with avatar, this paper presents a novel conversation system. It is composed of two sequence-to-sequence models respectively for listening and speaking and a Generative Adversarial…

Computer Vision and Pattern Recognition · Computer Science 2019-08-22 Zezhou Chen , Zhaoxiang Liu , Huan Hu , Jinqiang Bai , Shiguo Lian , Fuyuan Shi , Kai Wang

Attackers may manipulate audio with the intent of presenting falsified reports, changing an opinion of a public figure, and winning influence and power. The prevalence of inauthentic multimedia continues to rise, so it is imperative to…

Sound · Computer Science 2022-05-05 Emily R. Bartusiak , Edward J. Delp

This paper addresses source tracing in synthetic speech-identifying generative systems behind manipulated audio via speaker recognition-inspired pipelines. While prior work focuses on spoofing detection, source tracing lacks robust…

Rapid advancements in generative modeling have made synthetic audio generation easy, making speech-based services vulnerable to spoofing attacks. Consequently, there is a dire need for robust countermeasures more than ever. Existing…

Sound · Computer Science 2025-09-03 Arnab Das , Yassine El Kheir , Carlos Franzreb , Tim Herzig , Tim Polzehl , Sebastian Möller

Linguistic entrainment is a phenomenon where people tend to mimic each other in conversation. The core instrument to quantify entrainment is a linguistic similarity measure between conversational partners. Most of the current similarity…

Computation and Language · Computer Science 2021-09-07 Mingzhi Yu , Diane Litman , Shuang Ma , Jian Wu

This paper is about developing personalized speech synthesis systems with recordings of mildly impaired speech. In particular, we consider consonant and vowel alterations resulted from partial glossectomy, the surgical removal of part of…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-10 Yusheng Tian , Guangyan Zhang , Tan Lee

Voice conversion (VC) consists of digitally altering the voice of an individual to manipulate part of its content, primarily its identity, while maintaining the rest unchanged. Research in neural VC has accomplished considerable…

Sound · Computer Science 2021-07-28 Laurent Benaroya , Nicolas Obin , Axel Roebel

Speech synthesis is an important practical generative modeling problem that has seen great progress over the last few years, with likelihood-based autoregressive neural models now outperforming traditional concatenative systems. A downside…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-26 Alexey A. Gritsenko , Tim Salimans , Rianne van den Berg , Jasper Snoek , Nal Kalchbrenner

Recent successes in generative modeling have accelerated studies on this subject and attracted the attention of researchers. One of the most important methods used to achieve this success is Generative Adversarial Networks (GANs). It has…

Graphics · Computer Science 2022-09-27 Muhammed Pektas , Aybars Ugur

Advances in neural speech synthesis have brought us technology that is not only close to human naturalness, but is also capable of instant voice cloning with little data, and is highly accessible with pre-trained models available.…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-03 Lauri Juvela , Xin Wang

Customizing voice and speaking style in a speech synthesis system with intuitive and fine-grained controls is challenging, given that little data with appropriate labels is available. Furthermore, editing an existing human's voice also…

Sound · Computer Science 2023-10-27 Florian Lux , Pascal Tilli , Sarina Meyer , Ngoc Thang Vu

Recent advances in neural multi-speaker text-to-speech (TTS) models have enabled the generation of reasonably good speech quality with a single model and made it possible to synthesize the speech of a speaker with limited training data.…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-30 Jinhyeok Yang , Jae-Sung Bae , Taejun Bak , Youngik Kim , Hoon-Young Cho

Despite the dramatic success in image generation, Generative Adversarial Networks (GANs) still face great challenges in synthesizing sequences of discrete elements, in particular human language. The difficulty in generator training arises…

Computation and Language · Computer Science 2023-02-24 Yekun Chai , Qiyue Yin , Junge Zhang

In this paper, we explore the possibility of speech synthesis from low quality found data using only limited number of samples of target speaker. We try to extract only the speaker embedding from found data of target speaker unlike previous…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-15 Sunghee Jung , Hoirin Kim

We propose a novel training algorithm for a multi-speaker neural text-to-speech (TTS) model based on multi-task adversarial training. A conventional generative adversarial network (GAN)-based training algorithm significantly improves the…

Sound · Computer Science 2022-09-27 Yusuke Nakai , Yuki Saito , Kenta Udagawa , Hiroshi Saruwatari

The advancements of AI-synthesized human voices have introduced a growing threat of impersonation and disinformation. It is therefore of practical importance to developdetection methods for synthetic human voices. This work proposes a new…

Sound · Computer Science 2023-04-28 Chengzhe Sun , Shan Jia , Shuwei Hou , Ehab AlBadawy , Siwei Lyu

This work addresses the scarcity of annotated hyperspectral data required to train deep neural networks. Especially, we investigate generative adversarial networks and their application to the synthesis of consistent labeled spectra. By…

Neural and Evolutionary Computing · Computer Science 2018-06-08 Nicolas Audebert , Bertrand Le Saux , Sébastien Lefèvre