English
Related papers

Related papers: Single and Multi-Speaker Cloned Voice Detection: F…

200 papers

Speaker verification systems have been used in many production scenarios in recent years. Unfortunately, they are still highly prone to different kinds of spoofing attacks such as voice conversion and speech synthesis, etc. In this paper,…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-07 Junxiao Xue , Hao Zhou , Yabo Wang

Current text-to-speech algorithms produce realistic fakes of human voices, making deepfake detection a much-needed area of research. While researchers have presented various techniques for detecting audio spoofs, it is often unclear exactly…

Spoof diarization identifies ``what spoofed when" in a given speech by temporally locating spoofed regions and determining their manipulation techniques. As a first step toward this task, prior work proposed a two-branch model for…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-17 Kyo-Won Koo , Chan-yeong Lim , Jee-weon Jung , Hye-jin Shim , Ha-Jin Yu

We propose to implement speech enhancement by the regeneration of clean speech from a salient representation extracted from the noisy signal. The network that extracts salient features is trained using a set of weight-sharing clones of the…

Audio and Speech Processing · Electrical Eng. & Systems 2019-09-12 Michael Chinen , W. Bastiaan Kleijn , Felicia S. C. Lim , Jan Skoglund

The goal of voice conversion is to transform source speech into a target voice, keeping the content unchanged. In this paper, we focus on self-supervised representation learning for voice conversion. Specifically, we compare discrete and…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-09 Benjamin van Niekerk , Marc-André Carbonneau , Julian Zaïdi , Mathew Baas , Hugo Seuté , Herman Kamper

Speaker verification is a task of confirming an individual's identity through the analysis of their voice. Whispered speech differs from phonated speech in acoustic characteristics, which degrades the performance of speaker verification…

Sound · Computer Science 2026-05-08 Magdalena Gołębiowska , Piotr Syga

Voice conversion is a challenging task which transforms the voice characteristics of a source speaker to a target speaker without changing linguistic content. Recently, there have been many works on many-to-many Voice Conversion (VC) based…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-23 Manh Luong , Viet Anh Tran

Speech cloning technology is becoming more sophisticated thanks to the advances in machine learning. Researchers have successfully implemented natural-sounding English speech synthesis and good English speech cloning by some effective…

Sound · Computer Science 2022-03-08 Qingyu Xing , Xiaohan Ma

This paper proposes an interesting voice and accent joint conversion approach, which can convert an arbitrary source speaker's voice to a target speaker with non-native accent. This problem is challenging as each target speaker only has…

Sound · Computer Science 2020-11-18 Zhichao Wang , Wenshuo Ge , Xiong Wang , Shan Yang , Wendong Gan , Haitao Chen , Hai Li , Lei Xie , Xiulin Li

The task of few-shot style transfer for voice cloning in text-to-speech (TTS) synthesis aims at transferring speaking styles of an arbitrary source speaker to a target speaker's voice using very limited amount of neutral data. This is a…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-16 Songxiang Liu , Dan Su , Dong Yu

Voice anti-spoofing aims at classifying a given utterance either as a bonafide human sample, or a spoofing attack (e.g. synthetic or replayed sample). Many anti-spoofing methods have been proposed but most of them fail to generalize across…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-23 Bhusan Chettri , Rosa González Hautamäki , Md Sahidullah , Tomi Kinnunen

Generally speaking, the main objective when training a neural speech synthesis system is to synthesize natural and expressive speech from the output layer of the neural network without much attention given to the hidden layers. However, by…

Sound · Computer Science 2021-06-28 Hieu-Thi Luong , Junichi Yamagishi

Speaker anonymization seeks to conceal a speaker's identity while preserving the utility of their speech. The achieved privacy is commonly evaluated with a speaker recognition model trained on anonymized speech. Although this represents a…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-26 Carlos Franzreb , Arnab Das , Tim Polzehl , Sebastian Möller

Recent advances in foundation models have enabled audio-generative models that produce high-fidelity sounds associated with music, events, and human actions. Despite the success achieved in modern audio-generative models, the conventional…

Sound · Computer Science 2024-08-30 Tiantian Feng , Dimitrios Dimitriadis , Shrikanth Narayanan

Speech synthesis technology has posed a serious threat to speaker verification systems. Currently, the most effective fake audio detection methods utilize pretrained models, and integrating features from various layers of pretrained model…

Lies and deception are common phenomena in society, both in our private and professional lives. However, humans are notoriously bad at accurate deception detection. Based on the literature, human accuracy of distinguishing between lies and…

Computer Vision and Pattern Recognition · Computer Science 2018-12-31 Minh Ngô , Burak Mandira , Selim Fırat Yılmaz , Ward Heij , Sezer Karaoglu , Henri Bouma , Hamdi Dibeklioglu , Theo Gevers

Recent advances in AI-generated voices have intensified the challenge of detecting deepfake audio, posing risks for scams and the spread of disinformation. To tackle this issue, we establish the largest public voice dataset to date, named…

In this paper, we focus on improving the performance of the text-dependent speaker verification system in the scenario of limited training data. The speaker verification system deep learning based text-dependent generally needs a large…

Sound · Computer Science 2020-11-24 Xiaoyi Qin , Yaogen Yang , Lin Yang , Xuyang Wang , Junjie Wang , Ming Li

Voice cloning (VC)-resistant watermarking is an emerging technique for tracing and preventing unauthorized cloning. Existing methods effectively trace traditional VC models by training them on watermarked audio but fail in zero-shot VC…

Sound · Computer Science 2025-06-02 Haiyun Li , Zhiyong Wu , Xiaofeng Xie , Jingran Xie , Yaoxun Xu , Hanyang Peng

Automatic speech recognition systems have created exciting possibilities for applications, however they also enable opportunities for systematic eavesdropping. We propose a method to camouflage a person's voice over-the-air from these…

Sound · Computer Science 2022-02-18 Mia Chiquier , Chengzhi Mao , Carl Vondrick