English
Related papers

Related papers: Private kNN-VC: Interpretable Anonymization of Con…

200 papers

Voice conversion (VC) is a task that transforms the source speaker's timbre, accent, and tones in audio into another one's while preserving the linguistic content. It is still a challenging work, especially in a one-shot setting.…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-09 Da-Yi Wu , Yen-Hao Chen , Hung-Yi Lee

The performance of a voice anonymization system is typically measured according to its ability to hide the speaker's identity and keep the data's utility for downstream tasks. This means that the requirements the anonymization should…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-11 Sarina Meyer , Ngoc Thang Vu

In our previous work, we proposed a language-independent speaker anonymization system based on self-supervised learning models. Although the system can anonymize speech data of any language, the anonymization was imperfect, and the speech…

Sound · Computer Science 2022-03-29 Xiaoxiao Miao , Xin Wang , Erica Cooper , Junichi Yamagishi , Natalia Tomashenko

Any-to-any voice conversion aims to transform source speech into a target voice with just a few examples of the target speaker as a reference. Recent methods produce convincing conversions, but at the cost of increased complexity -- making…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-31 Matthew Baas , Benjamin van Niekerk , Herman Kamper

Advances in speech technology now allow unprecedented access to personally identifiable information through speech. To protect such information, the differential privacy field has explored ways to anonymize speech while preserving its…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-06 Zexin Cai , Henry Li Xinyuan , Ashi Garg , Leibny Paola García-Perera , Kevin Duh , Sanjeev Khudanpur , Nicholas Andrews , Matthew Wiesner

The accuracy of automated speaker recognition is negatively impacted by change in emotions in a person's speech. In this paper, we hypothesize that speaker identity is composed of various vocal style factors that may be learned from…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-04 Morgan Sandler , Arun Ross

Neural networks are commonly known to be vulnerable to adversarial attacks mounted through subtle perturbation on the input data. Recent development in voice-privacy protection has shown the positive use cases of the same technique to…

Sound · Computer Science 2024-12-13 Chenyang Guo , Liping Chen , Zhuhai Li , Kong Aik Lee , Zhen-Hua Ling , Wu Guo

Given the increasing privacy concerns from identity theft and the re-identification of speakers through content in the speech field, this paper proposes a prompt-based speech generation pipeline that ensures dual anonymization of both…

Sound · Computer Science 2025-07-11 Belinda Soh Hui Hui , Xiaoxiao Miao , Xin Wang

Unlike other data modalities such as text and vision, speech does not lend itself to easy interpretation. While lay people can understand how to describe an image or sentence via perception, non-expert descriptions of speech often end at…

Sound · Computer Science 2023-10-05 Robin Netzorg , Bohan Yu , Andrea Guzman , Peter Wu , Luna McNulty , Gopala Anumanchipalli

Voice recognition and speaker identification are vital for applications in security and personal assistants. This paper presents a lightweight 1D-Convolutional Neural Network (1D-CNN) designed to perform speaker identification on minimal…

Sound · Computer Science 2024-11-25 Irfan Nafiz Shahan , Pulok Ahmed Auvi

An automatic speaker verification system aims to verify the speaker identity of a speech signal. However, a voice conversion system could manipulate a person's speech signal to make it sound like another speaker's voice and deceive the…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-02 Danwei Cai , Zexin Cai , Ming Li

The recently proposed x-vector based anonymization scheme converts any input voice into that of a random pseudo-speaker. In this paper, we present a flexible pseudo-speaker selection technique as a baseline for the first VoicePrivacy…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-19 Brij Mohan Lal Srivastava , Natalia Tomashenko , Xin Wang , Emmanuel Vincent , Junichi Yamagishi , Mohamed Maouche , Aurélien Bellet , Marc Tommasi

Children are one of the most under-represented groups in speech technologies, as well as one of the most vulnerable in terms of privacy. Despite this, anonymization techniques targeting this population have received little attention. In…

Computers and Society · Computer Science 2025-06-05 Ajinkya Kulkarni , Francisco Teixeira , Enno Hermann , Thomas Rolland , Isabel Trancoso , Mathew Magimai Doss

Here we present a novel approach to conditioning the SampleRNN generative model for voice conversion (VC). Conventional methods for VC modify the perceived speaker identity by converting between source and target acoustic features. Our…

Sound · Computer Science 2018-10-30 Cong Zhou , Michael Horgan , Vivek Kumar , Cristina Vasco , Dan Darcy

In a conventional voice conversion (VC) framework, a VC model is often trained with a clean dataset consisting of speech data carefully recorded and selected by minimizing background interference. However, collecting such a high-quality…

Sound · Computer Science 2021-09-23 Chao Xie , Yi-Chiao Wu , Patrick Lumban Tobing , Wen-Chin Huang , Tomoki Toda

Voice anonymization protects speaker privacy by concealing identity while preserving linguistic and paralinguistic content. Self-supervised learning (SSL) representations encode linguistic features but preserve speaker traits. We propose a…

Sound · Computer Science 2025-08-19 Beilong Tang , Xiaoxiao Miao , Xin Wang , Ming Li

Speaker identification (SI) determines a speaker's identity based on their spoken utterances. Previous work indicates that SI deep neural networks (DNNs) are vulnerable to backdoor attacks. Backdoor attacks involve embedding hidden triggers…

Cryptography and Security · Computer Science 2024-09-19 Coen Schoof , Stefanos Koffas , Mauro Conti , Stjepan Picek

Speaker anonymization aims to protect the privacy of speakers while preserving spoken linguistic information from speech. Current mainstream neural network speaker anonymization systems are complicated, containing an F0 extractor, speaker…

Sound · Computer Science 2022-04-28 Xiaoxiao Miao , Xin Wang , Erica Cooper , Junichi Yamagishi , Natalia Tomashenko

Speaker verification is a task of confirming an individual's identity through the analysis of their voice. Whispered speech differs from phonated speech in acoustic characteristics, which degrades the performance of speaker verification…

Sound · Computer Science 2026-05-08 Magdalena Gołębiowska , Piotr Syga

We present results and analyses from the third VoicePrivacy Challenge held in 2024, which focuses on advancing voice anonymization technologies. The task was to develop a voice anonymization system for speech data that conceals a speaker's…