English
Related papers

Related papers: Exploring VQ-VAE with Prosody Parameters for Speak…

200 papers

Voice conversion for speaker anonymization is an emerging concept for privacy protection. In a deep learning setting, this is achieved by extracting multiple features from speech, altering the speaker identity, and waveform synthesis.…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-30 Ünal Ege Gaznepoglu , Nils Peters

In recent years, the rapid progress in speaker verification (SV) technology has been driven by the extraction of speaker representations based on deep learning. However, such representations are still vulnerable to emotion variability. To…

Sound · Computer Science 2025-05-27 Jingguang Tian , Xinhui Hu , Xinkang Xu

In recent years, the need for privacy preservation when manipulating or storing personal data, including speech , has become a major issue. In this paper, we present a system addressing the speaker-level anonymization problem. We propose…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-29 Francesco Nespoli , Daniel Barreda , Joerg Bitzer , Patrick A. Naylor

The goal of voice anonymization is to modify an audio such that the true identity of its speaker is hidden. Research on this task is typically limited to the same English read speech datasets, thus the efficacy of current methods for other…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-03 Sarina Meyer , Ekaterina Kolos , Ngoc Thang Vu

In recent years, neural network based methods have been proposed as a method that cangenerate representations from music, but they are not human readable and hardly analyzable oreditable by a human. To address this issue, we propose a novel…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-29 Jinsung Kim , Yeong-Seok Jeong , Woosung Choi , Jaehwa Chung , Soonyoung Jung

This paper proposes a non-parallel many-to-many voice conversion (VC) method using a variant of the conditional variational autoencoder (VAE) called an auxiliary classifier VAE (ACVAE). The proposed method has three key features. First, it…

Machine Learning · Statistics 2020-10-13 Hirokazu Kameoka , Takuhiro Kaneko , Kou Tanaka , Nobukatsu Hojo

Inspired by the success of deep neural networks (DNNs) in speech processing, this paper presents Deep Vocoder, a direct end-to-end low bit rate speech compression method with deep autoencoder (DAE). In Deep Vocoder, DAE is used for…

Multimedia · Computer Science 2019-05-15 Gang Min , Changqing Zhang , Xiongwei Zhang , Wei Tan

In this paper, we present a Distribution-Preserving Voice Anonymization technique, as our submission to the VoicePrivacy Challenge 2020. We observe that the challenge baseline system generates fake X-vectors which are very similar to each…

Sound · Computer Science 2021-01-06 Henry Turner , Giulio Lovisotto , Ivan Martinovic

Voice Conversion (VC) for unseen speakers, also known as zero-shot VC, is an attractive research topic as it enables a range of applications like voice customizing, animation production, and others. Recent work in this area made progress…

Sound · Computer Science 2022-06-01 Shijun Wang , Dimche Kostadinov , Damian Borth

Voice anonymization aims to conceal speaker identity and attributes while preserving intelligibility, but current evaluations rely almost exclusively on Equal Error Rate (EER) that obscures whether adversaries can mount high-precision…

Cryptography and Security · Computer Science 2026-01-27 Efthymios Tsaprazlis , Thanathai Lertpetchpun , Tiantian Feng , Sai Praneeth Karimireddy , Shrikanth Narayanan

Voice privacy approaches that preserve the anonymity of speakers modify speech in an attempt to break the link with the true identity of the speaker. Current benchmarks measure speaker protection based on signal-to-signal comparisons. In…

Sound · Computer Science 2026-03-25 Mehtab Ur Rahman , Martha Larson , Cristian Tejedor-Garcia

Emotional voice conversion aims to convert the emotion of speech from one state to another while preserving the linguistic content and speaker identity. The prior studies on emotional voice conversion are mostly carried out under the…

Sound · Computer Science 2020-10-14 Kun Zhou , Berrak Sisman , Mingyang Zhang , Haizhou Li

Emotional voice conversion (VC) aims to convert a neutral voice to an emotional (e.g. happy) one while retaining the linguistic information and speaker identity. We note that the decoupling of emotional features from other speech…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-05 Zhaojie Luo , Shoufeng Lin , Rui Liu , Jun Baba , Yuichiro Yoshikawa , Ishiguro Hiroshi

Speaker anonymization aims to protect the privacy of speakers while preserving spoken linguistic information from speech. Current mainstream neural network speaker anonymization systems are complicated, containing an F0 extractor, speaker…

Sound · Computer Science 2022-04-28 Xiaoxiao Miao , Xin Wang , Erica Cooper , Junichi Yamagishi , Natalia Tomashenko

The growing reliance on large-scale speech data has made privacy protection a critical concern. However, existing anonymization approaches often degrade data utility, for example by disrupting acoustic continuity or reducing vocal…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-21 Yunchong Xiao , Yuxiang Zhao , Ziyang Ma , Shuai Wang , Kai Yu , Jiachun Liao , Xie Chen

Speech data conveys sensitive speaker attributes like identity or accent. With a small amount of found data, such attributes can be inferred and exploited for malicious purposes: voice cloning, spoofing, etc. Anonymization aims to make the…

Computation and Language · Computer Science 2020-02-14 Brij Mohan Lal Srivastava , Nathalie Vauquier , Md Sahidullah , Aurélien Bellet , Marc Tommasi , Emmanuel Vincent

Recent advances in discrete audio codecs have significantly improved speech representation modeling, while codec language models have enabled in-context learning for zero-shot speech synthesis. Inspired by this, we propose a voice…

Sound · Computer Science 2025-09-30 Junchuan Zhao , Xintong Wang , Ye Wang

Voice anonymization masks vocal traits while preserving linguistic content, which may still leak speaker-specific patterns. To assess and strengthen privacy evaluation, we propose a dual-stream attacker that fuses spectral and…

Sound · Computer Science 2026-03-17 Ridwan Arefeen , Xiaoxiao Miao , Rong Tong , Aik Beng Ng , Simon See , Timothy Liu

The expressive quality of synthesized speech for audiobooks is limited by generalized model architecture and unbalanced style distribution in the training data. To address these issues, in this paper, we propose a self-supervised style…

Sound · Computer Science 2023-12-20 Xueyuan Chen , Xi Wang , Shaofei Zhang , Lei He , Zhiyong Wu , Xixin Wu , Helen Meng

Speaker embeddings extracted from voice recordings have been proven valuable for dementia detection. However, by their nature, these embeddings contain identifiable information which raises privacy concerns. In this work, we aim to…

Sound · Computer Science 2024-07-08 Dominika Woszczyk , Ranya Aloufi , Soteris Demetriou