English
Related papers

Related papers: SecureSpeech: Prompt-based Speaker and Content Pro…

200 papers

Recently, speech assistant and speech verification have been used in many fields, which brings much benefit and convenience for us. However, when we enjoy these speech applications, our speech may be collected by attackers for speech…

Cryptography and Security · Computer Science 2025-09-03 Yuwen Pu , Zhou Feng , Chunyi Zhou , Jiahao Chen , Chunqiang Hu , Haibo Hu , Shouling Ji

Speaker anonymization systems hide the identity of speakers while preserving other information such as linguistic content and emotions. To evaluate their privacy benefits, attacks in the form of automatic speaker verification (ASV) systems…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-21 Ünal Ege Gaznepoglu , Anna Leschanowsky , Ahmad Aloradi , Prachi Singh , Daniel Tenbrinck , Emanuël A. P. Habets , Nils Peters

Speaker anonymization aims to conceal a speaker's identity while preserving content information in speech. Current mainstream neural-network speaker anonymization systems disentangle speech into prosody-related, content, and speaker…

Sound · Computer Science 2023-09-14 Xiaoxiao Miao , Xin Wang , Erica Cooper , Junichi Yamagishi , Natalia Tomashenko

Text-to-image diffusion models, such as Stable Diffusion, generate highly realistic images from text descriptions. However, the generation of certain content at such high quality raises concerns. A prominent issue is the accurate depiction…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Liang Shi , Jie Zhang , Shiguang Shan

Responsible use of AI demands that we protect sensitive information without undermining the usefulness of data, an imperative that has become acute in the age of large language models. We address this challenge with an on-premise,…

Computation and Language · Computer Science 2026-03-19 Federico Albanese , Pablo Ronco , Nicolás D'Ippolito

The recently proposed x-vector based anonymization scheme converts any input voice into that of a random pseudo-speaker. In this paper, we present a flexible pseudo-speaker selection technique as a baseline for the first VoicePrivacy…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-19 Brij Mohan Lal Srivastava , Natalia Tomashenko , Xin Wang , Emmanuel Vincent , Junichi Yamagishi , Mohamed Maouche , Aurélien Bellet , Marc Tommasi

Prompt-tuning has received attention as an efficient tuning method in the language domain, i.e., tuning a prompt that is a few tokens long, while keeping the large language model frozen, yet achieving comparable performance with…

Cryptography and Security · Computer Science 2023-04-18 Shangyu Xie , Wei Dai , Esha Ghosh , Sambuddha Roy , Dan Schwartz , Kim Laine

Voice anonymization has been developed as a technique for preserving privacy by replacing the speaker's voice in a speech signal with that of a pseudo-speaker, thereby obscuring the original voice attributes from machine recognition and…

Sound · Computer Science 2024-11-13 Rui Wang , Liping Chen , Kong AiK Lee , Zhen-Hua Ling

The trend of scaling up speech generation models poses a threat of biometric information leakage of the identities of the voices in the training data, raising privacy and security concerns. In this paper, we investigate training…

Audio and Speech Processing · Electrical Eng. & Systems 2024-05-21 Wen-Chin Huang , Yi-Chiao Wu , Tomoki Toda

Besides its linguistic content, our speech is rich in biometric information that can be inferred by classifiers. Learning privacy-preserving representations for speech signals enables downstream tasks without sharing unnecessary, private…

Sound · Computer Science 2021-06-18 Dimitrios Stoidis , Andrea Cavallaro

Most existing datasets for speaker identification contain samples obtained under quite constrained conditions, and are usually hand-annotated, hence limited in size. The goal of this paper is to generate a large scale text-independent…

Sound · Computer Science 2020-11-05 Arsha Nagrani , Joon Son Chung , Andrew Zisserman

Privacy-preserving voice protection approaches primarily suppress privacy-related information derived from paralinguistic attributes while preserving the linguistic content. Existing solutions focus particularly on single-speaker scenarios.…

Sound · Computer Science 2025-03-28 Xiaoxiao Miao , Ruijie Tao , Chang Zeng , Xin Wang

The vast majority of approaches to speaker anonymization involve the extraction of fundamental frequency estimates, linguistic features and a speaker embedding which is perturbed to obfuscate the speaker identity before an anonymized speech…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-15 Michele Panariello , Francesco Nespoli , Massimiliano Todisco , Nicholas Evans

Given the speech generation framework that represents the speaker attribute with an embedding vector, asynchronous voice anonymization can be achieved by modifying the speaker embedding derived from the original speech. However, the…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-08 Rui Wang , Liping Chen , Kong Aik Lee , Zhengpeng Zha , Zhenhua Ling

Speech data conveys sensitive speaker attributes like identity or accent. With a small amount of found data, such attributes can be inferred and exploited for malicious purposes: voice cloning, spoofing, etc. Anonymization aims to make the…

Computation and Language · Computer Science 2020-02-14 Brij Mohan Lal Srivastava , Nathalie Vauquier , Md Sahidullah , Aurélien Bellet , Marc Tommasi , Emmanuel Vincent

Privacy and security are major concerns when communicating speech signals to cloud services such as automatic speech recognition (ASR) and speech emotion recognition (SER). Existing solutions for speech anonymization mainly focus on voice…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-31 Minh Tran , Mohammad Soleymani

Customizing voice and speaking style in a speech synthesis system with intuitive and fine-grained controls is challenging, given that little data with appropriate labels is available. Furthermore, editing an existing human's voice also…

Sound · Computer Science 2023-10-27 Florian Lux , Pascal Tilli , Sarina Meyer , Ngoc Thang Vu

Speaker anonymization aims to conceal a speaker's identity without degrading speech quality and intelligibility. Most speaker anonymization systems disentangle the speaker representation from the original speech and achieve anonymization by…

Sound · Computer Science 2023-10-10 Yuanjun Lv , Jixun Yao , Peikun Chen , Hongbin Zhou , Heng Lu , Lei Xie

Most of the existing speaker anonymization research has focused on single-speaker audio, leading to the development of techniques and evaluation metrics optimized for such condition. This study addresses the significant challenge of speaker…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-13 Natalia Tomashenko , Junichi Yamagishi , Xin Wang , Yun Liu , Emmanuel Vincent

In text-to-speech synthesis, the ability to control voice characteristics is vital for various applications. By leveraging thriving text prompt-based generation techniques, it should be possible to enhance the nuanced control of voice…