English
Related papers

Related papers: Adversarial speech for voice privacy protection fr…

200 papers

Sharing real-world speech utterances is key to the training and deployment of voice-based services. However, it also raises privacy risks as speech contains a wealth of personal data. Speaker anonymization aims to remove speaker information…

This paper proposes a zero-shot text-to-speech (TTS) conditioned by a self-supervised speech-representation model acquired through self-supervised learning (SSL). Conventional methods with embedding vectors from x-vector or global style…

Sound · Computer Science 2023-12-19 Kenichi Fujita , Takanori Ashihara , Hiroki Kanagawa , Takafumi Moriya , Yusuke Ijima

Facilitated by the speech generation framework that disentangles speech into content, speaker, and prosody, voice anonymization is accomplished by substituting the original speaker embedding vector with that of a pseudo-speaker. In this…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-04 Zeyan Liu , Liping Chen , Kong Aik Lee , Zhenhua Ling

Natural language processing (NLP) models may leak private information in different ways, including membership inference, reconstruction or attribute inference attacks. Sensitive information may not be explicit in the text, but hidden in…

Computation and Language · Computer Science 2024-07-01 Pedro Faustini , Shakila Mahjabin Tonni , Annabelle McIver , Qiongkai Xu , Mark Dras

Over the last decade, the use of Automatic Speaker Verification (ASV) systems has become increasingly widespread in response to the growing need for secure and efficient identity verification methods. The voice data encompasses a wealth of…

Audio and Speech Processing · Electrical Eng. & Systems 2023-07-06 Oubaïda Chouchane , Michele Panariello , Oualid Zari , Ismet Kerenciler , Imen Chihaoui , Massimiliano Todisco , Melek Önen

Automatic speaker verification (ASV) is one of the core technologies in biometric identification. With the ubiquitous usage of ASV systems in safety-critical applications, more and more malicious attackers attempt to launch adversarial…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-16 Haibin Wu , Xu Li , Andy T. Liu , Zhiyong Wu , Helen Meng , Hung-yi Lee

Most text-to-speech (TTS) methods use high-quality speech corpora recorded in a well-designed environment, incurring a high cost for data collection. To solve this problem, existing noise-robust TTS methods are intended to use noisy speech…

Sound · Computer Science 2022-06-30 Takaaki Saeki , Kentaro Tachibana , Ryuichi Yamamoto

Automatic speech recognition (ASR) models are prevalent, particularly in applications for voice navigation and voice control of domestic appliances. The computational core of ASRs are deep neural networks (DNNs) that have been shown to be…

Sound · Computer Science 2022-04-13 Xiaoliang Wu , Ajitha Rajan

The current privacy evaluation for speaker anonymization often overestimates privacy when a same-gender target selection algorithm (TSA) is used, although this TSA leaks the speaker's gender and should hence be more vulnerable. We…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-21 Carlos Franzreb , Arnab Das , Tim Polzehl , Sebastian Möller

Vibrometry-based side channels pose a significant privacy risk, exploiting sensors like mmWave radars, light sensors, and accelerometers to detect vibrations from sound sources or proximate objects, enabling speech eavesdropping. Despite…

Cryptography and Security · Computer Science 2025-04-11 Jung-Woo Chang , Ke Sun , David Xia , Xinyu Zhang , Farinaz Koushanfar

It is known that deep neural networks are vulnerable to adversarial attacks. Although Automatic Speaker Verification (ASV) built on top of deep neural networks exhibits robust performance in controlled scenarios, many studies confirm that…

Sound · Computer Science 2024-01-17 Li Wang , Jiaqi Li , Yuhao Luo , Jiahao Zheng , Lei Wang , Hao Li , Ke Xu , Chengfang Fang , Jie Shi , Zhizheng Wu

Attacking deep learning based biometric systems has drawn more and more attention with the wide deployment of fingerprint/face/speaker recognition systems, given the fact that the neural networks are vulnerable to the adversarial examples,…

Audio and Speech Processing · Electrical Eng. & Systems 2020-04-08 Jiguo Li , Xinfeng Zhang , Chuanmin Jia , Jizheng Xu , Li Zhang , Yue Wang , Siwei Ma , Wen Gao

Neural Text-to-speech (TTS) synthesis is a powerful technology that can generate speech using neural networks. One of the most remarkable features of TTS synthesis is its capability to produce speech in the voice of different speakers. This…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-19 Vinotha R , Hepsiba D , L. D. Vijay Anand , Deepak John Reji

Audio adversarial examples (AEs) have posed significant security challenges to real-world speaker recognition systems. Most black-box attacks still require certain information from the speaker recognition model to be effective (e.g.,…

Sound · Computer Science 2023-11-21 Rui Duan , Zhe Qu , Leah Ding , Yao Liu , Zhuo Lu

In contemporary society, voice-controlled devices, such as smartphones and home assistants, have become pervasive due to their advanced capabilities and functionality. The always-on nature of their microphones offers users the convenience…

Cryptography and Security · Computer Science 2023-09-27 Yuchen Liu , Apu Kapadia , Donald Williamson

Recent years have seen a surge in the popularity of acoustics-enabled personal devices powered by machine learning. Yet, machine learning has proven to be vulnerable to adversarial examples. A large number of modern systems protect…

Machine Learning · Computer Science 2023-05-30 Shimaa Ahmed , Yash Wani , Ali Shahin Shamsabadi , Mohammad Yaghini , Ilia Shumailov , Nicolas Papernot , Kassem Fawaz

The rapid advancements in AI voice cloning, fueled by machine learning, have significantly impacted text-to-speech (TTS) and voice conversion (VC) fields. While these developments have led to notable progress, they have also raised concerns…

Sound · Computer Science 2025-02-17 Qingyuan Fei , Wenjie Hou , Xuan Hai , Xin Liu

In light of the widespread application of Automatic Speech Recognition (ASR) systems, their security concerns have received much more attention than ever before, primarily due to the susceptibility of Deep Neural Networks. Previous studies…

Sound · Computer Science 2024-05-16 Weifei Jin , Yuxin Cao , Junjie Su , Qi Shen , Kai Ye , Derui Wang , Jie Hao , Ziyao Liu

This work investigates the vulnerability of Gaussian Mixture Model (GMM) i-vector based speaker verification systems to adversarial attacks, and the transferability of adversarial samples crafted from GMM i-vector based systems to x-vector…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-13 Xu Li , Jinghua Zhong , Xixin Wu , Jianwei Yu , Xunying Liu , Helen Meng

We propose PromptTTS++, a prompt-based text-to-speech (TTS) synthesis system that allows control over speaker identity using natural language descriptions. To control speaker identity within the prompt-based TTS framework, we introduce the…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-29 Reo Shimizu , Ryuichi Yamamoto , Masaya Kawamura , Yuma Shirahata , Hironori Doi , Tatsuya Komatsu , Kentaro Tachibana