English
Related papers

Related papers: Preserving spoken content in voice anonymisation w…

200 papers

Non-parallel many-to-many voice conversion remains an interesting but challenging speech processing task. Recently, AutoVC, a conditional autoencoder based method, achieved excellent conversion results by disentangling the speaker identity…

Sound · Computer Science 2022-08-09 Huaizhen Tang , Xulong Zhang , Jianzong Wang , Ning Cheng , Zhen Zeng , Edward Xiao , Jing Xiao

Automatic Speech Understanding (ASU) leverages the power of deep learning models for accurate interpretation of human speech, leading to a wide range of speech applications that enrich the human experience. However, training a robust ASU…

Sound · Computer Science 2023-06-14 Tiantian Feng , Digbalay Bose , Xuan Shi , Shrikanth Narayanan

Privacy in speech and audio has many facets. A particularly under-developed area of privacy in this domain involves consideration for information related to content and context. Speech content can include words and their meaning or even…

Audio and Speech Processing · Electrical Eng. & Systems 2023-01-24 Jennifer Williams , Karla Pizzi , Shuvayanti Das , Paul-Gauthier Noe

Environmental sound recordings often contain intelligible speech, raising privacy concerns that limit analysis, sharing and reuse of data. In this paper, we introduce a method that renders speech unintelligible while preserving both the…

Sound · Computer Science 2025-07-14 Modan Tailleur , Mathieu Lagrange , Pierre Aumond , Vincent Tourre

This work proposes the use of clean speech vocoder parameters as the target for a neural network performing speech enhancement. These parameters have been designed for text-to-speech synthesis so that they both produce high-quality…

Audio and Speech Processing · Electrical Eng. & Systems 2019-04-03 Soumi Maiti , Michael I Mandel

Voice conversion (VC) aims to modify the speaker's identity while preserving the linguistic content. Commonly, VC methods use an encoder-decoder architecture, where disentangling the speaker's identity from linguistic information is…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-19 Philip H. Lee , Ismail Rasim Ulgen , Berrak Sisman

Recent privacy research on large language models (LLMs) has shown that they achieve near-human-level performance at inferring personal data from online texts. With ever-increasing model capabilities, existing text anonymization methods are…

Artificial Intelligence · Computer Science 2025-02-04 Robin Staab , Mark Vero , Mislav Balunović , Martin Vechev

Generally speaking, the main objective when training a neural speech synthesis system is to synthesize natural and expressive speech from the output layer of the neural network without much attention given to the hidden layers. However, by…

Sound · Computer Science 2021-06-28 Hieu-Thi Luong , Junichi Yamagishi

Customizing voice and speaking style in a speech synthesis system with intuitive and fine-grained controls is challenging, given that little data with appropriate labels is available. Furthermore, editing an existing human's voice also…

Sound · Computer Science 2023-10-27 Florian Lux , Pascal Tilli , Sarina Meyer , Ngoc Thang Vu

In this paper, we discuss an important aspect of speech privacy: protecting spoken content. New capabilities from the field of machine learning provide a unique and timely opportunity to revisit speech content protection. There are many…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-14 Jennifer Williams , Junichi Yamagishi , Paul-Gauthier Noe , Cassia Valentini Botinhao , Jean-Francois Bonastre

Substantial improvements have been achieved in recent years in voice conversion, which converts the speaker characteristics of an utterance into those of another speaker without changing the linguistic content of the utterance. Nonetheless,…

Audio and Speech Processing · Electrical Eng. & Systems 2021-05-05 Chien-yu Huang , Yist Y. Lin , Hung-yi Lee , Lin-shan Lee

Privacy preservation has long been a concern in smart acoustic monitoring systems, where speech can be passively recorded along with a target signal in the system's operating environment. In this study, we propose the integration of two…

Sound · Computer Science 2025-05-05 Diep Luong , Minh Tran , Shayan Gharib , Konstantinos Drossos , Tuomas Virtanen

The objective of this work is to train noise-robust speaker embeddings adapted for speaker diarisation. Speaker embeddings play a crucial role in the performance of diarisation systems, but they often capture spurious information such as…

Sound · Computer Science 2022-11-04 You Jin Kim , Hee-Soo Heo , Jee-weon Jung , Youngki Kwon , Bong-Jin Lee , Joon Son Chung

Text-to-Speech (TTS) and Voice Conversion (VC) models have exhibited remarkable performance in generating realistic and natural audio. However, their dark side, audio deepfake poses a significant threat to both society and individuals.…

Cryptography and Security · Computer Science 2024-09-17 Xinfeng Li , Kai Li , Yifan Zheng , Chen Yan , Xiaoyu Ji , Wenyuan Xu

In many practical natural language applications, user data are highly sensitive, requiring anonymous uploads of text data from mobile devices to the cloud without user identifiers. However, the absence of user identifiers restricts the…

Machine Learning · Computer Science 2025-01-13 Yucheng Ding , Yangwenjian Tan , Xiangyu Liu , Chaoyue Niu , Fandong Meng , Jie Zhou , Ning Liu , Fan Wu , Guihai Chen

Automatic Speaker Diarization (ASD) is an enabling technology with numerous applications, which deals with recordings of multiple speakers, raising special concerns in terms of privacy. In fact, in remote settings, where recordings are…

Audio and Speech Processing · Electrical Eng. & Systems 2023-04-19 Francisco Teixeira , Alberto Abad , Bhiksha Raj , Isabel Trancoso

In contemporary society, voice-controlled devices, such as smartphones and home assistants, have become pervasive due to their advanced capabilities and functionality. The always-on nature of their microphones offers users the convenience…

Cryptography and Security · Computer Science 2023-09-27 Yuchen Liu , Apu Kapadia , Donald Williamson

Recently, opportunities to transmit speech data to deep learning models executed in the cloud have increased. This has led to growing concerns about speech privacy, including both speaker-specific information and the linguistic content of…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-25 Kohei Tanaka , Hitoshi Kiya , Sayaka Shiota

The collection and use of personal data are becoming more common in today's data-driven culture. While there are many advantages to this, including better decision-making and service delivery, it also poses significant ethical issues around…

Cryptography and Security · Computer Science 2023-03-23 Constantinos Patsakis , Nikolaos Lykousas

The evaluation of voice anonymisation remains challenging. Current practice relies on automatic speaker verification metrics such as the equal error rate (EER). Performance estimates dependent on the classifier and operating point provide…