English
Related papers

Related papers: Privacy-oriented manipulation of speaker represent…

200 papers

Information on speaker characteristics can be useful as side information in improving speaker recognition accuracy. However, such information is often private. This paper investigates how privacy-preserving learning can improve a speaker…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-07 Filip Granqvist , Matt Seigel , Rogier van Dalen , Áine Cahill , Stephen Shum , Matthias Paulik

Disentanglement is the task of learning representations that identify and separate factors that explain the variation observed in data. Disentangled representations are useful to increase the generalizability, explainability, and fairness…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-09 Michael Kuhlmann , Adrian Meise , Fritz Seebauer , Petra Wagner , Reinhold Haeb-Umbach

This study investigates the explainability of embedding representations, specifically those used in modern audio spoofing detection systems based on deep neural networks, known as spoof embeddings. Building on established work in speaker…

Sound · Computer Science 2024-12-25 Xuechen Liu , Junichi Yamagishi , Md Sahidullah , Tomi kinnunen

Speech signals encompass various information across multiple levels including content, speaker, and style. Disentanglement of these information, although challenging, is important for applications such as voice conversion. The contrastive…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-06 Yuying Xie , Michael Kuhlmann , Frederik Rautenberg , Zheng-Hua Tan , Reinhold Haeb-Umbach

Collecting speech data is an important step in training speech recognition systems and other speech-based machine learning models. However, the issue of privacy protection is an increasing concern that must be addressed. The current study…

The use of modern vocoders in an analysis/synthesis pipeline allows us to investigate high-quality voice conversion that can be used for privacy purposes. Here, we propose to transform the speaker embedding and the pitch in order to hide…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-27 Paul-Gauthier Noé , Xiaoxiao Miao , Xin Wang , Junichi Yamagishi , Jean-François Bonastre , Driss Matrouf

In the era of big data, remarkable advancements have been achieved in personalized speech generation techniques that utilize speaker attributes, including voice and speaking style, to generate deepfake speech. This has also amplified global…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-10 Liping Chen , Kong Aik Lee , Zhen-Hua Ling , Xin Wang , Rohan Kumar Das , Tomoki Toda , Haizhou Li

Speaker individuality information is among the most critical elements within speech signals. By thoroughly and accurately modeling this information, it can be utilized in various intelligent speech applications, such as speaker recognition,…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-05 Shuai Wang , Zhengyang Chen , Kong Aik Lee , Yanmin Qian , Haizhou Li

Advancement in speech technology has brought convenience to our life. However, the concern is on the rise as speech signal contains multiple personal attributes, which would lead to either sensitive information leakage or bias toward…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-09 Yu-Lin Huang , Bo-Hao Su , Y. -W. Peter Hong , Chi-Chun Lee

The recently proposed x-vector based anonymization scheme converts any input voice into that of a random pseudo-speaker. In this paper, we present a flexible pseudo-speaker selection technique as a baseline for the first VoicePrivacy…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-19 Brij Mohan Lal Srivastava , Natalia Tomashenko , Xin Wang , Emmanuel Vincent , Junichi Yamagishi , Mohamed Maouche , Aurélien Bellet , Marc Tommasi

Developing a good speaker embedding has received tremendous interest in the speech community, with representations such as i-vector and d-vector demonstrating remarkable performance across various tasks. Despite their widespread adoption, a…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-23 Shuai Wang , Yanmin Qian , Kai Yu

Attribute control in generative tasks aims to modify personal attributes, such as age and gender while preserving the identity information in the source sample. Although significant progress has been made in controlling facial attributes in…

Sound · Computer Science 2025-01-06 Xuyuan Li , Zengqiang Shang. Li Wang , Pengyuan Zhang

Speech embeddings often retain sensitive attributes such as speaker identity, accent, or demographic information, posing risks in biased model training and privacy leakage. We propose WavShape, an information-theoretic speech representation…

Voice anonymization protects speaker privacy by concealing identity while preserving linguistic and paralinguistic content. Self-supervised learning (SSL) representations encode linguistic features but preserve speaker traits. We propose a…

Sound · Computer Science 2025-08-19 Beilong Tang , Xiaoxiao Miao , Xin Wang , Ming Li

Speech data carries a range of personal information, such as the speaker's identity and emotional state. These attributes can be used for malicious purposes. With the development of virtual assistants, a new generation of privacy threats…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-04 Hubert Nourtel , Pierre Champion , Denis Jouvet , Anthony Larcher , Marie Tahon

Speech 'in-the-wild' is a handicap for speaker recognition systems due to the variability induced by real-life conditions, such as environmental noise and the emotional state of the speaker. Taking advantage of the principles of…

Audio and Speech Processing · Electrical Eng. & Systems 2022-05-17 Esther Rituerto-González , Carmen Peláez-Moreno

The emergence of voice-assistant devices ushers in delightful user experiences not just on the smart home front, but also in diverse educational environments from classrooms to personalized-learning/tutoring. However, the use of voice as an…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-23 Mohammad Niknazar , Aditya Vempaty , Ravi Kokku

Privacy and security are major concerns when communicating speech signals to cloud services such as automatic speech recognition (ASR) and speech emotion recognition (SER). Existing solutions for speech anonymization mainly focus on voice…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-31 Minh Tran , Mohammad Soleymani

Most recent speech privacy efforts have focused on anonymizing acoustic speaker attributes but there has not been as much research into protecting information from speech content. We introduce a toy problem that explores an emerging type of…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-09 Jennifer Williams , Karla Pizzi , Paul-Gauthier Noe , Sneha Das

The widespread of powerful personal devices capable of collecting voice of their users has opened the opportunity to build speaker adapted speech recognition system (ASR) or to participate to collaborative learning of ASR. In both cases,…

Computation and Language · Computer Science 2021-11-09 Salima Mdhaffar , Jean-François Bonastre , Marc Tommasi , Natalia Tomashenko , Yannick Estève