English
Related papers

Related papers: A Speech Representation Anonymization Framework vi…

200 papers

As users increasingly rely on cloud-based computing services, it is important to ensure that uploaded speech data remains private. Existing solutions rely either on server-side methods or focus on hiding speaker identity. While these…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-26 Peter Wu , Paul Pu Liang , Jiatong Shi , Ruslan Salakhutdinov , Shinji Watanabe , Louis-Philippe Morency

The remarkable success of machine learning has fostered a growing number of cloud-based intelligent services for mobile users. Such a service requires a user to send data, e.g. image, voice and video, to the provider, which presents a…

Machine Learning · Computer Science 2020-06-12 Sicong Liu , Junzhao Du , Anshumali Shrivastava , Lin Zhong

Information on speaker characteristics can be useful as side information in improving speaker recognition accuracy. However, such information is often private. This paper investigates how privacy-preserving learning can improve a speaker…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-07 Filip Granqvist , Matt Seigel , Rogier van Dalen , Áine Cahill , Stephen Shum , Matthias Paulik

In the era of big data, remarkable advancements have been achieved in personalized speech generation techniques that utilize speaker attributes, including voice and speaking style, to generate deepfake speech. This has also amplified global…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-10 Liping Chen , Kong Aik Lee , Zhen-Hua Ling , Xin Wang , Rohan Kumar Das , Tomoki Toda , Haizhou Li

Recent advances in machine learning techniques are enabling Automated Speech Recognition (ASR) more accurate and practical. The evidence of this can be seen in the rising number of smart devices with voice processing capabilities. More and…

Cryptography and Security · Computer Science 2022-03-15 Yogachandran Rahulamathavan

The goal of self-supervised learning (SSL) for automatic speech recognition (ASR) is to learn good speech representations from a large amount of unlabeled speech for the downstream ASR task. However, most SSL frameworks do not consider…

Computation and Language · Computer Science 2022-01-27 Yiming Wang , Jinyu Li , Heming Wang , Yao Qian , Chengyi Wang , Yu Wu

Voice input has been tremendously improving the user experience of mobile devices by freeing our hands from typing on the small screen. Speech recognition is the key technology that powers voice input, and it is usually outsourced to the…

Cryptography and Security · Computer Science 2017-12-01 Jianwei Qian , Haohua Du , Jiahui Hou , Linlin Chen , Taeho Jung , Xiang-Yang Li , Yu Wang , Yanbo Deng

In a data-centric era, concerns regarding privacy and ethical data handling grow as machine learning relies more on personal information. This empirical study investigates the privacy, generalization, and stability of deep learning models…

Machine Learning · Computer Science 2023-11-13 Elaheh Jafarigol , Theodore Trafalis

In this paper, we present AltVoice -- a system designed to help user's protect their privacy when using remotely accessed voice services. The system allows a user to conceal their true voice identity information with no cooperation from the…

Cryptography and Security · Computer Science 2022-02-15 Henry Turner , Giulio Lovisotto , Simon Eberz , Ivan Martinovic

This paper addresses the problem of automatic speech recognition (ASR) of a target speaker in background speech. The novelty of our approach is that we focus on a wakeup keyword, which is usually used for activating ASR systems like smart…

Audio and Speech Processing · Electrical Eng. & Systems 2018-11-08 Yusuke Kida , Dung Tran , Motoi Omachi , Toru Taniguchi , Yuya Fujita

Over the last decade, the use of Automatic Speaker Verification (ASV) systems has become increasingly widespread in response to the growing need for secure and efficient identity verification methods. The voice data encompasses a wealth of…

Audio and Speech Processing · Electrical Eng. & Systems 2023-07-06 Oubaïda Chouchane , Michele Panariello , Oualid Zari , Ismet Kerenciler , Imen Chihaoui , Massimiliano Todisco , Melek Önen

Personalized speech enhancement (PSE) models utilize additional cues, such as speaker embeddings like d-vectors, to remove background noise and interfering speech in real-time and thus improve the speech quality of online video conferencing…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-20 Sefik Emre Eskimez , Takuya Yoshioka , Huaming Wang , Xiaofei Wang , Zhuo Chen , Xuedong Huang

In recent years, the increasing availability of personal data has raised concerns regarding privacy and security. One of the critical processes to address these concerns is data anonymization, which aims to protect individual privacy and…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Fabio Hellmann , Silvan Mertes , Mohamed Benouis , Alexander Hustinx , Tzung-Chien Hsieh , Cristina Conati , Peter Krawitz , Elisabeth André

Our voice encodes a uniquely identifiable pattern which can be used to infer private attributes, such as gender or identity, that an individual might wish not to reveal when using a speech recognition service. To prevent attribute inference…

Sound · Computer Science 2022-07-05 Dimitrios Stoidis , Andrea Cavallaro

We revisit the privacy-utility tradeoff of x-vector speaker anonymization. Existing approaches quantify privacy through training complex speaker verification or identification models that are later used as attacks. Instead, we propose a…

Cryptography and Security · Computer Science 2025-05-15 Luke Bauer , Wenxuan Bao , Malvika Jadhav , Vincent Bindschaedler

An effective way to increase the noise robustness of automatic speech recognition is to label noisy speech features as either reliable or unreliable (missing) prior to decoding, and to replace the missing ones by clean speech estimates. We…

Sound · Computer Science 2009-01-19 J. F. Gemmeke , B. Cranen

Speech emotion sensing in communication networks has a wide range of applications in real life. In these applications, voice data are transmitted from the user to the central server for storage, processing, and decision making. However,…

In this paper, we present a Distribution-Preserving Voice Anonymization technique, as our submission to the VoicePrivacy Challenge 2020. We observe that the challenge baseline system generates fake X-vectors which are very similar to each…

Sound · Computer Science 2021-01-06 Henry Turner , Giulio Lovisotto , Ivan Martinovic

Streaming Automatic Speech Recognition (ASR) in voice assistants can utilize prefetching to partially hide the latency of response generation. Prefetching involves passing a preliminary ASR hypothesis to downstream systems in order to…

Computation and Language · Computer Science 2023-05-24 Andreas Schwarz , Di He , Maarten Van Segbroeck , Mohammed Hethnawi , Ariya Rastrow

The objective of this work is to train noise-robust speaker embeddings adapted for speaker diarisation. Speaker embeddings play a crucial role in the performance of diarisation systems, but they often capture spurious information such as…

Sound · Computer Science 2022-11-04 You Jin Kim , Hee-Soo Heo , Jee-weon Jung , Youngki Kwon , Bong-Jin Lee , Joon Son Chung