English
Related papers

Related papers: Introducing Model Inversion Attacks on Automatic S…

200 papers

Recently, adapting the idea of self-supervised learning (SSL) on continuous speech has started gaining attention. SSL models pre-trained on a huge amount of unlabeled audio can generate general-purpose representations that benefit a wide…

Cryptography and Security · Computer Science 2022-08-16 Wei-Cheng Tseng , Wei-Tsung Kao , Hung-yi Lee

A Model Inversion (MI) attack based on Generative Adversarial Networks (GAN) aims to recover the private training data from complex deep learning models by searching codes in the latent space. However, they merely search a deterministic…

Machine Learning · Computer Science 2024-04-23 Huan Bao , Kaimin Wei , Yongdong Wu , Jin Qian , Robert H. Deng

These days, deep learning models have achieved great success in multiple fields, from autonomous driving to medical diagnosis. These models have expanded the abilities of artificial intelligence by offering great solutions to complex…

Cryptography and Security · Computer Science 2023-11-27 Gopichandh Golla

Since the introduction of Masked Autoencoders, various improvements to masking techniques have been explored. In this paper, we rethink masking strategies for audio representation learning using masked prediction-based self-supervised…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-26 Daisuke Niizumi , Daiki Takeuchi , Masahiro Yasuda , Binh Thien Nguyen , Noboru Harada , Nobutaka Ono

Increasing use of machine learning (ML) technologies in privacy-sensitive domains such as medical diagnoses, lifestyle predictions, and business decisions highlights the need to better understand if these ML technologies are introducing…

Cryptography and Security · Computer Science 2022-01-25 Shagufta Mehnaz , Sayanton V. Dibbo , Ehsanul Kabir , Ninghui Li , Elisa Bertino

De-identification of data used for automatic speech recognition modeling is a critical component in protecting privacy, especially in the medical domain. However, simply removing all personally identifiable information (PII) from end-to-end…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-13 Martin Flechl , Shou-Chun Yin , Junho Park , Peter Skala

Member inference (MI) attacks aim to determine if a specific data sample was used to train a machine learning model. Thus, MI is a major privacy threat to models trained on private sensitive data, such as medical records. In MI attacks one…

Machine Learning · Computer Science 2022-05-30 Gilad Cohen , Raja Giryes

As a type of biometric identification, a speaker identification (SID) system is confronted with various kinds of attacks. The spoofing attacks typically imitate the timbre of the target speakers, while the adversarial attacks confuse the…

Sound · Computer Science 2023-09-06 Qing Wang , Jixun Yao , Li Zhang , Pengcheng Guo , Lei Xie

Faced with the threat of identity leakage during voice data publishing, users are engaged in a privacy-utility dilemma when enjoying convenient voice services. Existing studies employ direct modification or text-based re-synthesis to…

Sound · Computer Science 2022-11-11 Meng Chen , Li Lu , Jiadi Yu , Yingying Chen , Zhongjie Ba , Feng Lin , Kui Ren

Self-supervised learning (SSL) methods which learn representations of data without explicit supervision have gained popularity in speech-processing tasks, particularly for single-talker applications. However, these models often have…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-02 Zili Huang , Desh Raj , Paola García , Sanjeev Khudanpur

To build speech processing methods that can handle speech as naturally as humans, researchers have explored multiple ways of building an invertible mapping from speech to an interpretable space. The articulatory space is a promising…

Audio and Speech Processing · Electrical Eng. & Systems 2023-07-26 Peter Wu , Li-Wei Chen , Cheol Jun Cho , Shinji Watanabe , Louis Goldstein , Alan W Black , Gopala K. Anumanchipalli

The success of deep learning-based speaker verification systems is largely attributed to access to large-scale and diverse speaker identity data. However, collecting data from more identities is expensive, challenging, and often limited by…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-27 Tianchi Liu , Ruijie Tao , Qiongqiong Wang , Yidi Jiang , Hardik B. Sailor , Ke Zhang , Jingru Lin , Haizhou Li

Despite rapid advances in speech recognition, current models remain brittle to superficial perturbations to their inputs. Small amounts of noise can destroy the performance of an otherwise state-of-the-art model. To harden models against…

Audio and Speech Processing · Electrical Eng. & Systems 2018-07-19 Davis Liang , Zhiheng Huang , Zachary C. Lipton

Membership Inference (MI) poses a substantial privacy threat to the training data of Automatic Speech Recognition (ASR) systems, while also offering an opportunity to audit these models with regard to user data. This paper explores the…

Machine Learning · Computer Science 2024-05-03 Francisco Teixeira , Karla Pizzi , Raphael Olivier , Alberto Abad , Bhiksha Raj , Isabel Trancoso

Self-supervised learning (SSL) speech models generate meaningful representations of given clips and achieve incredible performance across various downstream tasks. Model extraction attack (MEA) often refers to an adversary stealing the…

Sound · Computer Science 2023-10-10 Tsu-Yuan Hsu , Chen-An Li , Tung-Yu Wu , Hung-yi Lee

Learning good representations is of crucial importance in deep learning. Mutual Information (MI) or similar measures of statistical dependence are promising tools for learning these representations in an unsupervised way. Even though the…

Audio and Speech Processing · Electrical Eng. & Systems 2019-04-09 Mirco Ravanelli , Yoshua Bengio

Due to the widespread deployment of fingerprint/face/speaker recognition systems, attacking deep learning based biometric systems has drawn more and more attention. Previous research mainly studied the attack to the vision-based system,…

Audio and Speech Processing · Electrical Eng. & Systems 2020-04-08 Jiguo Li , Xinfeng Zhang , Jizheng Xu , Li Zhang , Yue Wang , Siwei Ma , Wen Gao

Fake audio attack becomes a major threat to the speaker verification system. Although current detection approaches have achieved promising results on dataset-specific scenarios, they encounter difficulties on unseen spoofing data.…

Sound · Computer Science 2022-07-12 Haoxin Ma , Jiangyan Yi , Jianhua Tao , Ye Bai , Zhengkun Tian , Chenglong Wang

Machine learning models often pose a threat to the privacy of individuals whose data is part of the training set. Several recent attacks have been able to infer sensitive information from trained models, including model inversion or…

Machine Learning · Computer Science 2020-06-30 Abigail Goldsteen , Gilad Ezov , Ariel Farkash

Model Inversion (MI) attacks, which reconstruct the training dataset of neural networks, pose significant privacy concerns in machine learning. Recent MI attacks have managed to reconstruct realistic label-level private data, such as the…

Machine Learning · Computer Science 2025-02-27 Haoyang Li , Li Bai , Qingqing Ye , Haibo Hu , Yaxin Xiao , Huadi Zheng , Jianliang Xu