English
Related papers

Related papers: Representation Learning for Audio Privacy Preserva…

200 papers

Adversarial attacks pose a severe security threat to the state-of-the-art speaker identification systems, thereby making it vital to propose countermeasures against them. Building on our previous work that used representation learning to…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-11 Sonal Joshi , Saurabh Kataria , Jesus Villalba , Najim Dehak

Federated Learning enables a population of clients, working with a trusted server, to collaboratively learn a shared machine learning model while keeping each client's data within its own local systems. This reduces the risk of exposing…

Cryptography and Security · Computer Science 2020-10-13 David Byrd , Antigoni Polychroniadou

Preserving privacy of continuous and/or high-dimensional data such as images, videos and audios, can be challenging with syntactic anonymization methods which are designed for discrete attributes. Differential privacy, which provides a more…

Machine Learning · Computer Science 2017-12-04 Jihun Hamm

Separating two sources from an audio mixture is an important task with many applications. It is a challenging problem since only one signal channel is available for analysis. In this paper, we propose a novel framework for singing voice…

Sound · Computer Science 2017-11-15 Zhe-Cheng Fan , Yen-Lin Lai , Jyh-Shing Roger Jang

Although federated learning improves privacy of training data by exchanging local gradients or parameters rather than raw data, the adversary still can leverage local gradients and parameters to obtain local training data by launching…

Machine Learning · Computer Science 2021-08-17 Xue Yang , Yan Feng , Weijun Fang , Jun Shao , Xiaohu Tang , Shu-Tao Xia , Rongxing Lu

Self-supervised learning (SSL) approaches, such as contrastive and generative methods, have advanced environmental sound representation learning using unlabeled data. However, how these approaches can complement each other within a unified…

Sound · Computer Science 2025-10-29 Sivan Ding , Julia Wilkins , Magdalena Fuentes , Juan Pablo Bello

We present a practical method for protecting data during the inference phase of deep learning based on bipartite topology threat modeling and an interactive adversarial deep network construction. We term this approach \emph{Privacy…

Cryptography and Security · Computer Science 2018-12-10 Jianfeng Chi , Emmanuel Owusu , Xuwang Yin , Tong Yu , William Chan , Patrick Tague , Yuan Tian

Audio is a rich sensing modality that is useful for a variety of human activity recognition tasks. However, the ubiquitous nature of smartphones and smart speakers with always-on microphones has led to numerous privacy concerns and a lack…

Recordings in everyday life require privacy preservation of the speech content and speaker identity. This contribution explores the influence of noise and reverberation on the trade-off between privacy and utility for low-cost…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-04 Jule Pohlhausen , Francesco Nespoli , Joerg Bitzer

Federated learning (FL) has been widely studied recently due to its property to collaboratively train data from different devices without sharing the raw data. Nevertheless, recent studies show that an adversary can still be possible to…

Cryptography and Security · Computer Science 2023-12-13 Caridad Arroyo Arevalo , Sayedeh Leila Noorbakhsh , Yun Dong , Yuan Hong , Binghui Wang

The rapid rise of IoT and Big Data has facilitated copious data driven applications to enhance our quality of life. However, the omnipresent and all-encompassing nature of the data collection can generate privacy concerns. Hence, there is a…

Machine Learning · Computer Science 2021-09-09 Mert Al , Semih Yagli , Sun-Yuan Kung

As users increasingly rely on cloud-based computing services, it is important to ensure that uploaded speech data remains private. Existing solutions rely either on server-side methods or focus on hiding speaker identity. While these…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-26 Peter Wu , Paul Pu Liang , Jiatong Shi , Ruslan Salakhutdinov , Shinji Watanabe , Louis-Philippe Morency

Latent factor models for recommender systems represent users and items as low dimensional vectors. Privacy risks of such systems have previously been studied mostly in the context of recovery of personal information in the form of usage…

Information Retrieval · Computer Science 2018-12-19 Yehezkel S. Resheff , Yanai Elazar , Moni Shahar , Oren Sar Shalom

Automatic speaker verification (ASV) is one of the core technologies in biometric identification. With the ubiquitous usage of ASV systems in safety-critical applications, more and more malicious attackers attempt to launch adversarial…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-16 Haibin Wu , Xu Li , Andy T. Liu , Zhiyong Wu , Helen Meng , Hung-yi Lee

The remarkable proliferation of deep learning across various industries has underscored the importance of data privacy and security in AI pipelines. As the evolution of sophisticated Membership Inference Attacks (MIAs) threatens the secrecy…

Cryptography and Security · Computer Science 2023-06-06 Eugenio Lomurno , Alberto Archetti , Francesca Ausonio , Matteo Matteucci

In this paper, we address the problem of speaker recognition in challenging acoustic conditions using a novel method to extract robust speaker-discriminative speech representations. We adopt a recently proposed unsupervised adversarial…

Audio and Speech Processing · Electrical Eng. & Systems 2019-11-05 Raghuveer Peri , Monisankha Pal , Arindam Jati , Krishna Somandepalli , Shrikanth Narayanan

We consider the problem of reinforcing federated learning with formal privacy guarantees. We propose to employ Bayesian differential privacy, a relaxation of differential privacy for similarly distributed data, to provide sharper privacy…

Machine Learning · Computer Science 2020-03-26 Aleksei Triastcyn , Boi Faltings

We consider the problem of audio voice separation for binaural applications, such as earphones and hearing aids. While today's neural networks perform remarkably well (separating $4+$ sources with 2 microphones) they assume a known or fixed…

Sound · Computer Science 2022-07-18 Zhongweiyang Xu , Romit Roy Choudhury

The performance of deep learning models highly depends on the amount of training data. It is common practice for today's data holders to merge their datasets and train models collaboratively, which yet poses a threat to data privacy.…

Cryptography and Security · Computer Science 2022-03-29 Jikun Chen , Feng Qiang , Na Ruan

The increasing adoption of data-driven applications in education such as in learning analytics and AI in education has raised significant privacy and data protection concerns. While these challenges have been widely discussed in previous…

Machine Learning · Computer Science 2025-03-19 Mohammad Khalil , Ronas Shakya , Qinyi Liu