English
Related papers

Related papers: Federated Self-supervised Speech Representations: …

200 papers

The increasing demand for privacy-preserving collaborative learning has given rise to a new computing paradigm called federated learning (FL), in which clients collaboratively train a machine learning (ML) model without revealing their…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-05-31 Zhifeng Jiang , Wei Wang , Bo Li , Qiang Yang

In terms of artificial intelligence, there are several security and privacy deficiencies in the traditional centralized training methods of machine learning models by a server. To address this limitation, federated learning (FL) has been…

Cryptography and Security · Computer Science 2022-11-29 Yao Chen , Yijie Gui , Hong Lin , Wensheng Gan , Yongdong Wu

Self-Supervised Learning (SSL) Automatic Speech Recognition (ASR) models have shown great promise over Supervised Learning (SL) ones in low-resource settings. However, the advantages of SSL are gradually weakened when the amount of labeled…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-06 Li Fu , Siqi Li , Qingtao Li , Fangzhu Li , Liping Deng , Lu Fan , Meng Chen , Youzheng Wu , Xiaodong He

Self-supervised learning (SSL) has proven vital in speech and audio-related applications. The paradigm trains a general model on unlabeled data that can later be used to solve specific downstream tasks. This type of model is costly to train…

Federated learning (FL) has emerged with increasing popularity to collaborate distributed medical institutions for training deep networks. However, despite existing FL algorithms only allow the supervised training setting, most hospitals in…

Computer Vision and Pattern Recognition · Computer Science 2021-06-17 Quande Liu , Hongzheng Yang , Qi Dou , Pheng-Ann Heng

Trustworthy artificial intelligence (AI) technology has revolutionized daily life and greatly benefited human society. Among various AI technologies, Federated Learning (FL) stands out as a promising solution for diverse real-world…

Machine Learning · Computer Science 2023-02-22 Yifei Zhang , Dun Zeng , Jinglong Luo , Zenglin Xu , Irwin King

Federated learning (FL) has emerged as a promising paradigm for training models on decentralized data while safeguarding data privacy. Most existing FL systems, however, assume that all machine learning models are of the same type, although…

Machine Learning · Computer Science 2024-06-17 Yingchao Yu , Yuping Yan , Jisong Cai , Yaochu Jin

Self-supervised learning (SSL) has emerged as a promising paradigm for learning flexible speech representations from unlabeled data. By designing pretext tasks that exploit statistical regularities, SSL models can capture useful…

Sound · Computer Science 2024-01-25 Yusuf Brima , Ulf Krumnack , Simone Pika , Gunther Heidemann

Federated Learning is a distributed machine learning paradigm dealing with decentralized and personal datasets. Since data reside on devices like smartphones and virtual assistants, labeling is entrusted to the clients, or labels are…

Machine Learning · Computer Science 2022-02-28 Vasileios Tsouvalas , Aaqib Saeed , Tanir Ozcelebi

Federated learning is an effective way of extracting insights from different user devices while preserving the privacy of users. However, new classes with completely unseen data distributions can stream across any device in a federated…

Machine Learning · Computer Science 2021-06-21 Gautham Krishna Gudur , Satheesh K. Perepu

Many application scenarios call for training a machine learning model among multiple participants. Federated learning (FL) was proposed to enable joint training of a deep learning model using the local data in each party without revealing…

Machine Learning · Computer Science 2021-02-12 Kai-Fung Chu , Lintao Zhang

Federated learning (FL) is emerging as a new paradigm to train machine learning models in distributed systems. Rather than sharing, and disclosing, the training dataset with the server, the model parameters (e.g. neural networks weights and…

Signal Processing · Electrical Eng. & Systems 2020-05-27 Stefano Savazzi , Monica Nicoli , Vittorio Rampa

Federated Learning (FL) is a learning paradigm that protects privacy by keeping client data on edge devices. However, optimizing FL in practice can be difficult due to the diversity and heterogeneity of the learning system. Despite recent…

Machine Learning · Computer Science 2023-02-21 Yongxin Guo , Tao Lin , Xiaoying Tang

Self-supervised learning (SSL) speech models have achieved remarkable performance in various tasks, yet the biased outcomes, especially affecting marginalized groups, raise significant concerns. Social bias refers to the phenomenon where…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-06 Yi-Cheng Lin , Tzu-Quan Lin , Hsi-Che Lin , Andy T. Liu , Hung-yi Lee

Recent advances in synthetic speech have made audio deepfakes increasingly realistic, posing significant security risks. Existing detection methods that rely on a single modality, either raw waveform embeddings or spectral based features,…

Federated learning (FL) faces three major difficulties: cross-domain, heterogeneous models, and non-i.i.d. labels scenarios. Existing FL methods fail to handle the above three constraints at the same time, and the level of privacy…

Machine Learning · Computer Science 2022-10-31 Chang Liu , Yuwen Yang , Xun Cai , Yue Ding , Hongtao Lu

Self-supervised learning (SSL) speech models such as wav2vec and HuBERT have demonstrated state-of-the-art performance on automatic speech recognition (ASR) and proved to be extremely useful in low label-resource settings. However, the…

Sound · Computer Science 2023-10-05 Weiwei Lin , Chenhang He , Man-Wai Mak , Youzhi Tu

Self-supervised learning (SSL) has grown in interest within the speech processing community, since it produces representations that are useful for many downstream tasks. SSL uses global and contextual methods to produce robust…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-08 Subrina Sultana , Donald S. Williamson

Billions of IoT devices will be deployed in the near future, taking advantage of faster Internet speed and the possibility of orders of magnitude more endpoints brought by 5G/6G. With the growth of IoT devices, vast quantities of data that…

Machine Learning · Computer Science 2022-04-07 Tuo Zhang , Lei Gao , Chaoyang He , Mi Zhang , Bhaskar Krishnamachari , Salman Avestimehr

Recent years have witnessed a boom in self-supervised learning (SSL) in various areas including speech processing. Speech based SSL models present promising performance in a range of speech related tasks. However, the training of SSL models…

Audio and Speech Processing · Electrical Eng. & Systems 2023-02-21 Xie Chen , Ziyang Ma , Changli Tang , Yujin Wang , Zhisheng Zheng