English
Related papers

Related papers: Federated Representation Learning for Automatic Sp…

200 papers

Cross-device federated learning (FL) protects user privacy by collaboratively training a model on user devices, therefore eliminating the need for collecting, storing, and manually labeling user data. While important topics such as the FL…

Sound · Computer Science 2022-04-06 Junteng Jia , Jay Mahadeokar , Weiyi Zheng , Yuan Shangguan , Ozlem Kalinli , Frank Seide

Federated learning (FL) is a distributed learning paradigm that facilitates collaborative training of a shared global model across devices while keeping data localized. The deployment of FL in numerous real-world applications faces delays,…

Machine Learning · Computer Science 2024-02-16 Xinchi Qiu , Yan Gao , Lorenzo Sani , Heng Pan , Wanru Zhao , Pedro P. B. Gusmao , Mina Alibeigi , Alex Iacob , Nicholas D. Lane

Integrating Federated Learning (FL) with self-supervised learning (SSL) enables privacy-preserving fine-tuning for speech tasks. However, federated environments exhibit significant heterogeneity: clients differ in computational capacity,…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-26 Xin Guo , Chunrui Zhao , Hong Jia , Ting Dang , Gongping Huang , Xianrui Zheng , Yan Gao

Federated learning (FL) enables distributed agents to collaboratively learn a centralized model without sharing their raw data with each other. However, data locality does not provide sufficient privacy protection, and it is desirable to…

Machine Learning · Computer Science 2021-06-15 Rui Hu , Yanmin Gong , Yuanxiong Guo

Federated Learning (FL) is transforming the ML training ecosystem from a centralized over-the-cloud setting to distributed training over edge devices in order to strengthen data privacy. An essential but rarely studied challenge in FL is…

Machine Learning · Computer Science 2021-10-07 Chaoyang He , Zhengyu Yang , Erum Mushtaq , Sunwoo Lee , Mahdi Soltanolkotabi , Salman Avestimehr

Smartphones, wearables, and Internet of Things (IoT) devices produce a wealth of data that cannot be accumulated in a centralized repository for learning supervised models due to privacy, bandwidth limitations, and the prohibitive cost of…

Machine Learning · Computer Science 2020-07-28 Aaqib Saeed , Flora D. Salim , Tanir Ozcelebi , Johan Lukkien

Federated learning is an effective way of extracting insights from different user devices while preserving the privacy of users. However, new classes with completely unseen data distributions can stream across any device in a federated…

Machine Learning · Computer Science 2021-06-21 Gautham Krishna Gudur , Satheesh K. Perepu

Many studies integrate federated learning (FL) with self-supervised learning (SSL) to take advantage of raw data distributed across edge devices. However, edge devices often struggle with high computational and communication costs imposed…

Machine Learning · Computer Science 2025-12-02 Ye Lin Tun , Chu Myaet Thwal , Huy Q. Le , Minh N. H. Nguyen , Eui-Nam Huh , Choong Seon Hong

Federated Learning (FL) is a technique to train models using data distributed across devices. Differential Privacy (DP) provides a formal privacy guarantee for sensitive data. Our goal is to train a large neural network language model…

Privacy-preserving machine learning has become a key conundrum for multi-party artificial intelligence. Federated learning (FL) and Split Learning (SL) are two frameworks that enable collaborative learning while keeping the data private (on…

Machine Learning · Computer Science 2022-12-15 Frédéric Berdoz , Abhishek Singh , Martin Jaggi , Ramesh Raskar

Speech data is expensive to collect, and incredibly sensitive to its sources. It is often the case that organizations independently collect small datasets for their own use, but often these are not performant for the demands of machine…

Cryptography and Security · Computer Science 2022-07-19 Michael Shoemate , Kevin Jett , Ethan Cowan , Sean Colbath , James Honaker , Prasanna Muthukumar

Speech model adaptation is crucial to handle the discrepancy between server-side proxy training data and actual data received on local devices of users. With the use of federated learning (FL), we introduce an efficient approach on…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-16 Zhe Liu , Ke Li , Shreyan Bakshi , Fuchun Peng

Federated Learning (FL) is a distributed machine learning framework that trains accurate global models while preserving clients' privacy-sensitive data. However, most FL approaches assume that clients possess labeled data, which is often…

Machine Learning · Computer Science 2024-11-01 Seungjoo Lee , Thanh-Long V. Le , Jaemin Shin , Sung-Ju Lee

Speech representation learning approaches for non-semantic tasks such as language recognition have either explored supervised embedding extraction methods using a classifier model or self-supervised representation learning approaches using…

Computation and Language · Computer Science 2023-06-08 Shikhar Vashishth , Shikhar Bharadwaj , Sriram Ganapathy , Ankur Bapna , Min Ma , Wei Han , Vera Axelrod , Partha Talukdar

Many existing federated learning (FL) algorithms are designed for supervised learning tasks, assuming that the local data owned by the clients are well labeled. However, in many practical situations, it could be difficult and expensive to…

Machine Learning · Computer Science 2021-11-02 Zhiguo Wang , Xintong Wang , Ruoyu Sun , Tsung-Hui Chang

Federated Learning (FL) is a privacy-protected machine learning paradigm that allows model to be trained directly at the edge without uploading data. One of the biggest challenges faced by FL in practical applications is the heterogeneity…

Machine Learning · Computer Science 2021-08-20 Zirui Zhu , Ziyi Ye

This work explores the challenge of enhancing Automatic Speech Recognition (ASR) model performance across various user-specific domains while preserving user data privacy. We employ federated learning and parameter-efficient domain…

Audio and Speech Processing · Electrical Eng. & Systems 2024-08-23 Xuan Kan , Yonghui Xiao , Tien-Ju Yang , Nanxin Chen , Rajiv Mathews

Data privacy remains a critical concern in educational research, requiring strict adherence to ethical standards and regulatory protocols. While traditional approaches rely on anonymization and centralized data collection, they often expose…

Machine Learning · Computer Science 2025-05-12 Ehsan Latif , Xiaoming Zhai

While federated learning (FL) and differential privacy (DP) have been extensively studied, their application to automatic speech recognition (ASR) remains largely unexplored due to the challenges in training large transformer models.…

Federated learning (FL) has emerged as an effective technique to co-training machine learning models without actually sharing data and leaking privacy. However, most existing FL methods focus on the supervised setting and ignore the…

Machine Learning · Computer Science 2021-07-06 Zewei Long , Liwei Che , Yaqing Wang , Muchao Ye , Junyu Luo , Jinze Wu , Houping Xiao , Fenglong Ma