English
Related papers

Related papers: Decoupled Federated Learning for ASR with Non-IID …

200 papers

Recommender Systems (RSs) have become increasingly important in many application domains, such as digital marketing. Conventional RSs often need to collect users' data, centralize them on the server-side, and form a global model to generate…

Information Retrieval · Computer Science 2022-12-20 Qi Le , Enmao Diao , Xinran Wang , Ali Anwar , Vahid Tarokh , Jie Ding

Automatic speech recognition (ASR) models are typically trained on large datasets of transcribed speech. As language evolves and new terms come into use, these models can become outdated and stale. In the context of models trained on the…

Computation and Language · Computer Science 2023-12-04 Lillian Zhou , Yuxin Ding , Mingqing Chen , Harry Zhang , Rohit Prabhavalkar , Dhruv Guliani , Giovanni Motta , Rajiv Mathews

Federated learning (FL) and split learning (SL) are two popular distributed machine learning approaches. Both follow a model-to-data scenario; clients train and test machine learning models without sharing raw data. SL provides better model…

Machine Learning · Computer Science 2022-02-18 Chandra Thapa , M. A. P. Chamikara , Seyit Camtepe , Lichao Sun

In Federated Learning (FL), the clients learn a single global model (FedAvg) through a central aggregator. In this setting, the non-IID distribution of the data across clients restricts the global FL model from delivering good performance…

Machine Learning · Computer Science 2021-07-29 Siddharth Divi , Yi-Shan Lin , Habiba Farrukh , Z. Berkay Celik

Standard acoustic event classification (AEC) solutions require large-scale collection of data from client devices for model optimization. Federated learning (FL) is a compelling framework that decouples data collection and model training to…

Sound · Computer Science 2022-03-24 Meng Feng , Chieh-Chi Kao , Qingming Tang , Ming Sun , Viktor Rozgic , Spyros Matsoukas , Chao Wang

We propose using federated learning, a decentralized on-device learning paradigm, to train speech recognition models. By performing epochs of training on a per-user basis, federated learning must incur the cost of dealing with non-IID data…

Machine Learning · Computer Science 2021-05-18 Dhruv Guliani , Francoise Beaufays , Giovanni Motta

This work explores the challenge of enhancing Automatic Speech Recognition (ASR) model performance across various user-specific domains while preserving user data privacy. We employ federated learning and parameter-efficient domain…

Audio and Speech Processing · Electrical Eng. & Systems 2024-08-23 Xuan Kan , Yonghui Xiao , Tien-Ju Yang , Nanxin Chen , Rajiv Mathews

Speech Emotion Recognition (SER) refers to the recognition of human emotions from natural speech. If done accurately, it can offer a number of benefits in building human-centered context-aware intelligent systems. Existing SER approaches…

Machine Learning · Computer Science 2022-02-08 Vasileios Tsouvalas , Tanir Ozcelebi , Nirvana Meratnia

Federated learning is an emerging distributed machine learning method, enables a large number of clients to train a model without exchanging their local data. The time cost of communication is an essential bottleneck in federated learning,…

Machine Learning · Computer Science 2023-09-19 Hao Sun , Li Shen , Shixiang Chen , Jingwei Sun , Jing Li , Guangzhong Sun , Dacheng Tao

Cross-silo Federated learning (FL) has become a promising tool in machine learning applications for healthcare. It allows hospitals/institutions to train models with sufficient data while the data is kept private. To make sure the FL model…

Machine Learning · Computer Science 2022-09-12 Aoxiao Zhong , Hao He , Zhaolin Ren , Na Li , Quanzheng Li

In the context of personalized federated learning (FL), the critical challenge is to balance local model improvement and global model tuning when the personal and global objectives may not be exactly aligned. Inspired by Bayesian…

Machine Learning · Computer Science 2022-04-19 Huili Chen , Jie Ding , Eric Tramel , Shuang Wu , Anit Kumar Sahu , Salman Avestimehr , Tao Zhang

Federated learning (FL) is a heavily promoted approach for training ML models on sensitive data, e.g., text typed by users on their smartphones. FL is expressly designed for training on data that are unbalanced and non-iid across the…

Machine Learning · Computer Science 2022-03-07 Tao Yu , Eugene Bagdasaryan , Vitaly Shmatikov

Federated recommendations leverage the federated learning (FL) techniques to make privacy-preserving recommendations. Though recent success in the federated recommender system, several vital challenges remain to be addressed: (i) The…

Information Retrieval · Computer Science 2022-08-25 Sichun Luo , Yuanzhang Xiao , Yang Liu , Congduan Li , Linqi Song

In the age of data-driven decision making, preserving privacy while providing personalized experiences has become paramount. Personalized Federated Learning (PFL) offers a promising framework by decentralizing the learning process, thus…

Machine Learning · Computer Science 2025-01-31 Kevin Cooper , Michael Geller

Personalization in federated learning (FL) functions as a coordinator for clients with high variance in data or behavior. Ensuring the convergence of these clients' models relies on how closely users collaborate with those with similar…

Machine Learning · Computer Science 2023-02-24 Eunjeong Jeong , Marios Kountouris

Federated learning (FL) enables learning from decentralized privacy-sensitive data, with computations on raw data confined to take place at edge clients. This paper introduces mixed FL, which incorporates an additional loss term calculated…

Machine Learning · Computer Science 2022-06-28 Sean Augenstein , Andrew Hard , Lin Ning , Karan Singhal , Satyen Kale , Kurt Partridge , Rajiv Mathews

Federated learning (FL) addresses privacy concerns in training language models by enabling multiple clients to contribute to the training, without sending their data to others. However, non-IID (identically and independently distributed)…

Machine Learning · Computer Science 2025-01-28 Jong-Ik Park , Carlee Joe-Wong

Federated learning (FL) enables a set of distributed clients to jointly train machine learning models while preserving their local data privacy, making it attractive for applications in healthcare, finance, mobility, and smart-city systems.…

Machine Learning · Computer Science 2026-03-26 Eman M. AbouNassar , Amr Elshall , Sameh Abdulah

Federated learning (FL) enables the collaboration of multiple deep learning models to learn from decentralized data archives (i.e., clients) without accessing data on clients. Although FL offers ample opportunities in knowledge discovery…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Barış Büyüktaş , Gencer Sumbul , Begüm Demir

Large language models (LLMs) have emerged as important components across various fields, yet their training requires substantial computation resources and abundant labeled data. It poses a challenge to robustly training LLMs for individual…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-13 Jiaxing QI , Zhongzhi Luan , Shaohan Huang , Carol Fung , Hailong Yang , Depei Qian