English
Related papers

Related papers: FedAvgen: Metadata for Model Aggregation In Commun…

200 papers

Automatic speech recognition models require large amounts of speech recordings for training. However, the collection of such data often is cumbersome and leads to privacy concerns. Federated learning has been widely used as an effective…

Computation and Language · Computer Science 2024-05-28 Mohamed Nabih Ali , Alessio Brutti , Daniele Falavigna

Federated learning is a collaborative model training method that iterates model updates by multiple clients and aggregation of the updates by a central server. Device and statistical heterogeneity of participating clients cause significant…

Machine Learning · Computer Science 2023-08-29 Ayano Nakai-Kasai , Tadashi Wadayama

Federated Learning using the Federated Averaging algorithm has shown great advantages for large-scale applications that rely on collaborative learning, especially when the training data is either unbalanced or inaccessible due to privacy…

Machine Learning · Computer Science 2021-07-21 Jonatan Reyes , Lisa Di Jorio , Cecile Low-Kam , Marta Kersten-Oertel

Recent advances in personalized federated learning have focused on addressing client model heterogeneity. However, most existing methods still require external data, rely on model decoupling, or adopt partial learning strategies, which can…

Machine Learning · Computer Science 2025-07-31 Chen Zhang , Husheng Li , Xiang Liu , Linshan Jiang , Danxin Wang

Federated learning is typically approached as an optimization problem, where the goal is to minimize a global loss function by distributing computation across client devices that possess local data and specify different parts of the global…

Machine Learning · Computer Science 2021-02-02 Maruan Al-Shedivat , Jennifer Gillenwater , Eric Xing , Afshin Rostamizadeh

Federated learning has emerged as an innovative paradigm of collaborative machine learning. Unlike conventional machine learning, a global model is collaboratively learned while data remains distributed over a tremendous number of client…

Machine Learning · Computer Science 2020-12-08 Taehyeon Kim , Sangmin Bae , Jin-woo Lee , Seyoung Yun

The future of machine learning lies in moving data collection along with training to the edge. Federated Learning, for short FL, has been recently proposed to achieve this goal. The principle of this approach is to aggregate models learned…

Machine Learning · Computer Science 2023-07-13 Adnan Ben Mansour , Gaia Carenini , Alexandre Duplessis

Federated learning has created a decentralized method to train a machine learning model without needing direct access to client data. The main goal of a federated learning architecture is to protect the privacy of each client while still…

Cryptography and Security · Computer Science 2023-12-11 Marc Vucovich , Devin Quinn , Kevin Choi , Christopher Redino , Abdul Rahman , Edward Bowen

Federated learning (FL) is able to manage edge devices to cooperatively train a model while maintaining the training data local and private. One common assumption in FL is that all edge devices share the same machine learning model in…

Machine Learning · Computer Science 2022-07-07 Chan Yun Hin , Ngai Edith

By letting local clients perform multiple local updates before communicating with a parameter server, modern federated learning algorithms such as FedAvg tackle the communication bottleneck problem in distributed learning and have found…

Machine Learning · Computer Science 2025-03-21 Jie Liu , Yongqiang Wang

Federated learning (FL) is a machine learning paradigm where a shared central model is learned across distributed edge devices while the training data remains on these devices. Federated Averaging (FedAvg) is the leading optimization method…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-22 Yujing Chen , Yue Ning , Martin Slawski , Huzefa Rangwala

Heterogeneity across clients in federated learning (FL) usually hinders the optimization convergence and generalization performance when the aggregation of clients' knowledge occurs in the gradient space. For example, clients may differ in…

Machine Learning · Computer Science 2022-03-08 Yue Tan , Guodong Long , Lu Liu , Tianyi Zhou , Qinghua Lu , Jing Jiang , Chengqi Zhang

Federated learning learns from scattered data by fusing collaborative models from local nodes. However, the conventional coordinate-based model averaging by FedAvg ignored the random information encoded per parameter and may suffer from…

Machine Learning · Computer Science 2021-11-30 Fuxun Yu , Weishan Zhang , Zhuwei Qin , Zirui Xu , Di Wang , Chenchen Liu , Zhi Tian , Xiang Chen

Mobile crowdsensing has gained significant attention in recent years and has become a critical paradigm for emerging Internet of Things applications. The sensing devices continuously generate a significant quantity of data, which provide…

Machine Learning · Computer Science 2020-02-07 Zhouyuan Huo , Qian Yang , Bin Gu , Lawrence Carin. Heng Huang

Federated learning has emerged as a new paradigm of collaborative machine learning; however, it has also faced several challenges such as non-independent and identically distributed(IID) data and high communication cost. To this end, we…

Machine Learning · Computer Science 2020-12-10 Jin-woo Lee , Jaehoon Oh , Yooju Shin , Jae-Gil Lee , Se-Young Yoon

Automatic Speech Recognition models require large amount of speech data for training, and the collection of such data often leads to privacy concerns. Federated learning has been widely used and is considered to be an effective…

Machine Learning · Computer Science 2022-09-15 Rongmei Lin , Yonghui Xiao , Tien-Ju Yang , Ding Zhao , Li Xiong , Giovanni Motta , Françoise Beaufays

We study practical data characteristics underlying federated learning, where non-i.i.d. data from clients have sparse features, and a certain client's local data normally involves only a small part of the full model, called a submodel. Due…

Machine Learning · Computer Science 2023-04-06 Yucheng Ding , Chaoyue Niu , Fan Wu , Shaojie Tang , Chengfei Lv , Yanghe Feng , Guihai Chen

Federated learning is an emerging paradigm for decentralized training of machine learning models on distributed clients, without revealing the data to the central server. Most existing works have focused on horizontal or vertical data…

Machine Learning · Computer Science 2024-04-16 Jaeyeon Jang , Diego Klabjan , Veena Mendiratta , Fanfei Meng

Despite the recent success of modern imitation learning methods in robot manipulation, their performance is often constrained by geometric variations due to limited data diversity. Leveraging powerful 3D generative models and vision…

Robotics · Computer Science 2026-04-14 Jiawei Zhang , Kaizhe Hu , Yingqian Huang , Yuanchen Ju , Zhengrong Xue , Huazhe Xu

Federated Learning (FL) has recently emerged as a promising method that employs a distributed learning model structure to overcome data privacy and transmission issues paused by central machine learning models. In FL, datasets collected…

Machine Learning · Computer Science 2021-11-05 Ali Anaissi , Basem Suleiman