English
Related papers

Related papers: Statistical Limits and Efficient Algorithms for Di…

200 papers

Federated learning faces huge challenges from model overfitting due to the lack of data and statistical diversity among clients. To address these challenges, this paper proposes a novel personalized federated learning method via Bayesian…

Machine Learning · Computer Science 2022-06-17 Xu Zhang , Yinchuan Li , Wenpeng Li , Kaiyang Guo , Yunfeng Shao

The increasing digitalization of education presents unprecedented opportunities for data-driven personalization, but it also introduces significant challenges to student data privacy. Conventional recommender systems rely on centralized…

Machine Learning · Computer Science 2025-11-12 Rodrigo Tertulino , Ricardo Almeida

This paper introduces FedGenGMM, a novel one-shot federated learning approach for Gaussian Mixture Models (GMM) tailored for unsupervised learning scenarios. In federated learning (FL), where multiple decentralized clients collaboratively…

Machine Learning · Computer Science 2025-06-03 Sophia Zhang Pettersson , Kuo-Yun Liang , Juan Carlos Andresen

Deep learning has achieved great success in many applications. However, its deployment in practice has been hurdled by two issues: the privacy of data that has to be aggregated centrally for model training and high communication overhead…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-02-04 Tien-Dung Cao , Tram Truong-Huu , Hien Tran , Khanh Tran

Everyday, large amounts of sensitive data is distributed across mobile phones, wearable devices, and other sensors. Traditionally, these enormous datasets have been processed on a single system, with complex models being trained to make…

Machine Learning · Computer Science 2023-01-10 Zongshun Zhang , Andrea Pinto , Valeria Turina , Flavio Esposito , Ibrahim Matta

Federated learning protects data privacy and security by exchanging models instead of data. However, unbalanced data distributions among participating clients compromise the accuracy and convergence speed of federated learning algorithms.…

Machine Learning · Computer Science 2022-04-11 Qilong Wu , Lin Liu , Shibei Xue

Federated learning enables collaborative model training across distributed clients while preserving data privacy. However, in practical deployments, device heterogeneity, non-independent, and identically distributed (Non-IID) data often…

Artificial Intelligence · Computer Science 2026-02-20 Jin Wang , Hui Ma , Fei Xing , Ming Yan

Federated learning is a distributed learning framework where clients collaboratively train a global model without sharing their raw data. FedAvg is a popular algorithm for federated learning, but it often suffers from slow convergence due…

Machine Learning · Computer Science 2025-05-19 Shokichi Takakura , Seng Pei Liew , Satoshi Hasegawa

Federated learning is a distributed machine learning paradigm where multiple data owners (clients) collaboratively train one machine learning model while keeping data on their own devices. The heterogeneity of client datasets is one of the…

Machine Learning · Computer Science 2021-08-18 Ye Xue , Diego Klabjan , Yuan Luo

Federated Learning (FL) allows training machine learning models in privacy-constrained scenarios by enabling the cooperation of edge devices without requiring local data sharing. This approach raises several challenges due to the different…

Machine Learning · Computer Science 2022-12-02 Riccardo Zaccone , Andrea Rizzardi , Debora Caldarola , Marco Ciccone , Barbara Caputo

Federated learning is a promising distributed machine learning paradigm that can effectively exploit large-scale data without exposing users' privacy. However, it may incur significant communication overhead, thereby potentially impairing…

Machine Learning · Computer Science 2024-08-07 Shiwei Li , Wenchao Xu , Haozhao Wang , Xing Tang , Yining Qi , Shijie Xu , Weihong Luo , Yuhua Li , Xiuqiang He , Ruixuan Li

Federated learning can be used to train machine learning models on the edge on local data that never leave devices, providing privacy by default. This presents a challenge pertaining to the communication and computation costs associated…

Machine Learning · Computer Science 2021-10-08 Dhruv Guliani , Lillian Zhou , Changwan Ryu , Tien-Ju Yang , Harry Zhang , Yonghui Xiao , Francoise Beaufays , Giovanni Motta

This paper studies federated learning for nonparametric regression in the context of distributed samples across different servers, each adhering to distinct differential privacy constraints. The setting we consider is heterogeneous,…

Statistics Theory · Mathematics 2024-06-12 T. Tony Cai , Abhinav Chakraborty , Lasse Vuursteen

Modern mobile devices have access to a wealth of data suitable for learning models, which in turn can greatly improve the user experience on the device. For example, language models can improve speech recognition and text entry, and image…

Machine Learning · Computer Science 2023-01-30 H. Brendan McMahan , Eider Moore , Daniel Ramage , Seth Hampson , Blaise Agüera y Arcas

This paper presents the first consumer-scale next-word prediction (NWP) model trained with Federated Learning (FL) while leveraging the Differentially Private Federated Averaging (DP-FedAvg) technique. There has been prior work on building…

Machine Learning · Computer Science 2020-09-22 Swaroop Ramaswamy , Om Thakkar , Rajiv Mathews , Galen Andrew , H. Brendan McMahan , Françoise Beaufays

Conventional federated learning directly averages model weights, which is only possible for collaboration between models with homogeneous architectures. Sharing prediction instead of weight removes this obstacle and eliminates the risk of…

Cryptography and Security · Computer Science 2021-05-24 Lichao Sun , Lingjuan Lyu

Federated learning (FL) is a distributed machine learning approach that allows multiple clients to collaboratively train a model without sharing their raw data. To prevent sensitive information from being inferred through the model updates…

Machine Learning · Computer Science 2024-09-23 Zhenxiao Zhang , Yuanxiong Guo , Yanmin Gong

Virtually all federated learning (FL) methods, including FedAvg, operate in the following manner: i) an orchestrating server sends the current model parameters to a cohort of clients selected via certain rule, ii) these clients then…

Machine Learning · Computer Science 2024-06-04 Kai Yi , Timur Kharisov , Igor Sokolov , Peter Richtárik

Federated learning (FL) is an emerging paradigm to train model with distributed data from numerous Internet of Things (IoT) devices. It inherently assumes a uniform capacity among participants. However, due to different conditions such as…

Machine Learning · Computer Science 2023-07-04 Hao Zhang , Tingting Wu , Siyao Cheng , Jie Liu

Federated Learning (FL) incurs high communication overhead, which can be greatly alleviated by compression for model updates. Yet the tradeoff between compression and model accuracy in the networked environment remains unclear and, for…

Machine Learning · Computer Science 2021-12-14 Laizhong Cui , Xiaoxin Su , Yipeng Zhou , Jiangchuan Liu