中文
相关论文

相关论文: FedSkip: Combatting Statistical Heterogeneity with…

200 篇论文

Federated learning increasingly operates in a large-model regime where communication, memory, and computation are all scarce. Typically, non-IID client data induce drift that degrades the stability and performance of local training.…

机器学习 · 计算机科学 2026-04-29 Shuchen Zhu , Zhengyang Huang , Yuqi Xu , Peijin Li

Federated learning is a new distributed machine learning framework, where a bunch of heterogeneous clients collaboratively train a model without sharing training data. In this work, we consider a practical and ubiquitous issue when…

机器学习 · 统计学 2023-09-06 Yikai Yan , Chaoyue Niu , Yucheng Ding , Zhenzhe Zheng , Fan Wu , Guihai Chen , Shaojie Tang , Zhihua Wu

This work considers the category distribution heterogeneity in federated learning. This issue is due to biased labeling preferences at multiple clients and is a typical setting of data heterogeneity. To alleviate this issue, most previous…

机器学习 · 计算机科学 2023-05-31 Rui Ye , Mingkai Xu , Jianyu Wang , Chenxin Xu , Siheng Chen , Yanfeng Wang

The federated learning paradigm has motivated the development of methods for aggregating multiple client updates into a global server model, without sharing client data. Many federated learning algorithms, including the canonical Federated…

机器学习 · 计算机科学 2024-02-20 Nikita Dhawan , Nicole Mitchell , Zachary Charles , Zachary Garrett , Gintare Karolina Dziugaite

Federated learning aims to jointly learn statistical models over massively distributed remote devices. In this work, we propose FedDANE, an optimization method that we adapt from DANE, a method for classical distributed optimization, to…

机器学习 · 计算机科学 2020-01-08 Tian Li , Anit Kumar Sahu , Manzil Zaheer , Maziar Sanjabi , Ameet Talwalkar , Virginia Smith

Composite federated learning offers a general framework for solving machine learning problems with additional regularization terms. However, existing methods often face significant limitations: many require clients to perform…

机器学习 · 计算机科学 2025-12-12 Yuan Zhou , Jiachen Zhong , Xinli Shi , Guanghui Wen , Xinghuo Yu

Non-IID data and partial participation induce client drift and inconsistent local optima in federated learning, causing unstable convergence and accuracy loss. We present FedSSG, a stochastic sampling-guided, history-aware drift alignment…

机器学习 · 计算机科学 2025-09-18 Zhanting Zhou , Jinshan Lai , Fengchun Zhang , Zeqin Wu , Fengli Zhang

As an emerging technology, federated learning (FL) involves training machine learning models over distributed edge devices, which attracts sustained attention and has been extensively studied. However, the heterogeneity of client data…

机器学习 · 计算机科学 2022-12-29 Hao Zhang , Tingting Wu , Siyao Cheng , Jie Liu

In federated optimization, heterogeneity in the clients' local datasets and computation speeds results in large variations in the number of local updates performed by each client in each communication round. Naive weighted aggregation of…

机器学习 · 计算机科学 2020-07-16 Jianyu Wang , Qinghua Liu , Hao Liang , Gauri Joshi , H. Vincent Poor

Minimax optimization has seen a surge in interest with the advent of modern applications such as GANs, and it is inherently more challenging than simple minimization. The difficulty is exacerbated by the training data residing at multiple…

机器学习 · 计算机科学 2023-02-10 Pranay Sharma , Rohan Panda , Gauri Joshi

Federated Learning (FL) enables decentralized training of machine learning models on distributed data while preserving privacy. However, in real-world FL settings, client data is often non-identically distributed and imbalanced, resulting…

Federated Learning (FL) models often experience client drift caused by heterogeneous data, where the distribution of data differs across clients. To address this issue, advanced research primarily focuses on manipulating the existing…

机器学习 · 计算机科学 2024-03-15 Zhenheng Tang , Yonggang Zhang , Shaohuai Shi , Xinmei Tian , Tongliang Liu , Bo Han , Xiaowen Chu

Federated Learning (FL) allows training machine learning models in privacy-constrained scenarios by enabling the cooperation of edge devices without requiring local data sharing. This approach raises several challenges due to the different…

机器学习 · 计算机科学 2022-12-02 Riccardo Zaccone , Andrea Rizzardi , Debora Caldarola , Marco Ciccone , Barbara Caputo

Federated learning is an emerging distributed machine learning method, enables a large number of clients to train a model without exchanging their local data. The time cost of communication is an essential bottleneck in federated learning,…

机器学习 · 计算机科学 2023-09-19 Hao Sun , Li Shen , Shixiang Chen , Jingwei Sun , Jing Li , Guangzhong Sun , Dacheng Tao

Federated learning (FL) is a promising strategy for performing privacy-preserving, distributed learning with a network of clients (i.e., edge devices). However, the data distribution among clients is often non-IID in nature, making…

机器学习 · 计算机科学 2022-04-15 Matias Mendieta , Taojiannan Yang , Pu Wang , Minwoo Lee , Zhengming Ding , Chen Chen

Federated learning is an emerging distributed machine learning framework aiming at protecting data privacy. Data heterogeneity is one of the core challenges in federated learning, which could severely degrade the convergence rate and…

机器学习 · 统计学 2025-11-27 Feifei Wang , Huiyun Tang , Yang Li

Originated from distributed learning, federated learning enables privacy-preserved collaboration on a new abstracted level by sharing the model parameters only. While the current research mainly focuses on optimizing learning algorithms and…

机器学习 · 计算机科学 2020-09-17 Cong Wang , Yuanyuan Yang , Pengzhan Zhou

Federated Learning (FL) enables collaborative training across decentralized clients, but most methods assume aligned feature schemas, an assumption that rarely holds in tabular settings where clients observe only partially overlapping…

机器学习 · 计算机科学 2026-05-18 Imane Hocine , Chaimaa Medjadji , Sylvain Kubler , Gregoire Danoy , Yves Le Traon

Federated learning is a distributed machine learning approach in which a single server and multiple clients collaboratively build machine learning models without sharing datasets on clients. A challenging issue of federated learning is data…

机器学习 · 计算机科学 2022-06-28 Koji Matsuda , Yuya Sasaki , Chuan Xiao , Makoto Onizuka

Distributed learning algorithms aim to leverage distributed and diverse data stored at users' devices to learn a global phenomena by performing training amongst participating devices and periodically aggregating their local models'…

机器学习 · 计算机科学 2021-02-04 Naram Mhaisen , Alaa Awad , Amr Mohamed , Aiman Erbad , Mohsen Guizani