English
Related papers

Related papers: Taming the Instability: A Robust Second-Order Opti…

200 papers

Fairness and robustness are two important concerns for federated learning systems. In this work, we identify that robustness to data and model poisoning attacks and fairness, measured as the uniformity of performance across devices, are…

Machine Learning · Computer Science 2021-06-17 Tian Li , Shengyuan Hu , Ahmad Beirami , Virginia Smith

Adversarial attacks pose significant challenges in many machine learning applications, particularly in the setting of distributed training and federated learning, where malicious agents seek to corrupt the training process with the goal of…

Machine Learning · Computer Science 2025-06-10 Nicolás García Trillos , Aditya Kumar Akash , Sixu Li , Konstantin Riedl , Yuhua Zhu

Federated learning often suffers from slow and unstable convergence due to the heterogeneous characteristics of participating client datasets. Such a tendency is aggravated when the client participation ratio is low since the information…

Machine Learning · Computer Science 2024-04-02 Geeho Kim , Jinkyu Kim , Bohyung Han

Distributed learning algorithms aim to leverage distributed and diverse data stored at users' devices to learn a global phenomena by performing training amongst participating devices and periodically aggregating their local models'…

Machine Learning · Computer Science 2021-02-04 Naram Mhaisen , Alaa Awad , Amr Mohamed , Aiman Erbad , Mohsen Guizani

Despite achieving remarkable performance, Federated Learning (FL) encounters two important problems, i.e., low training efficiency and limited computational resources. In this paper, we propose a new FL framework, i.e., FedDUMAP, with three…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-08-13 Ji Liu , Juncheng Jia , Hong Zhang , Yuhui Yun , Leye Wang , Yang Zhou , Huaiyu Dai , Dejing Dou

Federated learning (FL) is an emerging learning paradigm to tackle massively distributed data. In Federated Learning, a set of clients jointly perform a machine learning task under the coordination of a server. The FedAvg algorithm is one…

Machine Learning · Computer Science 2023-02-14 Junyi Li , Feihu Huang , Heng Huang

Federated learning (FL) enables distributed model training from local data collected by users. In distributed systems with constrained resources and potentially high dynamics, e.g., mobile edge networks, the efficiency of FL is an important…

Machine Learning · Computer Science 2022-12-19 Shiqiang Wang , Jake Perazzone , Mingyue Ji , Kevin S. Chan

Federated learning, as a promising distributed learning paradigm, enables collaborative training of a global model across multiple network edge clients without the need for central data collecting. However, the heterogeneity of edge data…

Machine Learning · Computer Science 2024-03-06 Xingyan Chen , Tian Du , Mu Wang , Tiancheng Gu , Yu Zhao , Gang Kou , Changqiao Xu , Dapeng Oliver Wu

Federated Learning (FL) aggregates locally trained models from individual clients to construct a global model. While FL enables learning a model with data privacy, it often suffers from significant performance degradation when clients have…

Machine Learning · Computer Science 2024-03-29 Gihun Lee , Minchan Jeong , Sangmook Kim , Jaehoon Oh , Se-Young Yun

Federated learning (FL) is an emerging technique that trains massive and geographically distributed edge data while maintaining privacy. However, FL has inherent challenges in terms of fairness and computational efficiency due to the rising…

Machine Learning · Computer Science 2023-04-28 Yingchun Wang , Jingcai Guo , Jie Zhang , Song Guo , Weizhan Zhang , Qinghua Zheng

With the proliferation of distributed data sources, Federated Learning (FL) has emerged as a key approach to enable collaborative intelligence through decentralized model training while preserving data privacy. However, conventional FL…

Machine Learning · Computer Science 2026-02-03 Noorain Mukhtiar , Adnan Mahmood , Quan Z. Sheng

Federated learning enables training a global model from data located at the client nodes, without data sharing and moving client data to a centralized server. Performance of federated learning in a multi-access edge computing (MEC) network…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-05-11 Saurav Prakash , Sagar Dhakal , Mustafa Akdeniz , Yair Yona , Shilpa Talwar , Salman Avestimehr , Nageen Himayat

Federated Learning (FL) has emerged as a promising distributed learning paradigm that enables multiple clients to learn a global model collaboratively without sharing their private data. However, the effectiveness of FL is highly dependent…

Machine Learning · Computer Science 2023-12-27 Zhongyi Cai , Ye Shi , Wei Huang , Jingya Wang

Federated learning encounters a critical challenge of data heterogeneity, adversely affecting the performance and convergence of the federated model. Various approaches have been proposed to address this issue, yet their effectiveness is…

Machine Learning · Computer Science 2023-12-06 Jinqian Chen , Jihua Zhu , Qinghai Zheng

Federated Learning is a framework that jointly trains a model \textit{with} complete knowledge on a remotely placed centralized server, but \textit{without} the requirement of accessing the data stored in distributed machines. Some work…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-10-26 Jia Qian , Lars Kai Hansen , Xenofon Fafoutis , Prayag Tiwari , Hari Mohan Pandey

This work proposes an accelerated first-order algorithm we call the Robust Momentum Method for optimizing smooth strongly convex functions. The algorithm has a single scalar parameter that can be tuned to trade off robustness to gradient…

Optimization and Control · Mathematics 2018-02-27 Saman Cyrus , Bin Hu , Bryan Van Scoy , Laurent Lessard

In this paper, we study communication efficient distributed algorithms for distributionally robust federated learning via periodic averaging with adaptive sampling. In contrast to standard empirical risk minimization, due to the minimax…

Machine Learning · Computer Science 2021-02-26 Yuyang Deng , Mohammad Mahdi Kamani , Mehrdad Mahdavi

Pervasive computing promotes the installation of connected devices in our living spaces in order to provide services. Two major developments have gained significant momentum recently: an advanced use of edge resources and the integration of…

Machine Learning · Computer Science 2021-10-22 Sannara Ek , François Portet , Philippe Lalanda , German Vega

We study a Federated Reinforcement Learning (FedRL) problem with constraint heterogeneity. In our setting, we aim to solve a reinforcement learning problem with multiple constraints while $N$ training agents are located in $N$ different…

Machine Learning · Computer Science 2024-05-07 Hao Jin , Liangyu Zhang , Zhihua Zhang

Federated learning has gained significant attention due to its groundbreaking ability to enable distributed learning while maintaining privacy constraints. However, as a consequence of data heterogeneity among decentralized devices, it…

Machine Learning · Computer Science 2024-01-02 Hangyu Zhu , Yuxiang Fan , Zhenping Xie