English
Related papers

Related papers: Flag Aggregator: Scalable Distributed Training und…

200 papers

In this paper, we propose a class of robust stochastic subgradient methods for distributed learning from heterogeneous datasets at presence of an unknown number of Byzantine workers. The Byzantine workers, during the learning process, may…

Machine Learning · Computer Science 2019-11-12 Liping Li , Wei Xu , Tianyi Chen , Georgios B. Giannakis , Qing Ling

We propose a novel framework to study asynchronous federated learning optimization with delays in gradient updates. Our theoretical framework extends the standard FedAvg aggregation scheme by introducing stochastic aggregation weights to…

Machine Learning · Computer Science 2022-06-22 Yann Fraboni , Richard Vidal , Laetitia Kameni , Marco Lorenzi

We propose clustered federated multitask learning to address statistical challenges in non-independent and identically distributed data across clients. Our approach tackles complexities in hierarchical wireless networks by clustering…

Networking and Internet Architecture · Computer Science 2024-07-15 Moqbel Hamood , Abdullatif Albaseer , Mohamed Abdallah , Ala Al-Fuqaha , Amr Mohamed

We study robust distributed learning that involves minimizing a non-convex loss function with saddle points. We consider the Byzantine setting where some worker machines have abnormal or even arbitrary and adversarial behavior. In this…

Machine Learning · Computer Science 2020-07-30 Dong Yin , Yudong Chen , Kannan Ramchandran , Peter Bartlett

The problem of distributed optimization requires a group of networked agents to compute a parameter that minimizes the average of their local cost functions. While there are a variety of distributed optimization algorithms that can solve…

Multiagent Systems · Computer Science 2024-09-24 Kananart Kuwaranancharoen , Lei Xin , Shreyas Sundaram

Gradient-based training in federated learning is known to be vulnerable to faulty/malicious clients, which are often modeled as Byzantine clients. To this end, previous work either makes use of auxiliary data at parameter server to verify…

Machine Learning · Computer Science 2023-05-02 Jian Xu , Shao-Lun Huang , Linqi Song , Tian Lan

Distributed Learning often suffers from Byzantine failures, and there have been a number of works studying the problem of distributed stochastic optimization under Byzantine failures, where only a portion of workers, instead of all the…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-08-17 Kaiyun Li , Xiaojun Chen , Ye Dong , Peng Zhang , Dakui Wang , Shuai Zen

This paper proposes a new approach that enables multi-agent systems to achieve resilient \textit{constrained} consensus in the presence of Byzantine attacks, in contrast to existing literature that is only applicable to…

Systems and Control · Electrical Eng. & Systems 2023-12-19 Xuan Wang , Shaoshuai Mou , Shreyas Sundaram

Coded distributed computing framework enables large-scale machine learning (ML) models to be trained efficiently in a distributed manner, while mitigating the straggler effect. In this work, we consider a multi-task assignment problem in a…

Information Theory · Computer Science 2019-05-21 Yuxuan Sun , Junlin Zhao , Sheng Zhou , Deniz Gündüz

Distributed learning has become the standard approach for training large-scale machine learning models across private data silos. While distributed learning enhances privacy preservation and training efficiency, it faces critical challenges…

Machine Learning · Computer Science 2024-09-16 Changxin Liu , Yanghao Li , Yuhao Yi , Karl H. Johansson

Federated Learning (FL) is a distributed machine learning paradigm where data is distributed among clients who collaboratively train a model in a computation process coordinated by a central server. By assigning a weight to each client…

Machine Learning · Computer Science 2021-05-19 Amit Portnoy , Yoav Tirosh , Danny Hendler

Ensuring resilience to Byzantine clients while maintaining the privacy of the clients' data is a fundamental challenge in federated learning (FL). When the clients' data is homogeneous, suitable countermeasures were studied from an…

Machine Learning · Computer Science 2025-06-12 Maximilian Egger , Rawad Bitar

This paper proposes a new framework for distributed optimization, called distributed aggregative optimization, which allows local objective functions to be dependent not only on their own decision variables, but also on the average of…

Optimization and Control · Mathematics 2020-05-28 Xiuxian Li , Lihua Xie , Yiguang Hong

This paper considers the problem of resilient distributed optimization and stochastic machine learning in a server-based architecture. The system comprises a server and multiple agents, where each agent has a local cost function. The agents…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-10-22 Shuo Liu , Nirupam Gupta , Nitin Vaidya

Communication between workers and the master node to collect local stochastic gradients is a key bottleneck in a large-scale federated learning system. Various recent works have proposed to compress the local stochastic gradients to…

Machine Learning · Computer Science 2024-02-06 Heng Zhu , Qing Ling

Asynchronous federated learning aims to solve the straggler problem in heterogeneous environments, i.e., clients have small computational capacities that could cause aggregation delay. The principle of asynchronous federated learning is to…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-06-05 Xiang Ma , Qun Wang , Haijian Sun , Rose Qingyang Hu , Yi Qian

Owing to the low communication costs and privacy-promoting capabilities, Federated Learning (FL) has become a promising tool for training effective machine learning models among distributed clients. However, with the distributed…

Machine Learning · Computer Science 2021-08-03 Chuan Ma , Jun Li , Ming Ding , Kang Wei , Wen Chen , H. Vincent Poor

Byzantine-robust distributed optimization relies on robust aggregation rules to mitigate the influence of malicious Byzantine workers. Despite the proliferation of such rules, a unified convergence analysis framework that accommodates…

Optimization and Control · Mathematics 2026-04-14 Boyuan Ruan , Xiaoyu Wang , Ya-Feng Liu

Dramatic increases in the capabilities of neural network models in recent years are driven by scaling model size, training data, and corresponding computational resources. To develop the exceedingly large networks required in modern…

Machine Learning · Computer Science 2025-04-15 Jared Fernandez , Luca Wehrstedt , Leonid Shamis , Mostafa Elhoushi , Kalyan Saladi , Yonatan Bisk , Emma Strubell , Jacob Kahn

We study distributed composite optimization over networks: agents minimize the sum of a smooth (strongly) convex function, the agents' sum-utility, plus a non-smooth (extended-valued) convex one. We propose a general algorithmic framework…

Optimization and Control · Mathematics 2019-10-23 Jinming Xu , Ying Sun , Ye Tian , Gesualdo Scutari