English
Related papers

Related papers: Byzantine Resilient Non-Convex SVRG with Distribut…

200 papers

This paper proposes a distributed stochastic algorithm with variance reduction for general smooth non-convex finite-sum optimization, which has wide applications in signal processing and machine learning communities. In distributed setting,…

Optimization and Control · Mathematics 2021-07-23 Xia Jiang , Xianlin Zeng , Jian Sun , Jie Chen

The problem of distributed optimization requires a group of networked agents to compute a parameter that minimizes the average of their local cost functions. While there are a variety of distributed optimization algorithms that can solve…

Multiagent Systems · Computer Science 2024-09-24 Kananart Kuwaranancharoen , Lei Xin , Shreyas Sundaram

Stochastic gradient methods for machine learning and optimization problems are usually analyzed assuming data points are sampled \emph{with} replacement. In practice, however, sampling \emph{without} replacement is very common, easier to…

Machine Learning · Computer Science 2016-10-18 Ohad Shamir

Communication between workers and the master node to collect local stochastic gradients is a key bottleneck in a large-scale federated learning system. Various recent works have proposed to compress the local stochastic gradients to…

Machine Learning · Computer Science 2024-02-06 Heng Zhu , Qing Ling

This paper considers the problem of Byzantine fault tolerance in distributed linear regression in a multi-agent system. However, the proposed algorithms are given for a more general class of distributed optimization problems, of which…

Machine Learning · Computer Science 2019-04-05 Nirupam Gupta , Nitin H. Vaidya

While machine learning is going through an era of celebrated success, concerns have been raised about the vulnerability of its backbone: stochastic gradient descent (SGD). Recent approaches have been proposed to ensure the robustness of…

Machine Learning · Statistics 2018-07-19 El Mahdi El Mhamdi , Rachid Guerraoui , Sébastien Rouault

Distributed learning has become the standard approach for training large-scale machine learning models across private data silos. While distributed learning enhances privacy preservation and training efficiency, it faces critical challenges…

Machine Learning · Computer Science 2024-09-16 Changxin Liu , Yanghao Li , Yuhao Yi , Karl H. Johansson

Distributed model training needs to be adapted to challenges such as the straggler effect and Byzantine attacks. When coordinating the training process with multiple computing nodes, ensuring timely and reliable gradient aggregation amidst…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-12-11 Jiahe Yan , Pratik Chaudhari , Leonard Kleinrock

Communication efficiency and robustness are two major issues in modern distributed learning framework. This is due to the practical situations where some computing nodes may have limited communication power or may behave adversarial…

Machine Learning · Statistics 2021-03-02 Xingcai Zhou , Le Chang , Pengfei Xu , Shaogao Lv

We develop a communication-efficient distributed learning algorithm that is robust against Byzantine worker machines. We propose and analyze a distributed gradient-descent algorithm that performs a simple thresholding based on gradient…

Machine Learning · Computer Science 2021-08-17 Avishek Ghosh , Raj Kumar Maity , Swanand Kadhe , Arya Mazumdar , Kannan Ramchandran

In this paper, we consider a min-max optimization problem under adversarial manipulation, where there are $n$ cost functions, up to $f$ of which may be replaced by arbitrary faulty functions by an adversary. The goal is to minimize the…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-02-19 Shuo Liu , Nitin Vaidya

We consider the problem of Byzantine fault-tolerance in the peer-to-peer (P2P) distributed gradient-descent method -- a prominent algorithm for distributed optimization in a P2P system. In this problem, the system comprises of multiple…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-02-01 Nirupam Gupta , Nitin H. Vaidya

We consider distributed optimization under Byzantine attacks in the presence of $(L_0,L_1)$-smoothness, a generalization of standard $L$-smoothness that captures functions with state-dependent gradient Lipschitz constants. We propose…

Machine Learning · Computer Science 2026-03-16 Arman Bolatov , Samuel Horváth , Martin Takáč , Eduard Gorbunov

Distributed machine learning algorithms enable learning of models from datasets that are distributed over a network without gathering the data at a centralized location. While efficient distributed algorithms have been developed under the…

Machine Learning · Computer Science 2020-07-07 Zhixiong Yang , Waheed U. Bajwa

In distributed learning, a central server trains a model according to updates provided by nodes holding local data samples. In the presence of one or more malicious servers sending incorrect information (a Byzantine adversary), standard…

Machine Learning · Computer Science 2022-08-26 Lindon Roberts , Edward Smyth

Robustness to Byzantine attacks is a necessity for various distributed training scenarios. When the training reduces to the process of solving a minimization problem, Byzantine robustness is relatively well-understood. However, other…

The growth of data, the need for scalability and the complexity of models used in modern machine learning calls for distributed implementations. Yet, as of today, distributed machine learning frameworks have largely ignored the possibility…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-03-14 Peva Blanchard , El Mahdi El Mhamdi , Rachid Guerraoui , Julien Stainer

Distributed multi-task learning provides significant advantages in multi-agent networks with heterogeneous data sources where agents aim to learn distinct but correlated models simultaneously.However, distributed algorithms for learning…

Machine Learning · Computer Science 2021-01-11 Jiani Li , Waseem Abbas , Xenofon Koutsoukos

This paper considers the problem of Byzantine fault-tolerance in distributed multi-agent optimization. In this problem, each agent has a local cost function, and in the fault-free case, the goal is to design a distributed algorithm that…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-22 Shuo Liu , Nirupam Gupta , Nitin H. Vaidya

We analyze stochastic gradient algorithms for optimizing nonconvex, nonsmooth finite-sum problems. In particular, the objective function is given by the summation of a differentiable (possibly nonconvex) component, together with a possibly…

Optimization and Control · Mathematics 2018-12-04 Zhize Li , Jian Li