English
Related papers

Related papers: Distributed Newton-Type Methods with Communication…

200 papers

We propose and study a new class of gradient communication mechanisms for communication-efficient training -- three point compressors (3PC) -- as well as efficient distributed nonconvex optimization algorithms that can take advantage of…

Machine Learning · Computer Science 2022-02-03 Peter Richtárik , Igor Sokolov , Ilyas Fatkhullin , Elnur Gasanov , Zhize Li , Eduard Gorbunov

This paper considers distributed nonconvex optimization with the cost functions being distributed over agents. Noting that information compression is a key tool to reduce the heavy communication load for distributed algorithms as agents…

Optimization and Control · Mathematics 2022-10-10 Xinlei Yi , Shengjun Zhang , Tao Yang , Tianyou Chai , Karl H. Johansson

Recent advances in distributed optimization have shown that Newton-type methods with proper communication compression mechanisms can guarantee fast local rates and low communication cost compared to first order methods. We discover that the…

Machine Learning · Computer Science 2021-11-04 Xun Qian , Rustem Islamov , Mher Safaryan , Peter Richtárik

We present a new method that includes three key components of distributed optimization and federated learning: variance reduction of stochastic gradients, partial participation, and compressed communication. We prove that the new method has…

Machine Learning · Computer Science 2024-01-04 Alexander Tyurin , Peter Richtárik

We propose Adaptive Compressed Gradient Descent (AdaCGD) - a novel optimization algorithm for communication-efficient training of supervised machine learning models with adaptive compression level. Our approach is inspired by the recently…

Machine Learning · Computer Science 2022-11-02 Maksim Makarenko , Elnur Gasanov , Rustem Islamov , Abdurakhmon Sadiev , Peter Richtarik

Communication overhead severely hinders the scalability of distributed machine learning systems. Recently, there has been a growing interest in using gradient compression to reduce the communication overhead of the distributed training.…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-05-19 Yuchen Zhong , Cong Xie , Shuai Zheng , Haibin Lin

We propose a communication efficient quasi-Newton method for large-scale multi-agent convex composite optimization. We assume the setting of a network of agents that cooperatively solve a global minimization problem with strongly convex…

Optimization and Control · Mathematics 2022-02-18 Yichuan Li , Petros G. Voulgaris , Nikolaos M. Freris

We propose a communication and computation efficient second-order method for distributed optimization. For each iteration, our method only requires $\mathcal{O}(d)$ communication complexity, where $d$ is the problem dimension. We also…

Optimization and Control · Mathematics 2023-05-30 Chengchang Liu , Lesi Chen , Luo Luo , John C. S. Lui

Due to the explosion in the size of the training datasets, distributed learning has received growing interest in recent years. One of the major bottlenecks is the large communication cost between the central server and the local workers.…

Machine Learning · Computer Science 2022-02-25 Yujia Wang , Lu Lin , Jinghui Chen

In this paper, we consider a strongly convex finite-sum minimization problem over a decentralized network and propose a communication-efficient decentralized Newton's method for solving it. We first apply dynamic average consensus (DAC) so…

Optimization and Control · Mathematics 2022-10-04 Huikang Liu , Jiaojiao Zhang , Anthony Man-Cho So , Qing Ling

We propose a distributed, cubic-regularized Newton method for large-scale convex optimization over networks. The proposed method requires only local computations and communications and is suitable for federated learning applications over…

Optimization and Control · Mathematics 2020-07-08 César A. Uribe , Ali Jadbabaie

Inspired by recent work of Islamov et al (2021), we propose a family of Federated Newton Learn (FedNL) methods, which we believe is a marked step in the direction of making second-order methods applicable to FL. In contrast to the…

Machine Learning · Computer Science 2022-05-24 Mher Safaryan , Rustem Islamov , Xun Qian , Peter Richtárik

In this paper, we study the distributed nonconvex optimization problem, which aims to minimize the average value of the local nonconvex cost functions using local information exchange. To reduce the communication overhead, we introduce…

Optimization and Control · Mathematics 2025-02-12 Lei Xu , Xinlei Yi , Guanghui Wen , Yang Shi , Karl H. Johansson , Tao Yang

Information compression is essential to reduce communication cost in distributed optimization over peer-to-peer networks. This paper proposes a communication-efficient linearly convergent distributed (COLD) algorithm to solve strongly…

Optimization and Control · Mathematics 2021-05-17 Jiaqi Zhang , Keyou You , Lihua Xie

Communication compression is an essential strategy for alleviating communication overhead by reducing the volume of information exchanged between computing nodes in large-scale distributed stochastic optimization. Although numerous…

Machine Learning · Computer Science 2025-03-19 Yutong He , Xinmeng Huang , Yiming Chen , Wotao Yin , Kun Yuan

We consider distributed convex optimization problems in the regime when the communication between the server and the workers is expensive in both uplink and downlink directions. We develop a new and provably accelerated method, which we…

Optimization and Control · Mathematics 2023-11-28 Alexander Tyurin , Peter Richtárik

Distributed optimization is widely used in large-scale and privacy-preserving machine learning, where each agent stores a local objective and communicates only with its neighbors in a connected network. We study decentralized second-order…

In this paper, we propose new proximal Newton-type methods for convex optimization problems in composite form. The applications include model predictive control (MPC) and embedded MPC. Our new methods are computationally attractive since…

Optimization and Control · Mathematics 2020-07-21 Ilan Adler , Zhiyue Tom Hu , Tianyi Lin

In this paper, we design two compressed decentralized algorithms for solving nonconvex stochastic optimization under two different scenarios. Both algorithms adopt a momentum technique to achieve fast convergence and a message-compression…

Machine Learning · Computer Science 2025-08-08 Wei Liu , Anweshit Panda , Ujwal Pandey , Christopher Brissette , Yikang Shen , George M. Slota , Naigang Wang , Jie Chen , Yangyang Xu

Due to the high communication cost in distributed and federated learning, methods relying on compressed communication are becoming increasingly popular. Besides, the best theoretically and practically performing gradient-type methods…

Machine Learning · Computer Science 2021-11-09 Zhize Li , Peter Richtárik
‹ Prev 1 2 3 10 Next ›