English
Related papers

Related papers: Differentially Quantized Gradient Methods

200 papers

Gradient descent algorithm is the most utilized method when optimizing machine learning issues. However, there exists many local minimums and saddle points in the loss function, especially for high dimensional non-convex optimization…

Machine Learning · Computer Science 2021-07-19 Zhicheng Cai

In distributed training, the communication cost due to the transmission of gradients or the parameters of the deep model is a major bottleneck in scaling up the number of processing nodes. To address this issue, we propose \emph{dithered…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-04-03 Afshin Abdi , Faramarz Fekri

The compensated quotient-difference (Compqd) algorithm is proposed along with some applications. The main motivation is based on the fact that the standard quotient-difference (qd) algorithm can be numerically unstable. The Compqd algorithm…

Numerical Analysis · Mathematics 2017-02-20 Peibing Du , Roberto Barrio , Hao Jiang , Lizhi Cheng

In this paper we introduce a unified analysis of a large family of variants of proximal stochastic gradient descent ({\tt SGD}) which so far have required different intuitions, convergence analyses, have different applications, and which…

Optimization and Control · Mathematics 2019-05-28 Eduard Gorbunov , Filip Hanzely , Peter Richtárik

Stochastic gradient descent (SGD), which dates back to the 1950s, is one of the most popular and effective approaches for performing stochastic optimization. Research on SGD resurged recently in machine learning for optimizing convex loss…

Machine Learning · Computer Science 2019-12-24 Jie Chen , Ronny Luss

Distributed algorithms to solve linear equations in multi-agent networks have attracted great research attention and many iteration-based distributed algorithms have been developed. The convergence speed is a key factor to be considered for…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-07-30 Haodi Ping , Yongcai Wang , Deying Li

The article discusses distributed gradient-descent algorithms for computing local and global minima in nonconvex optimization. For local optimization, we focus on distributed stochastic gradient descent (D-SGD)--a simple network-based…

Optimization and Control · Mathematics 2020-09-17 Brian Swenson , Soummya Kar , H. Vincent Poor , José M. F. Moura , Aaron Jaech

One of the most widely used methods for solving large-scale stochastic optimization problems is distributed asynchronous stochastic gradient descent (DASGD), a family of algorithms that result from parallelizing stochastic gradient descent…

Optimization and Control · Mathematics 2021-07-08 Zhengyuan Zhou , Panayotis Mertikopoulos , Nicholas Bambos , Peter W. Glynn , Yinyu Ye

Optimization techniques are of great importance to effectively and efficiently train a deep neural network (DNN). It has been shown that using the first and second order statistics (e.g., mean and variance) to perform Z-score…

Computer Vision and Pattern Recognition · Computer Science 2020-04-09 Hongwei Yong , Jianqiang Huang , Xiansheng Hua , Lei Zhang

In this paper, we present a distributed variant of adaptive stochastic gradient method for training deep neural networks in the parameter-server model. To reduce the communication cost among the workers and server, we incorporate two types…

Machine Learning · Computer Science 2021-06-16 Congliang Chen , Li Shen , Haozhi Huang , Wei Liu

Network-distributed optimization has attracted significant attention in recent years due to its ever-increasing applications. However, the classic decentralized gradient descent (DGD) algorithm is communication-inefficient for large-scale…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-12-09 Xin Zhang , Jia Liu , Zhengyuan Zhu , Elizabeth S. Bentley

In this paper, a gradient-free distributed algorithm is introduced to solve a set constrained optimization problem under a directed communication network. Specifically, at each time-step, the agents locally compute a so-called…

Optimization and Control · Mathematics 2021-09-06 Yipeng Pang , Guoqiang Hu

Consider a linear quadratic regulator (LQR) problem being solved in a model-free manner using the policy gradient approach. If the gradient of the quadratic cost is being transmitted across a rate-limited channel, both the convergence and…

Optimization and Control · Mathematics 2024-09-20 Lintao Ye , Aritra Mitra , Vijay Gupta

We consider distributed optimization under communication constraints for training deep learning models. We propose a new algorithm, whose parameter updates rely on two forces: a regular gradient step, and a corrective direction dictated by…

Machine Learning · Computer Science 2022-04-29 Yunfei Teng , Wenbo Gao , Francois Chalus , Anna Choromanska , Donald Goldfarb , Adrian Weller

We study finite-time performance of a recently proposed distributed dual subgradient (DDSG) method for convex constrained multi-agent optimization problems. The algorithm enjoys performance guarantees on the last primal iterate, as opposed…

Optimization and Control · Mathematics 2023-07-28 Subhonmesh Bose , Hoa Dinh Nguyen , Haitian Liu , Ye Guo , Thinh T. Doan , Carolyn L. Beck

Distributed training enables large-scale deep learning, but suffers from high communication overhead, especially as models and datasets grow. Gradient compression, particularly quantization, is a promising approach to mitigate this…

Machine Learning · Computer Science 2025-07-30 Jihao Xin , Marco Canini , Peter Richtárik , Samuel Horváth

Distributed optimization plays an important role in modern large-scale machine learning and data processing systems by optimizing the utilization of computational resources. One of the classical and popular approaches is Local Stochastic…

Optimization and Control · Mathematics 2024-12-19 Andrey Sadchikov , Savelii Chezhegov , Aleksandr Beznosikov , Alexander Gasnikov

We address the problem of network quantization, that is, reducing bit-widths of weights and/or activations to lighten network architectures. Quantization methods use a rounding function to map full-precision values to the nearest quantized…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Dohyung kim , Junghyup Lee , Bumsub Ham

The gradient descent method aims at finding local minima of a given multivariate function by moving along the direction of its gradient, and hence, the algorithm typically involves computing all partial derivatives of a given function,…

Quantum Physics · Physics 2025-02-25 Nhat A. Nghiem

Stochastic Gradient Descent (SGD) with gradient clipping is a powerful technique for enabling differentially private optimization. Although prior works extensively investigated clipping with a constant threshold, private training remains…

Machine Learning · Computer Science 2024-12-31 Egor Shulgin , Peter Richtárik