English
Related papers

Related papers: Compressed Distributed Stochastic Nonconvex Optimi…

200 papers

The goal of this thesis is to study the compression problems arising in distributed computing systematically. In the first part of the thesis, we study gradient compression for distributed first-order optimization. We begin by establishing…

Information Theory · Computer Science 2023-01-12 Prathamesh Mayekar

By ensuring differential privacy in the learning algorithms, one can rigorously mitigate the risk of large models memorizing sensitive training data. In this paper, we study two algorithms for this purpose, i.e., DP-SGD and DP-NSGD, which…

Machine Learning · Computer Science 2022-06-28 Xiaodong Yang , Huishuai Zhang , Wei Chen , Tie-Yan Liu

This paper addresses two fundamental challenges in distributed online convex optimization: communication efficiency and optimization under limited feedback. We propose a unified framework named Online Compressed Gradient Tracking (OCGT),…

Optimization and Control · Mathematics 2025-12-08 Longkang Zhu , Xinli Shi , Xiangping Xu , Jinde Cao , Xiangyong Chen

We present new algorithms for optimizing non-smooth, non-convex stochastic objectives based on a novel analysis technique. This improves the current best-known complexity for finding a $(\delta,\epsilon)$-stationary point from…

Machine Learning · Computer Science 2025-08-08 Ashok Cutkosky , Harsh Mehta , Francesco Orabona

We present a new class of decentralized first-order methods for nonsmooth and stochastic optimization problems defined over multiagent networks. Considering that communication is a major bottleneck in decentralized optimization, our main…

Optimization and Control · Mathematics 2017-02-07 Guanghui Lan , Soomin Lee , Yi Zhou

Privacy protection has become an increasingly pressing requirement in distributed optimization. However, equipping distributed optimization with differential privacy, the state-of-the-art privacy protection mechanism, will unavoidably…

Optimization and Control · Mathematics 2023-04-28 Yu Xuan , Yongqiang Wang

This paper investigates accelerating the convergence of distributed optimization algorithms on non-convex problems. We propose a distributed primal-dual stochastic gradient descent~(SGD) equipped with "powerball" method to accelerate. We…

Optimization and Control · Mathematics 2021-10-15 Shengjun Zhang , Colleen P. Bailey

We study distributed big-data nonconvex optimization in multi-agent networks. We consider the (constrained) minimization of the sum of a smooth (possibly) nonconvex function, i.e., the agents' sum-utility, plus a convex (possibly) nonsmooth…

Optimization and Control · Mathematics 2018-09-03 Ivano Notarnicola , Ying Sun , Gesualdo Scutari , Giuseppe Notarstefano

We propose a novel algorithm for distributed stochastic gradient descent (SGD) with compressed gradient communication in the parameter-server framework. Our gradient compression technique, named flattened one-bit stochastic gradient descent…

Machine Learning · Computer Science 2024-05-21 Alexander Stollenwerk , Laurent Jacques

We devise a distributed asynchronous stochastic epsilon-gradient-based algorithm to enable a network of computing and communicating nodes to solve a constrained discrete-time time-varying stochastic convex optimization problem. Each node…

Optimization and Control · Mathematics 2014-10-02 Andrea Simonetto , Leon Kester , Geert Leus

Decentralized optimization and communication compression have exhibited their great potential in accelerating distributed machine learning by mitigating the communication bottleneck in practice. While existing decentralized algorithms with…

Machine Learning · Computer Science 2021-08-13 Yao Li , Xiaorui Liu , Jiliang Tang , Ming Yan , Kun Yuan

We study convex optimization problems under differential privacy (DP). With heavy-tailed gradients, existing works achieve suboptimal rates. The main obstacle is that existing gradient estimators have suboptimal tail properties, resulting…

Machine Learning · Computer Science 2024-08-20 Puning Zhao , Jiafei Wu , Zhe Liu , Chong Wang , Rongfei Fan , Qingming Li

We investigate a distributed optimization problem over a cooperative multi-agent time-varying network, where each agent has its own decision variables that should be set so as to minimize its individual objective subject to local…

Optimization and Control · Mathematics 2018-05-24 Chuanye Gu , Zhiyou Wu , Jueyou Li

In this report, we study decentralized stochastic optimization to minimize a sum of smooth and strongly convex cost functions when the functions are distributed over a directed network of nodes. In contrast to the existing work, we use…

Machine Learning · Computer Science 2020-07-24 Muhammad I. Qureshi , Ran Xin , Soummya Kar , Usman A. Khan

This paper studies the stochastic nonconvex-strongly-concave minimax optimization over a multi-agent network. We propose an efficient algorithm, called Decentralized Recursive gradient descEnt Ascent Method (DREAM), which achieves the…

Machine Learning · Computer Science 2024-05-15 Lesi Chen , Haishan Ye , Luo Luo

In this paper, we study distributed big-data nonconvex optimization in multi-agent networks. We consider the (constrained) minimization of the sum of a smooth (possibly) nonconvex function, i.e., the agents' sum-utility, plus a convex…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-05-03 Ivano Notarnicola , Ying Sun , Gesualdo Scutari , Giuseppe Notarstefano

Asynchronous computation and gradient compression have emerged as two key techniques for achieving scalability in distributed optimization for large-scale machine learning. This paper presents a unified analysis framework for distributed…

Optimization and Control · Mathematics 2018-11-30 Sarit Khirirat , Hamid Reza Feyzmahdavian , Mikael Johansson

Privacy preservation is addressed for decentralized optimization, where $N$ agents cooperatively minimize the sum of $N$ convex functions private to these individual agents. In most existing decentralized optimization approaches,…

Optimization and Control · Mathematics 2018-07-03 Chunlei Zhang , Muaz Ahmad , Yongqiang Wang

This paper considers a distributed stochastic non-convex optimization problem, where the nodes in a network cooperatively minimize a sum of $L$-smooth local cost functions with sparse gradients. By adaptively adjusting the stepsizes…

Optimization and Control · Mathematics 2024-04-01 Dongyu Han , Kun Liu , Yeming Lin , Yuanqing Xia

This paper aims at distributed multi-agent convex optimization where the communications network among the agents are presented by a random sequence of possibly state-dependent weighted graphs. This is the first work to consider both random…

Systems and Control · Electrical Eng. & Systems 2024-12-31 Seyyed Shaho Alaviani , Atul Kelkar