English
Related papers

Related papers: GT-STORM: Taming Sample, Communication, and Memory…

200 papers

We present new algorithms for optimizing non-smooth, non-convex stochastic objectives based on a novel analysis technique. This improves the current best-known complexity for finding a $(\delta,\epsilon)$-stationary point from…

Machine Learning · Computer Science 2025-08-08 Ashok Cutkosky , Harsh Mehta , Francesco Orabona

This paper studies decentralized optimization over a compact submanifold within a communication network of $n$ nodes, where each node possesses a smooth non-convex local cost function, and the goal is to jointly minimize the sum of these…

Optimization and Control · Mathematics 2025-04-17 Kangkang Deng , Jiang Hu

Stochastic gradient methods (SGMs) have been extensively used for solving stochastic problems or large-scale machine learning problems. Recent works employ various techniques to improve the convergence rate of SGMs for both convex and…

Optimization and Control · Mathematics 2022-05-02 Yangyang Xu , Yibo Xu

We study optimization algorithms for the finite sum problems frequently arising in machine learning applications. First, we propose novel variants of stochastic gradient descent with a variance reduction property that enables linear…

Machine Learning · Computer Science 2017-07-06 Jakub Konečný

This paper proposes the Doubly Compressed Momentum-assisted stochastic gradient tracking algorithm $\texttt{DoCoM}$ for communication-efficient decentralized optimization. The algorithm features two main ingredients to achieve a…

Machine Learning · Computer Science 2023-08-01 Chung-Yiu Yau , Hoi-To Wai

This paper proposes a distributed stochastic algorithm with variance reduction for general smooth non-convex finite-sum optimization, which has wide applications in signal processing and machine learning communities. In distributed setting,…

Optimization and Control · Mathematics 2021-07-23 Xia Jiang , Xianlin Zeng , Jian Sun , Jie Chen

This paper considers decentralized minimization of $N:=nm$ smooth non-convex cost functions equally divided over a directed network of $n$ nodes. Specifically, we describe a stochastic first-order gradient method, called GT-SARAH, that…

Optimization and Control · Mathematics 2021-09-21 Ran Xin , Usman A. Khan , Soummya Kar

For SGD based distributed stochastic optimization, computation complexity, measured by the convergence rate in terms of the number of stochastic gradient calls, and communication complexity, measured by the number of inter-node…

Optimization and Control · Mathematics 2019-05-14 Hao Yu , Rong Jin

We focus on decentralized stochastic non-convex optimization, where $n$ agents work together to optimize a composite objective function which is a sum of a smooth term and a non-smooth convex term. To solve this problem, we propose two…

Optimization and Control · Mathematics 2023-06-23 Tesi Xiao , Xuxing Chen , Krishnakumar Balasubramanian , Saeed Ghadimi

Minimax problems have recently attracted a lot of research interests. A few efforts have been made to solve decentralized nonconvex strongly-concave (NCSC) minimax-structured optimization; however, all of them focus on smooth problems with…

Optimization and Control · Mathematics 2023-04-06 Yangyang Xu

This paper addresses the problem of nonconvex nonsmooth decentralised optimisation in multi-agent networks with undirected connected communication graphs. Our contribution lies in introducing an algorithmic framework designed for the…

Optimization and Control · Mathematics 2023-12-08 Behnam Mafakheri , Jonathan H. Manton , Iman Shames

We consider decentralized machine learning over a network where the training data is distributed across $n$ agents, each of which can compute stochastic model updates on their local data. The agent's common goal is to find a model that…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-02-09 Anastasia Koloskova , Tao Lin , Sebastian U. Stich

We study differentially private (DP) optimization algorithms for stochastic and empirical objectives which are neither smooth nor convex, and propose methods that return a Goldstein-stationary point with sample complexity bounds that…

Machine Learning · Computer Science 2025-06-10 Guy Kornowski , Daogao Liu , Kunal Talwar

Gradient tracking (GT) is an algorithm designed for solving decentralized optimization problems over a network (such as training a machine learning model). A key feature of GT is a tracking mechanism that allows to overcome data…

Optimization and Control · Mathematics 2023-01-05 Yue Liu , Tao Lin , Anastasia Koloskova , Sebastian U. Stich

In this paper, we show how to transform any optimization problem that arises from fitting a machine learning model into one that (1) detects and removes contaminated data from the training set while (2) simultaneously fitting the trimmed…

Machine Learning · Statistics 2017-02-07 Aleksandr Aravkin , Damek Davis

The graduated optimization approach, also known as the continuation method, is a popular heuristic to solving non-convex problems that has received renewed interest over the last decade. Despite its popularity, very little is known in terms…

Machine Learning · Computer Science 2015-07-28 Elad Hazan , Kfir Y. Levy , Shai Shalev-Shwartz

We consider network-based decentralized optimization problems, where each node in the network possesses a local function and the objective is to collectively attain a consensus solution that minimizes the sum of all the local functions. A…

Optimization and Control · Mathematics 2023-09-07 Suhail M. Shah , Albert S. Berahas , Raghu Bollapragada

In this paper, we investigate the decentralized statistical inference problem, where a network of agents cooperatively recover a (structured) vector from private noisy samples without centralized coordination. Existing optimization-based…

Machine Learning · Computer Science 2021-04-06 He Wang , Yifei Shen , Ziyuan Wang , Dongsheng Li , Jun Zhang , Khaled B. Letaief , Jie Lu

Minimax optimization problems have attracted significant attention in recent years due to their widespread application in numerous machine learning models. To solve the minimax problem, a wide variety of stochastic optimization methods have…

Machine Learning · Computer Science 2024-06-12 Hongchang Gao

One fundamental problem in decentralized multi-agent optimization is the trade-off between gradient/sampling complexity and communication complexity. We propose new algorithms whose gradient and sampling complexities are graph topology…

Optimization and Control · Mathematics 2021-01-14 Guanghui Lan , Yuyuan Ouyang , Yi Zhou