English
Related papers

Related papers: Error Compensated Loopless SVRG, Quartz, and SDCA …

200 papers

Gradient compression is a popular technique for improving communication complexity of stochastic first-order methods in distributed training of machine learning models. However, the existing works consider only with-replacement sampling of…

Quantization (Alistarh et al., 2017) is an important (stochastic) compression technique that reduces the volume of transmitted bits during each communication round in distributed model training. Suresh et al. (2022) introduce correlated…

Machine Learning · Computer Science 2024-01-12 Andrei Panferov , Yury Demidovich , Ahmad Rammal , Peter Richtárik

The composite quantile regression (CQR) was introduced by Zou and Yuan [Ann. Statist. 36 (2008) 1108--1126] as a robust regression method for linear models with heavy-tailed errors while achieving high efficiency. Its penalized counterpart…

Methodology · Statistics 2023-10-16 Haeseong Moon , Wen-Xin Zhou

This paper is concerned with distributed stochastic multi-agent constrained optimization problem over time-varying network with a class of communication noise. This paper considers the problem in composite optimization setting which is more…

Optimization and Control · Mathematics 2022-12-20 Zhan Yu , Daniel W. C. Ho , Deming Yuan , Jie Liu

Many machine learning, statistical inference, and portfolio optimization problems require minimization of a composition of expected value functions (CEVF). Of particular interest is the finite-sum versions of such compositional optimization…

Machine Learning · Computer Science 2018-09-10 Tsung-Yu Hsieh , Yasser EL-Manzalawy , Yiwei Sun , Vasant Honavar

Communication bottleneck has been identified as a significant issue in distributed optimization of large-scale learning models. Recently, several approaches to mitigate this problem have been proposed, including different forms of gradient…

Machine Learning · Statistics 2019-11-05 Debraj Basu , Deepesh Data , Can Karakus , Suhas Diggavi

Training large machine learning models requires a distributed computing approach, with communication of the model updates being the bottleneck. For this reason, several methods based on the compression (e.g., sparsification and/or…

Machine Learning · Computer Science 2023-12-29 Konstantin Mishchenko , Eduard Gorbunov , Martin Takáč , Peter Richtárik

Local SGD is a promising approach to overcome the communication overhead in distributed learning by reducing the synchronization frequency among worker nodes. Despite the recent theoretical advances of local SGD in empirical risk…

Machine Learning · Computer Science 2021-03-01 Yuyang Deng , Mehrdad Mahdavi

Federated learning (FL) has become a hot research area in enabling the collaborative training of machine learning models among multiple clients that hold sensitive local data. Nevertheless, unconstrained federated optimization has been…

Machine Learning · Computer Science 2022-08-31 Ying Cui , Yangchen Li , Chencheng Ye

In recent centralized nonconvex distributed learning and federated learning, local methods are one of the promising approaches to reduce communication time. However, existing work has mainly focused on studying first-order optimality…

Machine Learning · Computer Science 2022-10-13 Tomoya Murata , Taiji Suzuki

This paper addresses two fundamental challenges in distributed online convex optimization: communication efficiency and optimization under limited feedback. We propose Online Compressed Gradient Tracking with one-point Bandit Feedback…

Optimization and Control · Mathematics 2025-05-06 Longkang Zhu , Xinli Shi , Xiangping Xu , Jinde Cao

Linear encoding of sparse vectors is widely popular, but is commonly data-independent -- missing any possible extra (but a priori unknown) structure beyond sparsity. In this paper we present a new method to learn linear encoders that adapt…

Consider a discrete-time Linear Quadratic Regulator (LQR) problem solved using policy gradient descent when the system matrices are unknown. The gradient is transmitted across a noisy channel over a finite time horizon using analog…

Optimization and Control · Mathematics 2025-07-22 Ashwin Verma , Aritra Mitra , Lintao Ye , Vijay Gupta

Classical assumptions like strong convexity and Lipschitz smoothness often fail to capture the nature of deep learning optimization problems, which are typically non-convex and non-smooth, making traditional analyses less applicable. This…

Machine Learning · Computer Science 2025-05-01 Binchuan Qi , Wei Gong , Li Li

We develop and analyze a new family of {\em nonaccelerated and accelerated loopless variance-reduced methods} for finite sum optimization problems. Our convergence analysis relies on a novel expected smoothness condition which upper bounds…

Optimization and Control · Mathematics 2019-06-05 Xun Qian , Zheng Qu , Peter Richtárik

This paper is concerned with multi-agent optimization problem. A distributed randomized gradient-free mirror descent (DRGFMD) method is developed by introducing a randomized gradient-free oracle in the mirror descent scheme where the…

Optimization and Control · Mathematics 2019-03-12 Zhan Yu , Daniel W. C. Ho , Deming Yuan

We study high-dimensional rank regression when data are distributed across multiple machines and the loss is a non-additive U-statistic, as in convoluted rank regression (CRR). Classical communication-efficient surrogate likelihood (CSL)…

Methodology · Statistics 2026-02-05 Wen Zhang , Liping Zhu , Songshan Yang

Distributed machine learning enables scalability and computational offloading, but requires significant levels of communication. Consequently, communication efficiency in distributed learning settings is an important consideration,…

Machine Learning · Computer Science 2022-09-27 Yicheng Chen , Rick S. Blum , Brian M. Sadler

Communication is a major bottleneck in distributed learning, especially in large-scale settings and in federated learning environments with slow links. Three standard ways to reduce this cost are communication compression, local training,…

Machine Learning · Computer Science 2026-05-21 Yassine Maziane , Ammar Mahran , Artavazd Maranjyan , Peter Richtárik

We propose a new stochastic optimization framework for empirical risk minimization problems such as those that arise in machine learning. The traditional approaches, such as (mini-batch) stochastic gradient descent (SGD), utilize an…

Machine Learning · Statistics 2020-02-04 Kenji Kawaguchi , Haihao Lu