English
Related papers

Related papers: Near-Optimal Sparse Allreduce for Distributed Deep…

200 papers

We present and analyze a stochastic distributed method (S-NEAR-DGD) that can tolerate inexact computation and inaccurate information exchange to alleviate the problems of costly gradient evaluations and bandwidth-limited communication in…

Optimization and Control · Mathematics 2021-02-02 Charikleia Iakovidou , Ermin Wei

We study the asynchronous stochastic gradient descent algorithm for distributed training over $n$ workers which have varying computation and communication frequency over time. In this algorithm, workers compute stochastic gradients in…

Machine Learning · Computer Science 2022-06-17 Anastasia Koloskova , Sebastian U. Stich , Martin Jaggi

Large-scale distributed training is increasingly becoming communication bound. Many gradient compression algorithms have been proposed to reduce the communication overhead and improve scalability. However, it has been observed that in some…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-03-30 Zhuang Wang , Xinyu Wu , T. S. Eugene Ng

Incorporating over-the-air computations (OAC) into the model training process of federated learning (FL) is an effective approach to alleviating the communication bottleneck in FL systems. Under OAC-FL, every client modulates its…

Machine Learning · Computer Science 2025-12-23 Jiaqi Zhu , Zhongyuan Zhao , Xiao Li , Ruihao Du , Shi Jin , Howard H. Yang

We study distributed optimization problems when $N$ nodes minimize the sum of their individual costs subject to a common vector variable. The costs are convex, have Lipschitz continuous gradient (with constant $L$), and bounded gradient. We…

Information Theory · Computer Science 2014-04-15 Dusan Jakovetic , Joao Xavier , Jose M. F. Moura

The communication bottleneck of over-the-air federated learning (OA-FL) lies in uploading the gradients of local learning models. In this paper, we study the reduction of the communication overhead in the gradients uploading by using the…

Signal Processing · Electrical Eng. & Systems 2023-04-11 Chenxi Zhong , Xiaojun Yuan

Communication bottleneck has been identified as a significant issue in distributed optimization of large-scale learning models. Recently, several approaches to mitigate this problem have been proposed, including different forms of gradient…

Machine Learning · Statistics 2019-11-05 Debraj Basu , Deepesh Data , Can Karakus , Suhas Diggavi

In this thesis, I study the minimax oracle complexity of distributed stochastic optimization. First, I present the "graph oracle model", an extension of the classic oracle complexity framework that can be applied to study distributed…

Optimization and Control · Mathematics 2021-09-03 Blake Woodworth

The significant progress in constructing graph spanners that are sparse (small number of edges) or light (low total weight) has skipped spanners that are everywhere-sparse (small maximum degree). This disparity is in line with other network…

Data Structures and Algorithms · Computer Science 2012-05-02 Eden Chlamtac , Michael Dinitz , Robert Krauthgamer

The distributed setting for Saddle Problems (SPs) has recently emerged as a framework for various modern applications in machine learning and multiagent systems. Despite its relevance, the theoretical foundations of this setting have not…

Optimization and Control · Mathematics 2026-05-19 Ruichen Luo , Anton Rodomanov , Sebastian U. Stich

In this paper, we introduce a new perspective on training deep neural networks capable of state-of-the-art performance without the need for the expensive over-parameterization by proposing the concept of In-Time Over-Parameterization (ITOP)…

Machine Learning · Computer Science 2021-06-16 Shiwei Liu , Lu Yin , Decebal Constantin Mocanu , Mykola Pechenizkiy

This work aims at improving the energy efficiency of decentralized learning by optimizing the mixing matrix, which controls the communication demands during the learning process. Through rigorous analysis based on a state-of-the-art…

Machine Learning · Computer Science 2024-05-24 Xusheng Zhang , Cho-Chun Chiu , Ting He

Communication overhead is a critical challenge in federated learning, particularly in bandwidth-constrained networks. Although many methods have been proposed to reduce communication overhead, most focus solely on compressing individual…

Machine Learning · Computer Science 2026-01-16 Shenlong Zheng , Zhen Zhang , Yuhui Deng , Geyong Min , Lin Cui

Lossy gradient compression has become a practical tool to overcome the communication bottleneck in centrally coordinated distributed training of machine learning models. However, algorithms for decentralized training with compressed…

Machine Learning · Computer Science 2020-10-20 Thijs Vogels , Sai Praneeth Karimireddy , Martin Jaggi

Recently, sparse training methods have started to be established as a de facto approach for training and inference efficiency in artificial neural networks. Yet, this efficiency is just in theory. In practice, everyone uses a binary mask to…

Machine Learning · Computer Science 2022-07-13 Selima Curci , Decebal Constantin Mocanu , Mykola Pechenizkiyi

The Segment Anything Model (SAM) achieves strong open-vocabulary segmentation, but its ViT-based image encoders dominate inference latency and memory. Existing activation compression methods, such as token merging, reduce the token length…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Hoai-Chau Tran , Chi H. Nguyen , Duy M. H. Nguyen , Mathias Niepert , Fan Lai , Khoa D. Doan

Data characterized by high dimensionality and sparsity are commonly used to describe real-world node interactions. Low-rank representation (LR) can map high-dimensional sparse (HDS) data to low-dimensional feature spaces and infer node…

Machine Learning · Computer Science 2024-08-30 Qicong Hu , Hao Wu

The top-k error is a common measure of performance in machine learning and computer vision. In practice, top-k classification is typically performed with deep neural networks trained with the cross-entropy loss. Theoretical results indeed…

Machine Learning · Computer Science 2018-02-22 Leonard Berrada , Andrew Zisserman , M. Pawan Kumar

We study first-order optimization algorithms under the constraint that the descent direction is quantized using a pre-specified budget of $R$-bits per dimension, where $R \in (0 ,\infty)$. We propose computationally efficient optimization…

Machine Learning · Computer Science 2022-08-17 Rajarshi Saha , Mert Pilanci , Andrea J. Goldsmith

In this paper, we study the communication and (sub)gradient computation costs in distributed optimization and give a sharp complexity analysis for the proposed distributed accelerated gradient methods. We present two algorithms based on the…

Optimization and Control · Mathematics 2020-08-19 Huan Li , Cong Fang , Wotao Yin , Zhouchen Lin
‹ Prev 1 8 9 10 Next ›