English
Related papers

Related papers: Toward Communication Efficient Adaptive Gradient M…

200 papers

Federated learning (FL) enables multiple devices to collaboratively learn a global model without sharing their personal data. In real-world applications, the different parties are likely to have heterogeneous data distribution and limited…

Machine Learning · Computer Science 2021-11-23 Ouiame Marnissi , Hajar El Hammouti , El Houcine Bergou

High network communication cost for synchronizing gradients and parameters is the well-known bottleneck of distributed training. In this work, we propose TernGrad that uses ternary gradients to accelerate distributed deep learning in data…

Machine Learning · Computer Science 2018-01-01 Wei Wen , Cong Xu , Feng Yan , Chunpeng Wu , Yandan Wang , Yiran Chen , Hai Li

We propose an algorithm for distributed optimization over time-varying communication networks. Our algorithm uses an optimized ratio between the number of rounds of communication and gradient evaluations to achieve fast convergence. The…

Optimization and Control · Mathematics 2020-01-08 Bryan Van Scoy , Laurent Lessard

Stochastic gradient algorithms are the main focus of large-scale optimization problems and led to important successes in the recent advancement of the deep learning algorithms. The convergence of SGD depends on the careful choice of…

Machine Learning · Computer Science 2017-03-03 Caglar Gulcehre , Jose Sotelo , Marcin Moczulski , Yoshua Bengio

Communication overhead is a major bottleneck hampering the scalability of distributed machine learning systems. Recently, there has been a surge of interest in using gradient compression to improve the communication efficiency of…

Machine Learning · Computer Science 2019-10-29 Shuai Zheng , Ziyue Huang , James T. Kwok

Federated learning is an emerging distributed machine learning method, enables a large number of clients to train a model without exchanging their local data. The time cost of communication is an essential bottleneck in federated learning,…

Machine Learning · Computer Science 2023-09-19 Hao Sun , Li Shen , Shixiang Chen , Jingwei Sun , Jing Li , Guangzhong Sun , Dacheng Tao

The past few years have witnessed the flourishing of large-scale deep neural network models with ever-growing parameter numbers. Training such large-scale models typically requires massive memory and computing resources, necessitating…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-08-30 Yunze Wei , Tianshuo Hu , Cong Liang , Yong Cui

Emerging technologies and applications including Internet of Things (IoT), social networking, and crowd-sourcing generate large amounts of data at the network edge. Machine learning models are often built from the collected data, to enable…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-02-19 Shiqiang Wang , Tiffany Tuor , Theodoros Salonidis , Kin K. Leung , Christian Makaya , Ting He , Kevin Chan

Adaptive inference is a promising technique to improve the computational efficiency of deep models at test time. In contrast to static models which use the same computation graph for all instances, adaptive networks can dynamically adjust…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Hao Li , Hong Zhang , Xiaojuan Qi , Ruigang Yang , Gao Huang

In distributed and federated learning algorithms, communication overhead is often reduced by performing multiple local updates between communication rounds. However, due to data heterogeneity across nodes and the local gradient noise within…

Machine Learning · Computer Science 2025-12-02 Yan Huang , Jinming Xu , Jiming Chen , Karl Henrik Johansson

In this paper, we consider communication-efficient over-the-air federated learning (FL), where multiple edge devices with non-independent and identically distributed datasets perform multiple local iterations in each communication round and…

Signal Processing · Electrical Eng. & Systems 2022-03-29 Yinan Zou , Zixin Wang , Xu Chen , Haibo Zhou , Yong Zhou

This paper presents a new class of gradient methods for distributed machine learning that adaptively skip the gradient calculations to learn with reduced communication and computation. Simple rules are designed to detect slowly-varying…

Machine Learning · Statistics 2018-05-31 Tianyi Chen , Georgios B. Giannakis , Tao Sun , Wotao Yin

Over-the-air computation is a communication-efficient solution for federated learning (FL). In such a system, iterative procedure is performed: Local gradient of private loss function is updated, amplified and then transmitted by every…

Machine Learning · Computer Science 2023-09-06 Rongfei Fan , Xuming An , Shiyuan Zuo , Han Hu

Federated Learning (FL) in mobile environments faces significant communication bottlenecks. Gradient compression has proven as an effective solution to this issue, offering substantial benefits in environments with limited bandwidth and…

Machine Learning · Computer Science 2024-11-26 Rongwei Lu , Yutong Jiang , Yinan Mao , Chen Tang , Bin Chen , Laizhong Cui , Zhi Wang

Federated learning is a machine learning approach that enables multiple devices (i.e., agents) to train a shared model cooperatively without exchanging raw data. This technique keeps data localized on user devices, ensuring privacy and…

Machine Learning · Computer Science 2025-07-16 Dimitrios Kritsiolis , Constantine Kotropoulos

Federated learning is a popular distributed and privacy-preserving learning paradigm in machine learning. Recently, some federated learning algorithms have been proposed to solve the distributed minimax problems. However, these federated…

Machine Learning · Computer Science 2024-03-01 Feihu Huang , Xinrui Wang , Junyi Li , Songcan Chen

Distributed-memory implementations of numerical optimization algorithm, such as stochastic gradient descent (SGD), require interprocessor communication at every iteration of the algorithm. On modern distributed-memory clusters where…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-14 Aditya Devarakonda , Ramakrishnan Kannan

We propose a Stochastic Gradient Descent (SGD)-type algorithm for Personalized Federated Learning which can be particularly attractive for mobile energy-limited regimes due to its low per-client computational cost. The model to be trained…

Machine Learning · Computer Science 2025-12-15 Sotirios Nikoloutsopoulos , Iordanis Koutsopoulos , Michalis K. Titsias

Federated learning can enable remote workers to collaboratively train a shared machine learning model while allowing training data to be kept locally. In the use case of wireless mobile devices, the communication overhead is a critical…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-01-11 Kai Yue , Richeng Jin , Chau-Wai Wong , Huaiyu Dai

In distributed training, communication often emerges as a bottleneck. In response, we introduce Kimad, a solution that offers adaptive gradient compression. By consistently monitoring bandwidth, Kimad refines compression ratios to match…

Machine Learning · Computer Science 2023-12-14 Jihao Xin , Ivan Ilin , Shunkang Zhang , Marco Canini , Peter Richtárik
‹ Prev 1 4 5 6 7 8 10 Next ›