English
Related papers

Related papers: Communication-Efficient Distributed Training for C…

200 papers

With the increased penetration and proliferation of Internet of Things (IoT) devices, there is a growing trend towards distributing the power of deep learning (DL) across edge devices rather than centralizing it in the cloud. This…

Machine Learning · Computer Science 2021-10-07 Yuhao Chen , Qianqian Yang , Shibo He , Zhiguo Shi , Jiming Chen

We propose a distributed approach to train deep neural networks (DNNs), which has guaranteed convergence theoretically and great scalability empirically: close to 6 times faster on instance of ImageNet data set when run with 6 machines. The…

Machine Learning · Statistics 2016-10-04 Abhimanu Kumar , Pengtao Xie , Junming Yin , Eric P. Xing

There is growing interest in large-scale machine learning and optimization over decentralized networks, e.g. in the context of multi-agent learning and federated learning. Due to the imminent need to alleviate the communication burden, the…

Machine Learning · Statistics 2020-09-02 Boyue Li , Shicong Cen , Yuxin Chen , Yuejie Chi

To address the communication burden and privacy concerns associated with the centralized server in Federated Learning (FL), Decentralized Federated Learning (DFL) has emerged, which discards the server with a peer-to-peer (P2P)…

Machine Learning · Computer Science 2023-10-10 Qinglun Li , Miao Zhang , Nan Yin , Quanjun Yin , Li Shen

Distributed reinforcement learning policies face network delays, jitter, and packet loss when deployed across edge devices and cloud servers. Standard RL training assumes zero-latency interaction, causing severe performance degradation…

Machine Learning · Computer Science 2026-03-16 Carlos Purves , Pietro Lio'

We propose a novel and efficient training method for RNNs by iteratively seeking a local minima on the loss surface within a small region, and leverage this directional vector for the update, in an outer-loop. We propose to utilize the…

Machine Learning · Computer Science 2020-10-16 Yun Yue , Ming Li , Venkatesh Saligrama , Ziming Zhang

Distributed training in deep learning (DL) is common practice as data and models grow. The current practice for distributed training of deep neural networks faces the challenges of communication bottlenecks when operating at scale, and…

Machine Learning · Computer Science 2020-12-21 Shubhankar Gahlot , Junqi Yin , Mallikarjun Shankar

Deep neural networks (DNNs) are quantized for efficient inference on resource-constrained platforms. However, training deep learning models with low-precision weights and activations involves a demanding optimization task, which calls for…

Machine Learning · Computer Science 2021-05-25 Ziang Long , Penghang Yin , Jack Xin

We consider distributed optimization under communication constraints for training deep learning models. We propose a new algorithm, whose parameter updates rely on two forces: a regular gradient step, and a corrective direction dictated by…

Machine Learning · Computer Science 2022-04-29 Yunfei Teng , Wenbo Gao , Francois Chalus , Anna Choromanska , Donald Goldfarb , Adrian Weller

This paper proposes a theoretical framework to evaluate and compare the performance of stochastic gradient algorithms for distributed learning in relation to their behavior around local minima in nonconvex environments. Previous works have…

Machine Learning · Computer Science 2025-07-03 Ying Cao , Zhaoxian Wu , Kun Yuan , Ali H. Sayed

Vertical Federated Learning (VFL) enables collaborative model training across feature-partitioned devices, yet its reliance on device-server information exchange introduces significant communication overhead and privacy risks. Downlink…

Machine Learning · Computer Science 2025-12-29 Jianing Zhang , Evan Chen , Dong-Jun Han , Chaoyue Liu , Christopher G. Brinton

To mitigate the privacy leakages and communication burdens of Federated Learning (FL), decentralized FL (DFL) discards the central server and each client only communicates with its neighbors in a decentralized communication network.…

Machine Learning · Computer Science 2023-06-12 Yifan Shi , Li Shen , Kang Wei , Yan Sun , Bo Yuan , Xueqian Wang , Dacheng Tao

Network slicing promises to provision diversified services with distinct requirements in one infrastructure. Deep reinforcement learning (e.g., deep $\mathcal{Q}$-learning, DQL) is assumed to be an appropriate algorithm to solve the…

Machine Learning · Computer Science 2019-06-12 Chen Qi , Yuxiu Hua , Rongpeng Li , Zhifeng Zhao , Honggang Zhang

Federated Learning (FL) is a promising framework for performing privacy-preserving, distributed learning with a set of clients. However, the data distribution among clients often exhibits non-IID, i.e., distribution shift, which makes…

Machine Learning · Computer Science 2022-06-07 Zhe Qu , Xingyu Li , Rui Duan , Yao Liu , Bo Tang , Zhuo Lu

Deep neural networks (DNNs) have demonstrated promising results in various complex tasks. However, current DNNs encounter challenges with over-parameterization, especially when there is limited training data available. To enhance the…

Machine Learning · Computer Science 2023-08-22 Xingyu Li , Bo Tang

Parallelization framework has become a necessity to speed up the training of deep neural networks (DNN) recently. Such framework typically employs the Model Average approach, denoted as MA-DNN, in which parallel workers conduct respective…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-07-19 Shizhao Sun , Wei Chen , Jiang Bian , Xiaoguang Liu , Tie-Yan Liu

In distributed optimization, the practical problem-solving performance is essentially sensitive to algorithm selection, parameter setting, problem type and data pattern. Thus, it is often laborious to acquire a highly efficient method for a…

Optimization and Control · Mathematics 2024-01-04 Daokuan Zhu , Tianqi Xu , Jie Lu

We propose near-optimal overlay networks based on $d$-regular expander graphs to accelerate decentralized federated learning (DFL) and improve its generalization. In DFL a massive number of clients are connected by an overlay network, and…

Networking and Internet Architecture · Computer Science 2022-01-03 Yifan Hua , Kevin Miller , Andrea L. Bertozzi , Chen Qian , Bao Wang

Regression with non-Euclidean responses -- e.g., probability distributions, networks, symmetric positive-definite matrices, and compositions -- has become increasingly important in modern applications. In this paper, we propose deep…

Machine Learning · Statistics 2025-10-21 Kyum Kim , Yaqing Chen , Paromita Dubey

Model fusion aims to integrate several deep neural network (DNN) models' knowledge into one by fusing parameters, and it has promising applications, such as improving the generalization of foundation models and parameter averaging in…

Machine Learning · Computer Science 2025-10-28 Zexi Li , Zhiqi Li , Jie Lin , Tao Shen , Jun Xiao , Yike Guo , Tao Lin , Chao Wu