Optimization and Control · Mathematics
Communication-Efficient Distributed SGD with Compressed Sensing
Yujie Tang, Vikram Ramanathan, Junshan Zhang, Na Li
2021-12-28
Machine Learning · Computer Science
Trustworthy Efficient Communication for Distributed Learning using LQ-SGD Algorithm
Hongyang Li, Lincen Bai, Caesar Wu, Mohammed Chadli +2
2025-06-24
Machine Learning · Computer Science
The Limits and Potentials of Local SGD for Distributed Heterogeneous Learning with Intermittent Communication
Kumar Kshitij Patel, Margalit Glasgow, Ali Zindari, Lingxiao Wang +4
2024-05-21
Machine Learning · Statistics
On Consensus-Optimality Trade-offs in Collaborative Deep Learning
Zhanhong Jiang, Aditya Balu, Chinmay Hegde, Soumik Sarkar
2018-05-31
Machine Learning · Computer Science
Layered SGD: A Decentralized and Synchronous SGD Algorithm for Scalable Deep Neural Network Training
Kwangmin Yu, Thomas Flynn, Shinjae Yoo, Nicholas D'Imperio
2019-06-17
Distributed, Parallel, and Cluster Computing · Computer Science
Fast and Straggler-Tolerant Distributed SGD with Reduced Computation Load
Maximilian Egger, Serge Kas Hanna, Rawad Bitar
2023-04-19
Cryptography and Security · Computer Science
Distributed Threat Intelligence at the Edge Devices: A Large Language Model-Driven Approach
Syed Mhamudul Hasan, Alaa M. Alotaibi, Sajedul Talukder, Abdur R. Shahid
2024-10-10
Machine Learning · Computer Science
Layer-wise Adaptive Gradient Sparsification for Distributed Deep Learning with Convergence Guarantees
Shaohuai Shi, Zhenheng Tang, Qiang Wang, Kaiyong Zhao +1
2020-03-03
Machine Learning · Computer Science
Federated Optimization: Distributed Machine Learning for On-Device Intelligence
Jakub Konečný, H. Brendan McMahan, Daniel Ramage, Peter Richtárik
2016-10-11
Machine Learning · Computer Science
Distributed Training with Heterogeneous Data: Bridging Median- and Mean-Based Algorithms
Xiangyi Chen, Tiancong Chen, Haoran Sun, Zhiwei Steven Wu +1
2019-06-07
Machine Learning · Computer Science
LEASGD: an Efficient and Privacy-Preserving Decentralized Algorithm for Distributed Learning
Hsin-Pai Cheng, Patrick Yu, Haojing Hu, Feng Yan +3
2018-11-28
Computer Vision and Pattern Recognition · Computer Science
Error Compensated Quantized SGD and its Applications to Large-scale Distributed Optimization
Jiaxiang Wu, Weidong Huang, Junzhou Huang, Tong Zhang
2018-06-22