English
Related papers

Related papers: Distributed Retraction-Free and Communication-Effi…

200 papers

This papers studies multi-agent (convex and \emph{nonconvex}) optimization over static digraphs. We propose a general distributed \emph{asynchronous} algorithmic framework whereby i) agents can update their local variables as well as…

Optimization and Control · Mathematics 2019-09-12 Ye Tian , Ying Sun , Gesualdo Scutari

This paper proposes a novel communication-efficient split learning (SL) framework, named SplitFC, which reduces the communication overhead required for transmitting intermediate feature and gradient vectors during the SL training process.…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-06 Yongjeong Oh , Jaeho Lee , Christopher G. Brinton , Yo-Seb Jeon

We present two stochastic descent algorithms that apply to unconstrained optimization and are particularly efficient when the objective function is slow to evaluate and gradients are not easily obtained, as in some PDE-constrained…

Optimization and Control · Mathematics 2019-04-30 David Kozak , Stephen Becker , Alireza Doostan , Luis Tenorio

We study distributed optimization problems over a network when the communication between the nodes is constrained, and so information that is exchanged between the nodes must be quantized. Recent advances using the distributed gradient…

Optimization and Control · Mathematics 2019-05-14 Thinh T. Doan , Siva Theja Maguluri , Justin Romberg

Federated learning (FL) is a distributed learning paradigm that enables a large number of mobile devices to collaboratively learn a model under the coordination of a central server without sharing their raw data. Despite its practical…

Machine Learning · Computer Science 2021-09-14 Bing Luo , Xiang Li , Shiqiang Wang , Jianwei Huang , Leandros Tassiulas

Fine-tuning pre-trained large language models (LLMs) in a distributed manner poses significant challenges on resource-constrained edge networks. To address this challenge, we propose SflLLM, a novel framework that integrates split federated…

Machine Learning · Computer Science 2025-07-03 Kai Zhao , Zhaohui Yang , Ye Hu , Mingzhe Chen , Chen Zhu , Zhaoyang Zhang

In this paper, we study distributed algorithms for large-scale AUC maximization with a deep neural network as a predictive model. Although distributed learning techniques have been investigated extensively in deep learning, they are not…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-12 Zhishuai Guo , Mingrui Liu , Zhuoning Yuan , Li Shen , Wei Liu , Tianbao Yang

In 6G mobile communication systems, various AI-based network functions and applications have been standardized. Federated learning (FL) is adopted as the core learning architecture for 6G systems to avoid privacy leakage from mobile user…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-01 Seyoung Ahn , Soohyeong Kim , Yongseok Kwon , Joohan Park , Jiseung Youn , Sunghyun Cho

We consider the problem of online stochastic optimization in a distributed setting with $M$ clients connected through a central server. We develop a distributed online learning algorithm that achieves order-optimal cumulative regret with…

Machine Learning · Computer Science 2023-06-07 Sudeep Salgia , Qing Zhao , Tamir Gabay , Kobi Cohen

Scalable machine learning over big data is an important problem that is receiving a lot of attention in recent years. On popular distributed environments such as Hadoop running on a cluster of commodity machines, communication costs are…

Machine Learning · Computer Science 2015-03-18 Dhruv Mahajan , Nikunj Agrawal , S. Sathiya Keerthi , S. Sundararajan , Leon Bottou

Federated learning (FL), which has gained increasing attention recently, enables distributed devices to train a common machine learning (ML) model for intelligent inference cooperatively without data sharing. However, problems in practical…

Machine Learning · Computer Science 2022-11-01 Yujie Zhou , Zhidu Li , Tong Tang , Ruyan Wang

A challenging problem in decentralized optimization is to develop algorithms with fast convergence on random and time varying topologies under unreliable and bandwidth-constrained communication network. This paper studies a stochastic…

Optimization and Control · Mathematics 2025-05-29 Chung-Yiu Yau , Haoming Liu , Hoi-To Wai

Intelligent mobile platforms such as smart vehicles and drones have recently become the focus of attention for onboard deployment of machine learning mechanisms to enable low latency decisions with low risk of privacy breach. However, most…

Information Theory · Computer Science 2019-05-22 Kai Yang , Yuanming Shi , Zhi Ding

Distributed and federated learning algorithms and techniques associated primarily with minimization problems. However, with the increase of minimax optimization and variational inequality problems in machine learning, the necessity of…

Optimization and Control · Mathematics 2024-06-04 Siqi Zhang , Sayantan Choudhury , Sebastian U Stich , Nicolas Loizou

Federated Learning (FL) has achieved significant achievements recently, enabling collaborative model training on distributed data over edge devices. Iterative gradient or model exchanges between devices and the centralized server in the…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-19 Ji Liu , Tianshi Che , Yang Zhou , Ruoming Jin , Huaiyu Dai , Dejing Dou , Patrick Valduriez

Communication between agents often constitutes a major computational bottleneck in distributed learning. One of the most common mitigation strategies is to compress the information exchanged, thereby reducing communication overhead. To…

Machine Learning · Computer Science 2025-11-04 Daniel Berg Thomsen , Adrien Taylor , Aymeric Dieuleveut

This paper addresses two fundamental challenges in distributed online convex optimization: communication efficiency and optimization under limited feedback. We propose Online Compressed Gradient Tracking with one-point Bandit Feedback…

Optimization and Control · Mathematics 2025-05-06 Longkang Zhu , Xinli Shi , Xiangping Xu , Jinde Cao

To enable the pre-trained models to be fine-tuned with local data on edge devices without sharing data with the cloud, we design an efficient split fine-tuning (SFT) framework for edge and cloud collaborative learning. We propose three…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-12-01 Shaohuai Shi , Qing Yang , Yang Xiang , Shuhan Qi , Xuan Wang

In distributed learning, the goal is to perform a learning task over data distributed across multiple nodes with minimal (expensive) communication. Prior work (Daume III et al., 2012) proposes a general model that bounds the communication…

Machine Learning · Computer Science 2012-04-17 Hal Daume , Jeff M. Phillips , Avishek Saha , Suresh Venkatasubramanian

Communication cost is one major bottleneck for the scalability for distributed learning. One approach to reduce the communication cost is to compress the gradient during communication. However, directly compressing the gradient decelerates…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-08-05 Hanlin Tang , Yao Li , Ji Liu , Ming Yan