English
Related papers

Related papers: BiCoLoR: Communication-Efficient Optimization with…

200 papers

Federated learning (FL) is a useful tool in distributed machine learning that utilizes users' local datasets in a privacy-preserving manner. When deploying FL in a constrained wireless environment; however, training models in a…

Machine Learning · Computer Science 2022-05-06 Jake Perazzone , Shiqiang Wang , Mingyue Ji , Kevin Chan

Traditional radio systems are strictly co-designed on the lower levels of the OSI stack for compatibility and efficiency. Although this has enabled the success of radio communications, it has also introduced lengthy standardization…

Signal Processing · Electrical Eng. & Systems 2018-01-16 Colin de Vrieze , Shane Barratt , Daniel Tsai , Anant Sahai

Despite the growing adoption of video processing via Internet of Things (IoT) devices due to their cost-effectiveness, transmitting captured data to nearby servers poses challenges due to varying timing constraints and scarcity of network…

Image and Video Processing · Electrical Eng. & Systems 2024-09-11 John Li , Shehab Sarar Ahmed , Deepak Nair

We consider a decentralized learning problem, where a set of computing nodes aim at solving a non-convex optimization problem collaboratively. It is well-known that decentralized optimization schemes face two major system bottlenecks:…

Machine Learning · Computer Science 2019-11-04 Amirhossein Reisizadeh , Hossein Taheri , Aryan Mokhtari , Hamed Hassani , Ramtin Pedarsani

Federated Learning is a collaborative training framework that leverages heterogeneous data distributed across a vast number of clients. Since it is practically infeasible to request and process all clients during the aggregation step,…

Machine Learning · Computer Science 2023-06-07 Michał Grudzień , Grigory Malinovsky , Peter Richtárik

Federated bilevel optimization (FBO) has shown great potential recently in machine learning and edge computing due to the emerging nested optimization structure in meta-learning, fine-tuning, hyperparameter tuning, etc. However, existing…

Machine Learning · Computer Science 2023-12-29 Yifan Yang , Peiyao Xiao , Kaiyi Ji

This paper explores second-order optimization methods in Federated Learning (FL), addressing the critical challenges of slow convergence and the excessive communication rounds required to achieve optimal performance from the global model.…

Machine Learning · Computer Science 2025-05-30 Mrinmay Sen , Sidhant R Nair , C Krishna Mohan

Decentralized optimization, particularly the class of decentralized composite convex optimization (DCCO) problems, has found many applications. Due to ubiquitous communication congestion and random dropouts in practice, it is highly…

Optimization and Control · Mathematics 2022-10-12 Changxin Liu , Zirui Zhou , Jian Pei , Yong Zhang , Yang Shi

We consider the task of minimizing the sum of smooth and strongly convex functions stored in a decentralized manner across the nodes of a communication network whose links are allowed to change in time. We solve two fundamental problems for…

Optimization and Control · Mathematics 2021-06-09 Dmitry Kovalev , Elnur Gasanov , Peter Richtárik , Alexander Gasnikov

We consider the task of decentralized minimization of the sum of smooth strongly convex functions stored across the nodes of a network. For this problem, lower bounds on the number of gradient computations and the number of communication…

Optimization and Control · Mathematics 2020-11-16 Dmitry Kovalev , Adil Salim , Peter Richtárik

We introduce a new and increasingly relevant setting for distributed optimization in machine learning, where the data defining the optimization are unevenly distributed over an extremely large number of nodes. The goal is to train a…

Machine Learning · Computer Science 2016-10-11 Jakub Konečný , H. Brendan McMahan , Daniel Ramage , Peter Richtárik

A change of the prevalent supervised learning techniques is foreseeable in the near future: from the complex, computational expensive algorithms to more flexible and elementary training ones. The strong revitalization of randomized…

Machine Learning · Computer Science 2022-09-02 Antonello Rosato , Massimo Panella , Evgeny Osipov , Denis Kleyko

We consider a class of popular distributed non-convex optimization problems, in which agents connected by a network $\mathcal{G}$ collectively optimize a sum of smooth (possibly non-convex) local objective functions. We address the…

Optimization and Control · Mathematics 2020-01-08 Haoran Sun , Mingyi Hong

In federated learning (FL), a number of devices train their local models and upload the corresponding parameters or gradients to the base station (BS) to update the global model while protecting their data privacy. However, due to the…

Machine Learning · Computer Science 2022-05-04 Zhigang Yan , Dong Li , Zhichao Zhang , Jiguang He

Recently, blockchain-based federated learning (BFL) has attracted intensive research attention due to that the training process is auditable and the architecture is serverless avoiding the single point failure of the parameter server in…

Machine Learning · Computer Science 2022-08-15 Laizhong Cui , Xiaoxin Su , Yipeng Zhou

Distributed training of foundation models via $\texttt{DDP}$ is limited by interconnect bandwidth. While infrequent communication strategies reduce synchronization frequency, they remain bottlenecked by the memory and communication…

Decentralized optimization is an emerging paradigm in distributed learning in which agents achieve network-wide solutions by peer-to-peer communication without the central server. Since communication tends to be slower than computation,…

Optimization and Control · Mathematics 2023-03-14 Zhuoqing Song , Weijian Li , Kexin Jin , Lei Shi , Ming Yan , Wotao Yin , Kun Yuan

The fundamental success of large language models hinges upon the efficacious implementation of large-scale distributed training techniques. Nevertheless, building a vast, high-performance cluster featuring high-speed communication…

Computation and Language · Computer Science 2024-01-30 Weigao Sun , Zhen Qin , Weixuan Sun , Shidi Li , Dong Li , Xuyang Shen , Yu Qiao , Yiran Zhong

Recent trend towards increasing large machine learning models require both training and inference tasks to be distributed. Considering the huge cost of training these models, it is imperative to unlock optimizations in computation and…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-03-29 Abhinav Jangda , Jun Huang , Guodong Liu , Amir Hossein Nodehi Sabet , Saeed Maleki , Youshan Miao , Madanlal Musuvathi , Todd Mytkowicz , Olli Sarikivi

The diversity and quantity of data warehouses, gathering data from distributed devices such as mobile devices, can enhance the success and robustness of machine learning algorithms. Federated learning enables distributed participants to…

Machine Learning · Computer Science 2022-03-10 Shuo Wang , Surya Nepal , Kristen Moore , Marthie Grobler , Carsten Rudolph , Alsharif Abuadbba