English
Related papers

Related papers: Federated Optimization:Distributed Optimization Be…

200 papers

Federated learning is a machine learning approach that enables multiple devices (i.e., agents) to train a shared model cooperatively without exchanging raw data. This technique keeps data localized on user devices, ensuring privacy and…

Machine Learning · Computer Science 2025-07-16 Dimitrios Kritsiolis , Constantine Kotropoulos

Federated Learning is a distributed learning paradigm with two key challenges that differentiate it from traditional distributed optimization: (1) significant variability in terms of the systems characteristics on each device in the network…

Machine Learning · Computer Science 2020-04-23 Tian Li , Anit Kumar Sahu , Manzil Zaheer , Maziar Sanjabi , Ameet Talwalkar , Virginia Smith

Federated learning (FL) is a promising learning paradigm that can tackle the increasingly prominent isolated data islands problem while keeping users' data locally with privacy and security guarantees. However, FL could result in…

Information Theory · Computer Science 2022-03-30 Peng Yang , Yuning Jiang , Ting Wang , Yong Zhou , Yuanming Shi , Colin N. Jones

The ability to perform computation on devices, such as smartphones, cars, or other nodes present at the Internet of Things leads to constraints regarding bandwidth, storage, and energy, as most of these devices are mobile and operate on…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-29 Natascha Harth , Hans-Joerg Voegel , Kostas Kolomvatsos , Christos Anagnostopoulos

A recent emphasis of distributed learning research has been on federated learning (FL), in which model training is conducted by the data-collecting devices. Existing research on FL has mostly focused on a star topology learning architecture…

Machine Learning · Computer Science 2022-11-24 Shahryar Zehtabi , Seyyedali Hosseinalipour , Christopher G. Brinton

Federated learning allows a large number of devices to jointly learn a model without sharing data. In this work, we enable clients with limited computing power to perform action recognition, a computationally heavy task. We first perform…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-07-27 Pranjal Jain , Shreyas Goenka , Saurabh Bagchi , Biplab Banerjee , Somali Chaterji

Federated learning has emerged recently as a promising solution for distributing machine learning tasks through modern networks of mobile devices. Recent studies have obtained lower bounds on the expected decrease in model loss that is…

Federated learning (FL) rests on the notion of training a global model in a decentralized manner. Under this setting, mobile devices perform computations on their local data before uploading the required updates to improve the global model.…

Machine Learning · Computer Science 2020-05-07 Shashi Raj Pandey , Nguyen H. Tran , Mehdi Bennis , Yan Kyaw Tun , Aunas Manzoor , Choong Seon Hong

Federated learning allows clients to collaboratively learn statistical models while keeping their data local. Federated learning was originally used to train a unique global model to be served to all clients, but this approach might be…

Machine Learning · Computer Science 2022-06-20 Othmane Marfoq , Giovanni Neglia , Laetitia Kameni , Richard Vidal

With the rapid advancement of 5G networks, billions of smart Internet of Things (IoT) devices along with an enormous amount of data are generated at the network edge. While still at an early age, it is expected that the evolving 6G network…

Machine Learning · Computer Science 2023-03-16 Bing Luo , Xiaomin Ouyang , Peng Sun , Pengchao Han , Ningning Ding , Jianwei Huang

Federated learning (FL) was proposed to facilitate the training of models in a distributed environment. It supports the protection of (local) data privacy and uses local resources for model training. Until now, the majority of research has…

Clustering large datasets is a fundamental problem with a number of applications in machine learning. Data is often collected on different sites and clustering needs to be performed in a distributed manner with low communication. We would…

Data Structures and Algorithms · Computer Science 2017-02-02 Jiecao Chen , He Sun , David P. Woodruff , Qin Zhang

Performative prediction is a framework that captures distribution shifts that occur during the training of machine learning models due to their deployment. As the trained model is used, data generation causes the model to evolve, leading to…

Machine Learning · Computer Science 2025-11-10 Xue Zheng , Tian Xie , Xuwei Tan , Aylin Yener , Xueru Zhang

Distributed optimization algorithms are widely used in machine learning. This paper investigates how a small amount of data sharing can improve their performance. Focusing on general linear models, we analyze the effects of data sharing on…

Optimization and Control · Mathematics 2025-05-19 Mingxi Zhu , Yinyu Ye

Federated learning enables training on a massive number of edge devices. To improve flexibility and scalability, we propose a new asynchronous federated optimization algorithm. We prove that the proposed approach has near-linear convergence…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-12-08 Cong Xie , Sanmi Koyejo , Indranil Gupta

The increasing popularity of cloud computing has resulted in a proliferation of data centers. Effective placement of data centers improves network performance and minimizes clients' perceived latency. The problem of determining the optimal…

Networking and Internet Architecture · Computer Science 2018-02-06 Wuqiong Luo , Wee Peng Tay , Peng Sun , Yonggang Wen

Owing to the increasing need for massive data analysis and model training at the network edge, as well as the rising concerns about the data privacy, a new distributed training framework called federated learning (FL) has emerged. In each…

Networking and Internet Architecture · Computer Science 2019-11-05 Wenqi Shi , Sheng Zhou , Zhisheng Niu

Federated learning poses new statistical and systems challenges in training machine learning models over distributed networks of devices. In this work, we show that multi-task learning is naturally suited to handle the statistical…

Machine Learning · Computer Science 2018-02-28 Virginia Smith , Chao-Kai Chiang , Maziar Sanjabi , Ameet Talwalkar

Federated Learning (FL) is an intriguing distributed machine learning approach due to its privacy-preserving characteristics. To balance the trade-off between energy and execution latency, and thus accommodate different demands and…

Machine Learning · Computer Science 2025-09-12 Xinyu Zhou , Jun Zhao , Huimei Han , Claude Guet

With the growing availability of smart devices and cloud services, personal speech assistance systems are increasingly used on a daily basis. Most devices redirect the voice recordings to a central server, which uses them for upgrading the…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-01 Wentao Yu , Jan Freiwald , Sören Tewes , Fabien Huennemeyer , Dorothea Kolossa