English
Related papers

Related papers: Fully Decentralized Joint Learning of Personalized…

200 papers

Decentralized optimization over time-varying networks has a wide range of applications in distributed learning, signal processing and various distributed control problems. The agents of the distributed system locally hold optimization…

Optimization and Control · Mathematics 2023-12-14 Alexander Rogozin , Alexander Gasnikov , Aleksander Beznosikov , Dmitry Kovalev

While federated learning traditionally aims to train a single global model across decentralized local datasets, one model may not always be ideal for all participating clients. Here we propose an alternative, where each client only…

Machine Learning · Computer Science 2021-03-30 Michael Zhang , Karan Sapra , Sanja Fidler , Serena Yeung , Jose M. Alvarez

This work aims at improving the energy efficiency of decentralized learning by optimizing the mixing matrix, which controls the communication demands during the learning process. Through rigorous analysis based on a state-of-the-art…

Machine Learning · Computer Science 2024-05-24 Xusheng Zhang , Cho-Chun Chiu , Ting He

This paper considers the problem of decentralized, personalized federated learning. For centralized personalized federated learning, a penalty that measures the deviation from the local model and its average, is often added to the objective…

The proliferation of Internet of Things devices and advances in communication technology have unleashed an explosion of personal data, amplifying privacy concerns amid stringent regulations like GDPR and CCPA. Federated Learning offers a…

Machine Learning · Computer Science 2025-03-04 Fan Wan , Yuchen Li , Xueqi Qiu , Rui Sun , Leyuan Zhang , Xingyu Miao , Tianyu Zhang , Haoran Duan , Yang Long

Federated learning obtains a central model on the server by aggregating models trained locally on clients. As a result, federated learning does not require clients to upload their data to the server, thereby preserving the data privacy of…

Machine Learning · Computer Science 2020-08-31 Yang Chen , Xiaoyan Sun , Yaochu Jin

Collaborative learning (CL) enables multiple participants to jointly train machine learning (ML) models on decentralized data sources without raw data sharing. While the primary goal of CL is to maximize the expected accuracy gain for each…

Machine Learning · Computer Science 2025-10-02 Nurbek Tastan , Samuel Horvath , Karthik Nandakumar

Federated learning is used for decentralized training of machine learning models on a large number (millions) of edge mobile devices. It is challenging because mobile devices often have limited communication bandwidth and local computation…

Machine Learning · Computer Science 2021-11-09 Hakim Sidahmed , Zheng Xu , Ankush Garg , Yuan Cao , Mingqing Chen

In this paper we consider online distributed learning problems. Online distributed learning refers to the process of training learning models on distributed data sources. In our setting a set of agents need to cooperatively train a learning…

Machine Learning · Computer Science 2024-05-07 Nicola Bastianello , Apostolos I. Rikos , Karl H. Johansson

Decentralized federated learning (DFL) captures FL settings where both (i) model updates and (ii) model aggregations are exclusively carried out by the clients without a central server. Existing DFL works have mostly focused on settings…

Machine Learning · Computer Science 2025-03-07 Shahryar Zehtabi , Dong-Jun Han , Rohit Parasnis , Seyyedali Hosseinalipour , Christopher G. Brinton

Key graph-based problems play a central role in understanding network topology and uncovering patterns of similarity in homogeneous and temporal data. Such patterns can be revealed by analyzing communities formed by nodes, which in turn can…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-02 Davide Rucci , Emanuele Carlini , Patrizio Dazzi , Hanna Kavalionak , Matteo Mordacchini

Federated Learning is a machine learning setting where the goal is to train a high-quality centralized model while training data remains distributed over a large number of clients each with unreliable and relatively slow network…

Machine Learning · Computer Science 2017-11-01 Jakub Konečný , H. Brendan McMahan , Felix X. Yu , Peter Richtárik , Ananda Theertha Suresh , Dave Bacon

In this paper, we investigate the problem of decentralized federated learning (DFL) in Internet of things (IoT) systems, where a number of IoT clients train models collectively for a common task without sharing their private training data…

Machine Learning · Computer Science 2021-05-13 Chengxi Li , Gang Li , Pramod K. Varshney

Data heterogeneity across participating devices poses one of the main challenges in federated learning as it has been shown to greatly hamper its convergence time and generalization capabilities. In this work, we address this limitation by…

Machine Learning · Computer Science 2021-10-20 Mohamad Mestoukirdi , Matteo Zecchin , David Gesbert , Qianrui Li , Nicolas Gresset

Federated learning allows mobile clients to jointly train a global model without sending their private data to a central server. Extensive works have studied the performance guarantee of the global model, however, it is still unclear how…

Machine Learning · Computer Science 2021-04-14 Yihao Xue , Chaoyue Niu , Zhenzhe Zheng , Shaojie Tang , Chengfei Lv , Fan Wu , Guihai Chen

Federated learning (FL) on graphs shows promise for distributed time-series forecasting. Yet, existing methods rely on static topologies and struggle with client heterogeneity. We propose Fed-GAME, a framework that models personalized…

Machine Learning · Computer Science 2026-03-03 Yi Li , Han Liu , Mingfeng Fan , Guo Chen , Chaojie Li , Biplab Sikdar

Learning from the collective knowledge of data dispersed across private sources can provide neural networks with enhanced generalization capabilities. Federated learning, a method for collaboratively training a machine learning model across…

Machine Learning · Computer Science 2024-05-20 Matt Gorbett , Hossein Shirazi , Indrakshi Ray

Collaborative training can improve the accuracy of a model for a user by trading off the model's bias (introduced by using data from other users who are potentially different) against its variance (due to the limited amount of data on any…

Machine Learning · Computer Science 2022-06-24 El Mahdi Chayti , Sai Praneeth Karimireddy , Sebastian U. Stich , Nicolas Flammarion , Martin Jaggi

Decentralized learning (DL) offers a powerful framework where nodes collaboratively train models without sharing raw data and without the coordination of a central server. In the iterative rounds of DL, models are trained locally, shared…

Machine Learning · Computer Science 2024-07-02 Akash Dhasade , Paolo Dini , Elia Guerra , Anne-Marie Kermarrec , Marco Miozzo , Rafael Pires , Rishi Sharma , Martijn de Vos

Federated learning (FL) has been facilitating privacy-preserving deep learning in many walks of life such as medical image classification, network intrusion detection, and so forth. Whereas it necessitates a central parameter server for…

Machine Learning · Computer Science 2022-03-23 Yuwei Sun , Hideya Ochiai