English
Related papers

Related papers: Heterogeneity-aware Clustered Distributed Learning…

200 papers

Federated Learning (FL) represents a paradigm shift in the field of machine learning, offering an approach for a decentralized training of models across a multitude of devices while maintaining the privacy of local data. However, the…

Machine Learning · Computer Science 2024-08-21 Tatjana Legler , Vinit Hegiste , Martin Ruskowski

Clustered Federated Learning (CFL) improves performance under non-IID client heterogeneity by clustering clients and training one model per cluster, thereby balancing between a global model and fully personalized models. However, most CFL…

Machine Learning · Computer Science 2026-01-30 Mariona Jaramillo-Civill , Peng Wu , Pau Closas

Federated learning harnesses the power of distributed optimization to train a unified machine learning model across separate clients. However, heterogeneous data distributions and computational workloads can lead to inconsistent updates and…

Machine Learning · Computer Science 2024-10-15 Aayushya Agarwal , Gauri Joshi , Larry Pileggi

A key learning scenario in large-scale applications is that of federated learning, where a centralized model is trained based on data originating from a large number of clients. We argue that, with the existing training and inference,…

Machine Learning · Computer Science 2019-02-04 Mehryar Mohri , Gary Sivek , Ananda Theertha Suresh

Federated Learning (FL) presents an innovative approach to privacy-preserving distributed machine learning and enables efficient crowd intelligence on a large scale. However, a significant challenge arises when coordinating FL with crowd…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-09-06 Yuhao Zhou , Minjia Shi , Yuxin Tian , Yuanxi Li , Qing Ye , Jiancheng Lv

Federated learning is a recent advance in privacy protection. In this context, a trusted curator aggregates parameters optimized in decentralized fashion by multiple clients. The resulting model is then distributed back to all clients,…

Cryptography and Security · Computer Science 2018-03-02 Robin C. Geyer , Tassilo Klein , Moin Nabi

As Federated Learning (FL) expands, the challenge of non-independent and identically distributed (non-IID) data becomes critical. Clustered Federated Learning (CFL) addresses this by training multiple specialized models, each representing a…

Machine Learning · Statistics 2026-01-21 Michael Ben Ali , Omar El-Rifai , Imen Megdiche , André Peninou , Olivier Teste

In artificial intelligence (AI), especially deep learning, data diversity and volume play a pivotal role in model development. However, training a robust deep learning model often faces challenges due to data privacy, regulations, and the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Xiao Chen , Shunan Zhang , Eric Z. Chen , Yikang Liu , Lin Zhao , Terrence Chen , Shanhui Sun

Federated learning is a framework for distributed optimization that places emphasis on communication efficiency. In particular, it follows a client-server broadcast model and is particularly appealing because of its ability to accommodate…

Machine Learning · Computer Science 2022-03-30 Han Wang , Siddartha Marella , James Anderson

Federated Learning (FL) enables decentralised model training across distributed clients without requiring data centralisation. However, the generalisation performance of the global model is usually degraded by data heterogeneity across…

Machine Learning · Computer Science 2026-05-11 Ozgu Goksu , Nicolas Pugeault

We study a new form of federated learning where the clients train personalized local models and make predictions jointly with the server-side shared model. Using this new federated learning framework, the complexity of the central shared…

Machine Learning · Computer Science 2020-03-31 Alekh Agarwal , John Langford , Chen-Yu Wei

The traditional approach in FL tries to learn a single global model collaboratively with the help of many clients under the orchestration of a central server. However, learning a single global model might not work well for all clients…

Machine Learning · Computer Science 2021-05-11 Saeed Vahidian , Mahdi Morafah , Bill Lin

In federated learning, clients share a global model that has been trained on decentralized local client data. Although federated learning shows significant promise as a key approach when data cannot be shared or centralized, current methods…

Machine Learning · Computer Science 2021-02-09 Edvin Listo Zec , Olof Mogren , John Martinsson , Leon René Sütfeld , Daniel Gillblad

Today data is often scattered among billions of resource-constrained edge devices with security and privacy constraints. Federated Learning (FL) has emerged as a viable solution to learn a global model while keeping data private, but the…

Machine Learning · Computer Science 2021-12-08 Sijie Cheng , Jingwen Wu , Yanghua Xiao , Yang Liu , Yang Liu

Federated learning (FL) has been proposed as a privacy-preserving approach in distributed machine learning. A federated learning architecture consists of a central server and a number of clients that have access to private, potentially…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-03-06 Gergely Dániel Németh , Miguel Ángel Lozano , Novi Quadrianto , Nuria Oliver

The heterogeneity of hardware and data is a well-known and studied problem in the community of Federated Learning (FL) as running under heterogeneous settings. Recently, custom-size client models trained with Knowledge Distillation (KD) has…

Machine Learning · Computer Science 2022-11-15 Hongrui Shi , Valentin Radu , Po Yang

We study the problem of training personalized deep learning models in a decentralized peer-to-peer setting, focusing on the setting where data distributions differ between the clients and where different clients have different local…

Machine Learning · Computer Science 2022-11-01 Edvin Listo Zec , Ebba Ekblom , Martin Willbo , Olof Mogren , Sarunas Girdzijauskas

Federated Learning (FL) emerged as a decentralized paradigm to train models while preserving privacy. However, conventional FL struggles with data heterogeneity and class imbalance, which degrade model performance. Clustered FL balances…

Machine Learning · Computer Science 2025-05-05 Alessandro Licciardi , Davide Leo , Eros Fanì , Barbara Caputo , Marco Ciccone

Cluster analysis is a fundamental problem in data mining and machine learning. In recent years, multi-view clustering has attracted increasing attention due to its ability to integrate complementary information from multiple views. However,…

Machine Learning · Computer Science 2025-08-07 Mudi Jiang , Jiahui Zhou , Lianyu Hu , Xinying Liu , Zengyou He , Zhikui Chen

Federated learning shows promise as a privacy-preserving collaborative learning technique. Existing heterogeneous federated learning mainly focuses on skewing the label distribution across clients. However, most approaches suffer from…

Machine Learning · Computer Science 2023-12-18 Shunxin Guo , Hongsong Wang , Xin Geng