English
Related papers

Related papers: Federated Two Stage Decoupling With Adaptive Perso…

200 papers

Federated learning (FL) addresses privacy concerns in training language models by enabling multiple clients to contribute to the training, without sending their data to others. However, non-IID (identically and independently distributed)…

Machine Learning · Computer Science 2025-01-28 Jong-Ik Park , Carlee Joe-Wong

With the wealth of information produced by social networks, smartphones, medical or financial applications, speculations have been raised about the sensitivity of such data in terms of users' personal privacy and data security. To address…

Machine Learning · Computer Science 2019-08-21 Vito Walter Anelli , Yashar Deldjoo , Tommaso Di Noia , Antonio Ferrara

The traditional approach in FL tries to learn a single global model collaboratively with the help of many clients under the orchestration of a central server. However, learning a single global model might not work well for all clients…

Machine Learning · Computer Science 2021-05-11 Saeed Vahidian , Mahdi Morafah , Bill Lin

We consider the problem of personalized federated learning when there are known cluster structures within users. An intuitive approach would be to regularize the parameters so that users in the same cluster share similar model weights. The…

Machine Learning · Computer Science 2022-04-29 Boxiang Lyu , Filip Hanzely , Mladen Kolar

Federated Learning (FL) deals with learning a central model (i.e. the server) in privacy-constrained scenarios, where data are stored on multiple devices (i.e. the clients). The central model has no direct access to the data, but only to…

Machine Learning · Computer Science 2021-05-03 Debora Caldarola , Massimiliano Mancini , Fabio Galasso , Marco Ciccone , Emanuele Rodolà , Barbara Caputo

This paper presents the design and implementation of FLIPS, a middleware system to manage data and participant heterogeneity in federated learning (FL) training workloads. In particular, we examine the benefits of label distribution…

Machine Learning · Computer Science 2023-10-03 Rahul Atul Bhope , K. R. Jayaram , Nalini Venkatasubramanian , Ashish Verma , Gegi Thomas

Personalized Federated Learning (PFL) relies on collective data knowledge to build customized models. However, non-IID data between clients poses significant challenges, as collaborating with clients who have diverse data distributions can…

Machine Learning · Computer Science 2024-01-01 Zihan Chen , Jundong Li , Cong Shen

One global model in federated learning (FL) might not be sufficient to serve many clients with non-IID tasks and distributions. While there has been advances in FL to train multiple global models for better personalization, they only…

Machine Learning · Computer Science 2026-02-19 Shutong Chen , Tianyi Zhou , Guodong Long , Jing Jiang , Chengqi Zhang

Federated learning (FL) allows multiple clients cooperatively train models without disclosing local data. However, the existing works fail to address all these practical concerns in FL: limited communication resources, dynamic network…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-12-20 Zhida Jiang , Yang Xu , Hongli Xu , Zhiyuan Wang , Chen Qian

Personalized federated learning (PFL) tailors models to clients' unique data distributions while preserving privacy. However, existing aggregation-weight-based PFL methods often struggle with heterogeneous data, facing challenges in…

Machine Learning · Computer Science 2025-02-18 Yuxia Sun , Aoxiang Sun , Siyi Pan , Zhixiao Fu , Jingcai Guo

In diverse fields ranging from finance to omics, it is increasingly common that data is distributed and with multiple individual sources (referred to as ``clients'' in some studies). Integrating raw data, although powerful, is often not…

Methodology · Statistics 2022-11-08 Yuanxing Chen , Qingzhao Zhang , Shuangge Ma , Kuangnan Fang

Machine learning in medical research, by nature, needs careful attention on obeying the regulations of data privacy, making it difficult to train a machine learning model over gathered data from different medical centers. Failure of…

Machine Learning · Computer Science 2021-10-19 Jun Luo , Shandong Wu

In Federated Learning (FL), the distributed nature and heterogeneity of client data present both opportunities and challenges. While collaboration among clients can significantly enhance the learning process, not all collaborations are…

Machine Learning · Computer Science 2024-07-18 Nazarii Tupitsa , Samuel Horváth , Martin Takáč , Eduard Gorbunov

In this paper, we investigate federated clustering (FedC) problem, that aims to accurately partition unlabeled data samples distributed over massive clients into finite clusters under the orchestration of a parameter server, meanwhile…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-11-07 Yiwei Li , Shuai Wang , Chong-Yung Chi , Tony Q. S. Quek

Federated learning is a collaborative model training method that iterates model updates by multiple clients and aggregation of the updates by a central server. Device and statistical heterogeneity of participating clients cause significant…

Machine Learning · Computer Science 2023-08-29 Ayano Nakai-Kasai , Tadashi Wadayama

Federated learning (FL) is an emerging distributed training paradigm that aims to learn a common global model without exchanging or transferring the data that are stored locally at different clients. The Federated Averaging (FedAvg)-based…

Machine Learning · Computer Science 2024-02-20 Xiaolu Wang , Zijian Li , Shi Jin , Jun Zhang

Traditional Federated Learning (FL) methods encounter significant challenges when dealing with heterogeneous data and providing personalized solutions for non-IID scenarios. Personalized Federated Learning (PFL) approaches aim to address…

Machine Learning · Computer Science 2025-11-11 Yasaman Saadati , Mohammad Rostami , M. Hadi Amini

Over the past few years, Federated Learning (FL) has become a popular distributed machine learning paradigm. FL involves a group of clients with decentralized data who collaborate to learn a common model under the coordination of a…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-21 Jieming Bian , Lei Wang , Kun Yang , Cong Shen , Jie Xu

In the expanding field of machine learning, federated learning has emerged as a pivotal methodology for distributed data environments, ensuring privacy while leveraging decentralized data sources. However, the heterogeneity of client data…

Machine Learning · Computer Science 2025-01-28 Alice Smith , Bob Johnson , Michael Geller

Despite achieving remarkable performance, Federated Learning (FL) suffers from two critical challenges, i.e., limited computational resources and low training efficiency. In this paper, we propose a novel FL framework, i.e., FedDUAP, with…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-04-26 Hong Zhang , Ji Liu , Juncheng Jia , Yang Zhou , Huaiyu Dai , Dejing Dou