English
Related papers

Related papers: Federated Learning with Partial Model Personalizat…

200 papers

In federated learning, models are learned from users' data that are held private in their edge devices, by aggregating them in the service provider's "cloud" to obtain a global model. Such global model is of great commercial value in, e.g.,…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-02-02 Ruiyuan Wu , Anna Scaglione , Hoi-To Wai , Nurullah Karakoc , Kari Hreinsson , Wing-Kin Ma

Personalized federated learning (PFL) jointly trains a variety of local models through balancing between knowledge sharing across clients and model personalization per client. This paper addresses PFL via explicit disentangling latent…

Machine Learning · Computer Science 2023-07-14 Peng Yan , Guodong Long

Federated Learning provides a privacy-preserving paradigm for distributed learning, but suffers from statistical heterogeneity across clients. Personalized Federated Learning (PFL) mitigates this issue by considering client-specific models.…

Machine Learning · Statistics 2026-02-17 Ala Emrani , Amir Najafi , Abolfazl Motahari

Federated edge learning is a promising technology to deploy intelligence at the edge of wireless networks in a privacy-preserving manner. Under such a setting, multiple clients collaboratively train a global generic model under the…

Machine Learning · Computer Science 2023-02-27 Zihan Chen , Zeshen Li , Howard H. Yang , Tony Q. S. Quek

We introduce a novel differentially private algorithm for online federated learning that employs temporally correlated noise to enhance utility while ensuring privacy of continuously released models. To address challenges posed by DP noise…

Machine Learning · Computer Science 2025-01-10 Jiaojiao Zhang , Linglingzhi Zhu , Mikael Johansson

Federated learning is a distributed paradigm that allows multiple parties to collaboratively train deep models without exchanging the raw data. However, the data distribution among clients is naturally non-i.i.d., which leads to severe…

Machine Learning · Computer Science 2023-01-31 Tianfei Zhou , Ender Konukoglu

Federated learning (FL) is a heavily promoted approach for training ML models on sensitive data, e.g., text typed by users on their smartphones. FL is expressly designed for training on data that are unbalanced and non-iid across the…

Machine Learning · Computer Science 2022-03-07 Tao Yu , Eugene Bagdasaryan , Vitaly Shmatikov

Dimensionality Reduction is a commonly used element in a machine learning pipeline that helps to extract important features from high-dimensional data. In this work, we explore an alternative federated learning system that enables…

Machine Learning · Computer Science 2020-11-16 Anna Bogdanova , Akie Nakai , Yukihiko Okada , Akira Imakura , Tetsuya Sakurai

This paper proposes a novel federated algorithm that leverages momentum-based variance reduction with adaptive learning to address non-convex settings across heterogeneous data. We intend to minimize communication and computation overhead,…

Machine Learning · Computer Science 2024-12-17 Dipanwita Thakur , Antonella Guzzo , Giancarlo Fortino , Sajal K. Das

We investigate the optimization aspects of personalized Federated Learning (FL). We propose general optimizers that can be applied to numerous existing personalized FL objectives, specifically a tailored variant of Local SGD and variants of…

Machine Learning · Computer Science 2023-05-30 Filip Hanzely , Boxin Zhao , Mladen Kolar

Federated learning is a promising distributed machine learning paradigm that can effectively exploit large-scale data without exposing users' privacy. However, it may incur significant communication overhead, thereby potentially impairing…

Machine Learning · Computer Science 2024-08-07 Shiwei Li , Wenchao Xu , Haozhao Wang , Xing Tang , Yining Qi , Shijie Xu , Weihong Luo , Yuhua Li , Xiuqiang He , Ruixuan Li

In real-world federated learning scenarios, participants could have their own personalized labels which are incompatible with those from other clients, due to using different label permutations or tackling completely different tasks or…

Machine Learning · Computer Science 2022-02-02 Wonyong Jeong , Sung Ju Hwang

Very few methods for hybrid federated learning, where clients only hold subsets of both features and samples, exist. Yet, this scenario is extremely important in practical settings. We provide a fast, robust algorithm for hybrid federated…

Machine Learning · Computer Science 2025-02-28 Tom Overman , Garrett Blum , Diego Klabjan

Federated learning (FL) is an appealing paradigm that allows a group of machines (a.k.a. clients) to learn collectively while keeping their data local. However, due to the heterogeneity between the clients' data distributions, the model…

Machine Learning · Computer Science 2024-10-01 Youssef Allouah , Abdellah El Mrini , Rachid Guerraoui , Nirupam Gupta , Rafael Pinot

The popularity of federated learning (FL) is on the rise, along with growing concerns about data privacy in artificial intelligence applications. FL facilitates collaborative multi-party model learning while simultaneously ensuring the…

Machine Learning · Computer Science 2024-02-19 Muhammad Firdaus , Kyung-Hyune Rhee

Federated Learning systems use a centralized server to aggregate model updates. This is a bandwidth and resource-heavy constraint and exposes the system to privacy concerns. We instead implement a peer to peer learning system in which nodes…

Machine Learning · Computer Science 2023-03-14 Ram M Kripa , Andy Zou , Ryan Jia , Kenny Huang

Personalized federated learning (PFL) offers a flexible framework for aggregating information across distributed clients with heterogeneous data. This work considers a personalized federated learning setting that simultaneously learns…

Machine Learning · Statistics 2025-06-03 Xin Yu , Zelin He , Ying Sun , Lingzhou Xue , Runze Li

Meta federated learning (FL) is a personalized variant of FL, where multiple agents collaborate on training an initial shared model without exchanging raw data samples. The initial model should be trained in a way that current or new agents…

Machine Learning · Computer Science 2025-05-14 Mohammad Vahid Jamali , Hamid Saber , Jung Hyun Bae

A distinguishing characteristic of federated learning is that the (local) client data could have statistical heterogeneity. This heterogeneity has motivated the design of personalized learning, where individual (personalized) models are…

Machine Learning · Computer Science 2022-07-06 Kaan Ozkara , Antonious M. Girgis , Deepesh Data , Suhas Diggavi

Fuzzy systems are a way to allow machines, systems and frameworks to deal with uncertainty, which is not possible in binary systems that most computers use. These systems have already been deployed for certain use cases, and fuzzy systems…

Machine Learning · Computer Science 2025-07-10 Arthur Alexander Lim , Zhen Bin It , Jovan Bowen Heng , Tee Hui Teo