English
Related papers

Related papers: Personalized Federated Learning using Hypernetwork…

200 papers

In Federated Learning, we aim to train models across multiple computing units (users), while users can only communicate with a common central server, without exchanging their data samples. This mechanism exploits the computational power of…

Machine Learning · Computer Science 2020-10-26 Alireza Fallah , Aryan Mokhtari , Asuman Ozdaglar

Most existing personalized federated learning approaches are based on intricate designs, which often require complex implementation and tuning. In order to address this limitation, we propose a simple yet effective personalized federated…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-01-30 Jiaqi Wang , Yuzhong Chen , Yuhang Wu , Mahashweta Das , Hao Yang , Fenglong Ma

Federated learning ensures the privacy of clients by conducting distributed training on individual client devices and sharing only the model weights with a central server. However, in real-world scenarios, the heterogeneity of data among…

Machine Learning · Computer Science 2024-04-30 Jaewon Jang , Bonjun Choi

While federated learning traditionally aims to train a single global model across decentralized local datasets, one model may not always be ideal for all participating clients. Here we propose an alternative, where each client only…

Machine Learning · Computer Science 2021-03-30 Michael Zhang , Karan Sapra , Sanja Fidler , Serena Yeung , Jose M. Alvarez

Federated Learning (FL) is a method of training machine learning models on private data distributed over a large number of possibly heterogeneous clients such as mobile phones and IoT devices. In this work, we propose a new federated…

Machine Learning · Computer Science 2021-12-15 Enmao Diao , Jie Ding , Vahid Tarokh

Personalized federated learning (FL) aims to train model(s) that can perform well for individual clients that are highly data and system heterogeneous. Most work in personalized FL, however, assumes using the same model architecture at all…

Machine Learning · Computer Science 2021-09-17 Yae Jee Cho , Jianyu Wang , Tarun Chiruvolu , Gauri Joshi

Standard Federated Learning (FL) techniques are limited to clients with identical network architectures. This restricts potential use-cases like cross-platform training or inter-organizational collaboration when both data privacy and…

Machine Learning · Computer Science 2022-01-24 Or Litany , Haggai Maron , David Acuna , Jan Kautz , Gal Chechik , Sanja Fidler

Traditional Federated Learning (FL) approaches often struggle with data heterogeneity across clients, leading to suboptimal model performance for individual clients. To address this issue, Personalized Federated Learning (PFL) emerges as a…

Machine Learning · Computer Science 2025-01-20 Zhou Ni , Masoud Ghazikor , Morteza Hashemi

The traditional approach in FL tries to learn a single global model collaboratively with the help of many clients under the orchestration of a central server. However, learning a single global model might not work well for all clients…

Machine Learning · Computer Science 2021-05-11 Saeed Vahidian , Mahdi Morafah , Bill Lin

Knowledge sharing and model personalization are two key components in the conceptual framework of personalized federated learning (PFL). Existing PFL methods focus on proposing new model personalization mechanisms while simply implementing…

Machine Learning · Computer Science 2022-05-03 Fengwen Chen , Guodong Long , Zonghan Wu , Tianyi Zhou , Jing Jiang

We study a new form of federated learning where the clients train personalized local models and make predictions jointly with the server-side shared model. Using this new federated learning framework, the complexity of the central shared…

Machine Learning · Computer Science 2020-03-31 Alekh Agarwal , John Langford , Chen-Yu Wei

Federated learning (FL) research has made progress in developing algorithms for distributed learning of global models, as well as algorithms for local personalization of those common models to the specifics of each client's local data…

Machine Learning · Computer Science 2023-10-05 Royson Lee , Minyoung Kim , Da Li , Xinchi Qiu , Timothy Hospedales , Ferenc Huszár , Nicholas D. Lane

Personalized Federated Learning (PFL) aims to address the statistical heterogeneity of data across clients by learning the personalized model for each client. Among various PFL approaches, the personalized aggregation-based approach…

Machine Learning · Computer Science 2025-10-09 Jiarui Song , Yunheng Shen , Chengbin Hou , Pengyu Wang , Jinbao Wang , Ke Tang , Hairong Lv

Federated learning is a distributed, privacy-aware learning scenario which trains a single model on data belonging to several clients. Each client trains a local model on its data and the local models are then aggregated by a central party.…

Machine Learning · Computer Science 2020-01-01 Hesham Mostafa

Deep neural networks have shown the ability to extract universal feature representations from data such as images and text that have been useful for a variety of learning tasks. However, the fruits of representation learning have yet to be…

Machine Learning · Computer Science 2023-03-28 Liam Collins , Hamed Hassani , Aryan Mokhtari , Sanjay Shakkottai

The emerging paradigm of federated learning strives to enable collaborative training of machine learning models on the network edge without centrally aggregating raw data and hence, improving data privacy. This sharply deviates from…

Machine Learning · Computer Science 2019-12-03 Manoj Ghuhan Arivazhagan , Vinay Aggarwal , Aaditya Kumar Singh , Sunav Choudhary

We propose a novel training recipe for federated learning with heterogeneous networks where each device can have different architectures. We introduce training with a side objective to the devices of higher complexities to jointly train…

Machine Learning · Computer Science 2022-07-08 Durmus Alp Emre Acar , Venkatesh Saligrama

Federated learning has recently gained popularity as a framework for distributed clients to collaboratively train a machine learning model using local data. While traditional federated learning relies on a central server for model…

Machine Learning · Computer Science 2025-09-03 I-Cheng Lin , Osman Yagan , Carlee Joe-Wong

Federated Learning (FL) allows several clients to construct a common global machine-learning model without having to share their data. FL, however, faces the challenge of statistical heterogeneity between the client's data, which degrades…

Machine Learning · Computer Science 2024-01-26 Zahra Taghiyarrenani , Abdallah Alabdallah , Slawomir Nowaczyk , Sepideh Pashami

Federated learning enables many applications benefiting distributed and private datasets of a large number of potential data-holding clients. However, different clients usually have their own particular objectives in terms of the tasks to…

Machine Learning · Computer Science 2022-07-19 Cihat Keçeci , Mohammad Shaqfeh , Hayat Mbayed , Erchin Serpedin