English
Related papers

Related papers: Federated Learning with Partial Model Personalizat…

200 papers

Federated learning is renowned for its efficacy in distributed model training, ensuring that users, called clients, retain data privacy by not disclosing their data to the central server that orchestrates collaborations. Most previous work…

Machine Learning · Computer Science 2024-10-30 Pouya M. Ghari , Yanning Shen

Investigation of the degree of personalization in federated learning algorithms has shown that only maximizing the performance of the global model will confine the capacity of the local models to personalize. In this paper, we advocate an…

Machine Learning · Computer Science 2020-11-09 Yuyang Deng , Mohammad Mahdi Kamani , Mehrdad Mahdavi

Partial model personalization, which encompasses both shared and personal variables in its formulation, is a critical optimization problem in federated learning. It balances individual client needs with collective knowledge utilization, and…

Optimization and Control · Mathematics 2023-10-02 Yiming Chen , Liyuan Cao , Kun Yuan , Zaiwen Wen

Federated learning enables machine learning models to learn from private decentralized data without compromising privacy. The standard formulation of federated learning produces one shared model for all clients. Statistical heterogeneity…

Machine Learning · Computer Science 2020-03-20 Viraj Kulkarni , Milind Kulkarni , Aniruddha Pant

Personalization methods in federated learning aim to balance the benefits of federated and local training for data availability, communication cost, and robustness to client heterogeneity. Approaches that require clients to communicate all…

Machine Learning · Computer Science 2022-04-28 Karan Singhal , Hakim Sidahmed , Zachary Garrett , Shanshan Wu , Keith Rush , Sushant Prakash

Large-scale machine learning systems often involve data distributed across a collection of users. Federated learning algorithms leverage this structure by communicating model updates to a central server, rather than entire datasets. In this…

Machine Learning · Statistics 2022-07-19 Alberto Bietti , Chen-Yu Wei , Miroslav Dudík , John Langford , Zhiwei Steven Wu

We present a partially personalized formulation of Federated Learning (FL) that strikes a balance between the flexibility of personalization and cooperativeness of global training. In our framework, we split the variables into global…

Machine Learning · Computer Science 2023-05-30 Konstantin Mishchenko , Rustem Islamov , Eduard Gorbunov , Samuel Horváth

Federated learning is a method of training models on private data distributed over multiple devices. To keep device data private, the global model is trained by only communicating parameters and updates which poses scalability challenges…

In Federated Learning, we aim to train models across multiple computing units (users), while users can only communicate with a common central server, without exchanging their data samples. This mechanism exploits the computational power of…

Machine Learning · Computer Science 2020-10-26 Alireza Fallah , Aryan Mokhtari , Asuman Ozdaglar

Federated Learning (FL) enables training ML models on edge clients without sharing data. However, the federated model's performance on local data varies, disincentivising the participation of clients who benefit little from FL. Fair FL…

Machine Learning · Computer Science 2023-05-05 Alex Iacob , Pedro P. B. Gusmão , Nicholas D. Lane

Federated learning allows clients to collaboratively learn statistical models while keeping their data local. Federated learning was originally used to train a unique global model to be served to all clients, but this approach might be…

Machine Learning · Computer Science 2022-06-20 Othmane Marfoq , Giovanni Neglia , Laetitia Kameni , Richard Vidal

Federated learning is used for decentralized training of machine learning models on a large number (millions) of edge mobile devices. It is challenging because mobile devices often have limited communication bandwidth and local computation…

Machine Learning · Computer Science 2021-11-09 Hakim Sidahmed , Zheng Xu , Ankush Garg , Yuan Cao , Mingqing Chen

While federated learning traditionally aims to train a single global model across decentralized local datasets, one model may not always be ideal for all participating clients. Here we propose an alternative, where each client only…

Machine Learning · Computer Science 2021-03-30 Michael Zhang , Karan Sapra , Sanja Fidler , Serena Yeung , Jose M. Alvarez

In federated learning, clients share a global model that has been trained on decentralized local client data. Although federated learning shows significant promise as a key approach when data cannot be shared or centralized, current methods…

Machine Learning · Computer Science 2021-02-09 Edvin Listo Zec , Olof Mogren , John Martinsson , Leon René Sütfeld , Daniel Gillblad

Federated learning is a distributed, privacy-aware learning scenario which trains a single model on data belonging to several clients. Each client trains a local model on its data and the local models are then aggregated by a central party.…

Machine Learning · Computer Science 2020-01-01 Hesham Mostafa

Federated learning has emerged as a promising approach for training machine learning models on decentralized data sources while preserving data privacy. However, challenges such as communication bottlenecks, heterogeneity of client devices,…

Machine Learning · Computer Science 2023-12-27 Anna Vettoruzzo , Mohamed-Rafik Bouguelia , Thorsteinn Rögnvaldsson

Federated learning (FL) research has made progress in developing algorithms for distributed learning of global models, as well as algorithms for local personalization of those common models to the specifics of each client's local data…

Machine Learning · Computer Science 2023-10-05 Royson Lee , Minyoung Kim , Da Li , Xinchi Qiu , Timothy Hospedales , Ferenc Huszár , Nicholas D. Lane

Federated learning (FL) enables distributed learning across edge devices while protecting data privacy. However, the learning accuracy decreases due to the heterogeneity of devices' data, and the computation and communication latency…

Machine Learning · Computer Science 2024-01-17 Xiaonan Liu , Tharmalingam Ratnarajah , Mathini Sellathurai , Yonina C. Eldar

Federated learning is a distributed, on-device computation framework that enables training global models without exporting sensitive user data to servers. In this work, we describe methods to extend the federation framework to evaluate…

Machine Learning · Computer Science 2019-10-24 Kangkang Wang , Rajiv Mathews , Chloé Kiddon , Hubert Eichner , Françoise Beaufays , Daniel Ramage

Federated Learning offers a way to train deep neural networks in a distributed fashion. While this addresses limitations related to distributed data, it incurs a communication overhead as the model parameters or gradients need to be…

Machine Learning · Computer Science 2023-05-26 Morten From Elvebakken , Alexandros Iosifidis , Lukas Esterle
‹ Prev 1 2 3 10 Next ›