English
Related papers

Related papers: On Second-order Optimization Methods for Federated…

200 papers

Purpose: We apply federated learning to train an OCT image classifier simulating a realistic scenario with multiple clients and statistical heterogeneous data distribution where data in the clients lack samples of some categories entirely.…

Computer Vision and Pattern Recognition · Computer Science 2024-02-16 Sanskar Amgain , Prashant Shrestha , Sophia Bano , Ignacio del Valle Torres , Michael Cunniffe , Victor Hernandez , Phil Beales , Binod Bhattarai

Federated learning (FL) aims to collaboratively train a shared model across multiple clients without transmitting their local data. Data heterogeneity is a critical challenge in realistic FL settings, as it causes significant performance…

Machine Learning · Computer Science 2023-11-15 Yuwei Wang , Runhan Li , Hao Tan , Xuefeng Jiang , Sheng Sun , Min Liu , Bo Gao , Zhiyuan Wu

Federated Learning (FL) offers a promising approach for collaborative machine learning across distributed devices. However, its adoption is hindered by the complexity of building reliable communication architectures and the need for…

Machine Learning · Computer Science 2024-08-26 Chamith Mawela , Chaouki Ben Issaid , Mehdi Bennis

Federated learning (FL) is a distributed learning method that offers medical institutes the prospect of collaboration in a global model while preserving the privacy of their patients. Although most medical centers conduct similar medical…

Machine Learning · Computer Science 2022-07-08 Yousef Yeganeh , Azade Farshad , Johann Boschmann , Richard Gaus , Maximilian Frantzen , Nassir Navab

Federated Learning is a machine learning paradigm where we aim to train machine learning models in a distributed fashion. Many clients/edge devices collaborate with each other to train a single model on the central. Clients do not share…

Machine Learning · Computer Science 2022-11-28 Mann Patel

Virtually all federated learning (FL) methods, including FedAvg, operate in the following manner: i) an orchestrating server sends the current model parameters to a cohort of clients selected via certain rule, ii) these clients then…

Machine Learning · Computer Science 2024-06-04 Kai Yi , Timur Kharisov , Igor Sokolov , Peter Richtárik

Federated learning (FL) is a promising paradigm to enable privacy-preserving deep learning from distributed data. Most previous works are based on federated average (FedAvg), which, however, faces several critical issues, including a high…

Machine Learning · Computer Science 2022-03-15 Lumin Liu , Jun Zhang , S. H. Song , Khaled B. Letaief

Federated learning (FL) is a distributed learning technique that trains a shared model over distributed data in a privacy-preserving manner. Unfortunately, FL's performance degrades when there is (i) variability in client characteristics in…

Machine Learning · Computer Science 2021-10-28 Muhammad Tahir Munir , Muhammad Mustansar Saeed , Mahad Ali , Zafar Ayyub Qazi , Ihsan Ayyub Qazi

Most existing federated learning algorithms are based on the vanilla FedAvg scheme. However, with the increase of data complexity and the number of model parameters, the amount of communication traffic and the number of iteration rounds for…

Machine Learning · Computer Science 2024-01-30 Xiaolin Zheng , Senci Ying , Fei Zheng , Jianwei Yin , Longfei Zheng , Chaochao Chen , Fengqin Dong

Federated Learning (FL) enables the training of Deep Learning models without centrally collecting possibly sensitive raw data. The most used algorithms for FL are parameter-averaging based schemes (e.g., Federated Averaging) that, however,…

Machine Learning · Computer Science 2025-04-08 Alessio Mora , Irene Tenison , Paolo Bellavista , Irina Rish

Local Stochastic Gradient Descent (SGD) with periodic model averaging (FedAvg) is a foundational algorithm in Federated Learning. The algorithm independently runs SGD on multiple workers and periodically averages the model across all the…

Machine Learning · Computer Science 2022-01-12 Sunwoo Lee , Anit Kumar Sahu , Chaoyang He , Salman Avestimehr

Federated learning (FL) enables decentralized clients to train a model collaboratively without sharing local data. A key distinction between FL and centralized learning is that clients' data are non-independent and identically distributed,…

Machine Learning · Computer Science 2025-08-19 Like Jian , Dong Liu

Recently, federated learning has raised increasing interest in the medical image analysis field due to its ability to aggregate multi-center data with privacy-preserving properties. A large amount of federated training schemes have been…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Matthis Manthe , Stefan Duffner , Carole Lartizien

Federated learning is a useful framework for centralized learning from distributed data under practical considerations of heterogeneity, asynchrony, and privacy. Federated architectures are frequently deployed in deep learning settings,…

Machine Learning · Computer Science 2020-12-04 Stefan Vlaski , Elsa Rizk , Ali H. Sayed

Federated learning (FL) is an emerging paradigm that permits a large number of clients with heterogeneous data to coordinate learning of a unified global model without the need to share data amongst each other. A major challenge in…

Machine Learning · Computer Science 2023-11-16 Irene Tenison , Sai Aravind Sreeramadas , Vaikkunth Mugunthan , Edouard Oyallon , Irina Rish , Eugene Belilovsky

Federated learning aims to jointly learn statistical models over massively distributed remote devices. In this work, we propose FedDANE, an optimization method that we adapt from DANE, a method for classical distributed optimization, to…

Machine Learning · Computer Science 2020-01-08 Tian Li , Anit Kumar Sahu , Manzil Zaheer , Maziar Sanjabi , Ameet Talwalkar , Virginia Smith

Federated Learning enables visual models to be trained on-device, bringing advantages for user privacy (data need never leave the device), but challenges in terms of data diversity and quality. Whilst typical models in the datacenter are…

Machine Learning · Computer Science 2020-07-20 Tzu-Ming Harry Hsu , Hang Qi , Matthew Brown

Federated learning (FL) is a general framework for learning across an axis of group partitioned data (heterogeneous clients) while preserving data privacy, under the orchestration of a central server. FL methods often compute gradients of…

Machine Learning · Computer Science 2024-11-26 Keith Rush , Zachary Charles , Zachary Garrett

Multi-server Federated learning (FL) has been considered as a promising solution to address the limited communication resource problem of single-server FL. We consider a typical multi-server FL architecture, where the coverage areas of…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-08-18 Zhe Qu , Xingyu Li , Jie Xu , Bo Tang , Zhuo Lu , Yao Liu

Federated learning (FL) is an emerging machine learning paradigm involving multiple clients, e.g., mobile phone devices, with an incentive to collaborate in solving a machine learning problem coordinated by a central server. FL was proposed…

Machine Learning · Computer Science 2022-07-04 Samuel Horváth