English
Related papers

Related papers: Faster federated optimization under second-order s…

200 papers

Federated Learning (FL) is a distributed approach to collaboratively training machine learning models. FL requires a high level of communication between the devices and a central server, thus imposing several challenges, including…

Many recent successes of machine learning went hand in hand with advances in optimization. The exchange of ideas between these fields has worked both ways, with machine learning building on standard optimization procedures such as gradient…

Optimization and Control · Mathematics 2021-10-26 Konstantin Mishchenko

Federated learning (FL) is an effective solution to train machine learning models on the increasing amount of data generated by IoT devices and smartphones while keeping such data localized. Most previous work on federated learning assumes…

Machine Learning · Computer Science 2023-01-05 Othmane Marfoq , Giovanni Neglia , Laetitia Kameni , Richard Vidal

In contrast to training traditional machine learning (ML) models in data centers, federated learning (FL) trains ML models over local datasets contained on resource-constrained heterogeneous edge devices. Existing FL algorithms aim to learn…

Machine Learning · Computer Science 2022-09-13 El Houcine Bergou , Konstantin Burlachenko , Aritra Dutta , Peter Richtárik

Federated Learning (FL) emerged as a practical approach to training a model from decentralized data. The proliferation of FL led to the development of numerous FL algorithms and mechanisms. Many prior efforts have given their primary focus…

Machine Learning · Computer Science 2024-03-27 Gustav A. Baumgart , Jaemin Shin , Ali Payani , Myungjin Lee , Ramana Rao Kompella

Federated learning (FL) enables collaborative model training with privacy preservation. Data heterogeneity across edge devices (clients) can cause models to converge to sharp minima, negatively impacting generalization and robustness.…

Artificial Intelligence · Computer Science 2025-04-01 Debora Caldarola , Pietro Cagnasso , Barbara Caputo , Marco Ciccone

With the rapid growth in mobile computing, massive amounts of data and computing resources are now located at the edge. To this end, Federated learning (FL) is becoming a widely adopted distributed machine learning (ML) paradigm, which aims…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-06-15 Li Chou , Zichang Liu , Zhuang Wang , Anshumali Shrivastava

In this paper, a new learning algorithm for Federated Learning (FL) is introduced. The proposed scheme is based on a weighted gradient aggregation using two-step optimization to offer a flexible training pipeline. Herein, two different…

Machine Learning · Computer Science 2021-06-15 Dimitrios Dimitriadis , Kenichi Kumatani , Robert Gmyr , Yashesh Gaur , Sefik Emre Eskimez

Federated Learning (FL), a distributed learning paradigm that scales on-device learning collaboratively, has emerged as a promising approach for decentralized AI applications. Local optimization methods such as Federated Averaging (FedAvg)…

Machine Learning · Computer Science 2024-01-25 Honglin Yuan

Federated Learning (FL) since proposed has been applied in many fields, such as credit assessment, medical, etc. Because of the difference in the network or computing resource, the clients may not update their gradients at the same time…

Machine Learning · Computer Science 2021-11-19 Zhicheng Zhou , Hailong Chen , Kunhua Li , Fei Hu , Bingjie Yan , Jieren Cheng , Xuyan Wei , Bernie Liu , Xiulai Li , Fuwen Chen , Yongji Sui

Federated learning (FL) faces critical challenges, particularly in heterogeneous environments where non-independent and identically distributed data across clients can lead to unfair and inefficient model performance. In this work, we…

Machine Learning · Computer Science 2025-05-22 Mounssif Krouka , Chaouki Ben Issaid , Mehdi Bennis

Federated Learning (FL) faces major challenges regarding communication overhead and model privacy when training large language models (LLMs), especially in healthcare applications. To address these, we introduce Selective Attention…

Computation and Language · Computer Science 2025-04-22 Yue Li , Lihong Zhang

Federated Learning (FL) is a novel, multidisciplinary Machine Learning paradigm where multiple clients, such as mobile devices, collaborate to solve machine learning problems. Initially introduced in Kone{\v{c}}n{\'y} et al. (2016a,b);…

Machine Learning · Computer Science 2025-09-11 Konstantin Burlachenko

Federated learning (FL) is a rapidly growing privacy-preserving collaborative machine learning paradigm. In practical FL applications, local data from each data silo reflect local usage patterns. Therefore, there exists heterogeneity of…

Machine Learning · Computer Science 2022-02-01 Shenglai Zeng , Zonghang Li , Hongfang Yu , Yihong He , Zenglin Xu , Dusit Niyato , Han Yu

Federated learning is a communication-efficient training process that alternates between local training at the edge devices and averaging the updated local model at the central server. Nevertheless, it is impractical to achieve a perfect…

Machine Learning · Computer Science 2019-11-04 Fan Ang , Li Chen , Nan Zhao , Yunfei Chen , Weidong Wang , F. Richard Yu

Federated learning (FL) is an emerging technique that trains massive and geographically distributed edge data while maintaining privacy. However, FL has inherent challenges in terms of fairness and computational efficiency due to the rising…

Machine Learning · Computer Science 2023-04-28 Yingchun Wang , Jingcai Guo , Jie Zhang , Song Guo , Weizhan Zhang , Qinghua Zheng

Federated learning (FL) is a promising distributed learning framework where distributed clients collaboratively train a machine learning model coordinated by a server. To tackle the stragglers issue in asynchronous FL, we consider that each…

Machine Learning · Computer Science 2023-11-29 Jiarong Yang , Yuan Liu , Fangjiong Chen , Wen Chen , Changle Li

Federated Learning (FL) has recently received a lot of attention for large-scale privacy-preserving machine learning. However, high communication overheads due to frequent gradient transmissions decelerate FL. To mitigate the communication…

Machine Learning · Computer Science 2021-05-27 Milad Khademi Nori , Sangseok Yun , Il-Min Kim

Federated learning (FL) is a recently developed area of machine learning, in which the private data of a large number of distributed clients is used to develop a global model under the coordination of a central server without explicitly…

Machine Learning · Computer Science 2022-07-21 Amit Kumar Kundu , Joseph Jaja

Federated Learning (FL) is a distributed machine learning approach where multiple clients work together to solve a machine learning task. One of the key challenges in FL is the issue of partial participation, which occurs when a large…

Machine Learning · Computer Science 2023-03-01 Grigory Malinovsky , Samuel Horváth , Konstantin Burlachenko , Peter Richtárik
‹ Prev 1 4 5 6 7 8 10 Next ›