English
Related papers

Related papers: On Second-order Optimization Methods for Federated…

200 papers

Federated Learning (FL) is a communication-efficient distributed machine learning method that allows multiple devices to collaboratively train models without sharing raw data. FL can be categorized into centralized and decentralized…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-01 Changheng Wang , Zhiqing Wei , Lizhe Liu , Qiao Deng , Yingda Wu , Yangyang Niu , Yashan Pang , Zhiyong Feng

Machine Learning (ML) techniques have shown strong potential for network traffic analysis; however, their effectiveness depends on access to representative, up-to-date datasets, which is limited in cybersecurity due to privacy and…

Cryptography and Security · Computer Science 2025-09-23 Roberto Doriguzzi-Corin , Petr Sabel , Silvio Cretti , Silvio Ranise

Federated Learning (FL) is a collaborative learning method that enables decentralized model training while preserving data privacy. Despite its promise in medical imaging, recent FL methods are often sensitive to local factors such as…

Machine Learning · Computer Science 2025-07-29 Youngjoon Lee , Hyukjoon Lee , Jinu Gong , Yang Cao , Joonhyuk Kang

In Federated Learning (FL), the distributed nature and heterogeneity of client data present both opportunities and challenges. While collaboration among clients can significantly enhance the learning process, not all collaborations are…

Machine Learning · Computer Science 2024-07-18 Nazarii Tupitsa , Samuel Horváth , Martin Takáč , Eduard Gorbunov

In federated learning (FL), clients usually have diverse participation statistics that are unknown a priori, which can significantly harm the performance of FL if not handled properly. Existing works aiming at addressing this problem are…

Machine Learning · Computer Science 2024-04-16 Shiqiang Wang , Mingyue Ji

Federated learning aims to collaboratively train models without accessing their client's local private data. The data may be Non-IID for different clients and thus resulting in poor performance. Recently, personalized federated learning…

Machine Learning · Computer Science 2023-02-16 Dui Wang , Li Shen , Yong Luo , Han Hu , Kehua Su , Yonggang Wen , Dacheng Tao

Federated learning (FL) is a promising technology that enables edge devices/clients to collaboratively and iteratively train a machine learning model under the coordination of a central server. The most common approach to FL is first-order…

Machine Learning · Computer Science 2025-01-22 Shayan Mohajer Hamidi , Linfeng Ye

We introduce a new and increasingly relevant setting for distributed optimization in machine learning, where the data defining the optimization are unevenly distributed over an extremely large number of nodes. The goal is to train a…

Machine Learning · Computer Science 2016-10-11 Jakub Konečný , H. Brendan McMahan , Daniel Ramage , Peter Richtárik

A widely recognized difficulty in federated learning arises from the statistical heterogeneity among clients: local datasets often originate from distinct yet not entirely unrelated probability distributions, and personalization is,…

Machine Learning · Statistics 2025-03-12 Shuxiao Chen , Qinqing Zheng , Qi Long , Weijie J. Su

Federated Learning (FL) enables collaborative model training across distributed clients while preserving data privacy, yet faces challenges in non-independent and identically distributed (non-IID) settings due to client drift, which impairs…

Machine Learning · Computer Science 2026-02-12 Mohammad Partohaghighi , Roummel Marcia , Bruce J. West , YangQuan Chen

Second-order federated learning (FL) algorithms offer faster convergence than their first-order counterparts by leveraging curvature information. However, they are hindered by high computational and storage costs, particularly for…

Machine Learning · Computer Science 2025-01-15 Abdulmomen Ghalkha , Chaouki Ben Issaid , Mehdi Bennis

Federated learning (FL) is a widely adopted paradigm for privacy-preserving model training, but FedAvg optimise for the majority while under-serving minority clients. Existing methods such as federated multi-objective learning (FMOL)…

Machine Learning · Computer Science 2025-08-26 Jiansheng Rao , Jiayi Li , Zhizhi Gong , Soummya Kar , Haoxuan Li

Federated learning (FL) is a decentralized learning technique that enables participating devices to collaboratively build a shared Machine Leaning (ML) or Deep Learning (DL) model without revealing their raw data to a third party. Due to…

In traffic prediction, the goal is to estimate traffic speed or flow in specific regions or road segments using historical data collected by devices deployed in each area. Each region or road segment can be viewed as an individual client…

Machine Learning · Computer Science 2025-07-15 Audri Banik , Glaucio Haroldo Silva de Carvalho , Renata Dividino

Federated learning (FL) is a decentralized and privacy-preserving machine learning technique in which a group of clients collaborate with a server to learn a global model without sharing clients' data. One challenge associated with FL is…

Machine Learning · Computer Science 2022-01-27 Canh T. Dinh , Nguyen H. Tran , Tuan Dung Nguyen

Federated learning (FL) enables decentralized model training without centralizing raw data. However, practical FL deployments often face a key realistic challenge: Clients participate intermittently in server aggregation and with unknown,…

Machine Learning · Computer Science 2025-07-15 Herlock , Rahimi , Dionysis Kalogerias

Federated Learning (FL) is a privacy-protected machine learning paradigm that allows model to be trained directly at the edge without uploading data. One of the biggest challenges faced by FL in practical applications is the heterogeneity…

Machine Learning · Computer Science 2021-08-20 Zirui Zhu , Ziyi Ye

There are situations where data relevant to a machine learning problem are distributed among multiple locations that cannot share the data due to regulatory, competitiveness, or privacy reasons. For example, data present in users'…

Machine Learning · Computer Science 2020-08-27 Dimitris Stripelis , Jose Luis Ambite

Adaptive optimization has achieved notable success for distributed learning while extending adaptive optimizer to federated Learning (FL) suffers from severe inefficiency, including (i) rugged convergence due to inaccurate gradient…

Machine Learning · Computer Science 2023-08-02 Yan Sun , Li Shen , Hao Sun , Liang Ding , Dacheng Tao

Federated Learning (FL) aggregates locally trained models from individual clients to construct a global model. While FL enables learning a model with data privacy, it often suffers from significant performance degradation when clients have…

Machine Learning · Computer Science 2024-03-29 Gihun Lee , Minchan Jeong , Sangmook Kim , Jaehoon Oh , Se-Young Yun