English
Related papers

Related papers: Accelerating Federated Learning in Heterogeneous D…

200 papers

Restrictive rules for data sharing in many industries have led to the development of federated learning. Federated learning is a machine-learning technique that allows distributed clients to train models collaboratively without the need to…

Computers and Society · Computer Science 2023-09-07 Joaquin Delgado Fernandez , Martin Brennecke , Tom Barbereau , Alexander Rieger , Gilbert Fridgen

Federated averaging (FedAvg) is the most fundamental algorithm in Federated learning (FL). Previous theoretical results assert that FedAvg convergence and generalization degenerate under heterogeneous clients. However, recent empirical…

Machine Learning · Computer Science 2024-12-16 Dun Zeng , Zenglin Xu , Shiyu Liu , Yu Pan , Qifan Wang , Xiaoying Tang

Distributed learning algorithms aim to leverage distributed and diverse data stored at users' devices to learn a global phenomena by performing training amongst participating devices and periodically aggregating their local models'…

Machine Learning · Computer Science 2021-02-04 Naram Mhaisen , Alaa Awad , Amr Mohamed , Aiman Erbad , Mohsen Guizani

Federated learning (FL) has emerged as a popular technique for distributing machine learning across wireless edge devices. We examine FL under two salient properties of contemporary networks: device-server communication delays and device…

Networking and Internet Architecture · Computer Science 2022-02-08 David Nickel , Frank Po-Chen Lin , Seyyedali Hosseinalipour , Nicolo Michelusi , Christopher G. Brinton

Federated learning harnesses the power of distributed optimization to train a unified machine learning model across separate clients. However, heterogeneous data distributions and computational workloads can lead to inconsistent updates and…

Machine Learning · Computer Science 2024-10-15 Aayushya Agarwal , Gauri Joshi , Larry Pileggi

Recently, federated learning has emerged as a promising approach for training a global model using data from multiple organizations without leaking their raw data. Nevertheless, directly applying federated learning to real-world tasks faces…

Machine Learning · Computer Science 2022-04-19 Bingzhe Wu , Zhipeng Liang , Yuxuan Han , Yatao Bian , Peilin Zhao , Junzhou Huang

Federated learning allows distributed devices to collectively train a model without sharing or disclosing the local dataset with a central server. The global model is optimized by training and averaging the model parameters of all local…

Machine Learning · Computer Science 2021-03-23 George Pu , Yanlin Zhou , Dapeng Wu , Xiaolin Li

Federated learning has gained popularity as a means of training models distributed across the wireless edge. The paper introduces delay-aware hierarchical federated learning (DFL) to improve the efficiency of distributed machine learning…

Machine Learning · Computer Science 2023-09-29 Frank Po-Chen Lin , Seyyedali Hosseinalipour , Nicolò Michelusi , Christopher Brinton

Terabytes of data are collected by wind turbine manufacturers from their fleets every day. And yet, a lack of data access and sharing impedes exploiting the full potential of the data. We present a distributed machine learning approach that…

Machine Learning · Computer Science 2023-09-18 Lorin Jenkel , Stefan Jonas , Angela Meyer

Federated learning achieves joint training of deep models by connecting decentralized data sources, which can significantly mitigate the risk of privacy leakage. However, in a more general case, the distributions of labels among clients are…

Machine Learning · Computer Science 2022-12-20 Tao Sheng , Chengchao Shen , Yuan Liu , Yeyu Ou , Zhe Qu , Jianxin Wang

Federated Learning is an emerging distributed collaborative learning paradigm used by many of applications nowadays. The effectiveness of federated learning relies on clients' collective efforts and their willingness to contribute local…

Computer Science and Game Theory · Computer Science 2022-05-24 Shuyu Kong , You Li , Hai Zhou

Federated learning (FL) is an emerging distributed training paradigm that aims to learn a common global model without exchanging or transferring the data that are stored locally at different clients. The Federated Averaging (FedAvg)-based…

Machine Learning · Computer Science 2024-02-20 Xiaolu Wang , Zijian Li , Shi Jin , Jun Zhang

One of the key challenges of collaborative machine learning, without data sharing, is multimodal data heterogeneity in real-world settings. While Federated Learning (FL) enables model training across multiple clients, existing frameworks,…

Machine Learning · Computer Science 2025-10-16 Alejandro Guerra-Manzanares , Omar El-Herraoui , Michail Maniatakos , Farah E. Shamout

There has been a surge of interest in continual learning and federated learning, both of which are important in deep neural networks in real-world scenarios. Yet little research has been done regarding the scenario where each client learns…

Machine Learning · Computer Science 2021-06-15 Jaehong Yoon , Wonyong Jeong , Giwoong Lee , Eunho Yang , Sung Ju Hwang

Federated learning is one popular paradigm to train a joint model in a distributed, privacy-preserving environment. But partial annotations pose an obstacle meaning that categories of labels are heterogeneous over clients. We propose to…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Malte Tölle , Fernando Navarro , Sebastian Eble , Ivo Wolf , Bjoern Menze , Sandy Engelhardt

In the context of Federated Learning with heterogeneous data environments, local models tend to converge to their own local model optima during local training steps, deviating from the overall data distributions. Aggregation of these local…

Machine Learning · Computer Science 2025-10-29 Mortesa Hussaini , Jan Theiß , Anthony Stein

With growth in the number of smart devices and advancements in their hardware, in recent years, data-driven machine learning techniques have drawn significant attention. However, due to privacy and communication issues, it is not possible…

Machine Learning · Computer Science 2020-12-10 Mohammad Salehi , Ekram Hossain

Federated Learning allows training of data stored in distributed devices without the need for centralizing training data, thereby maintaining data privacy. Addressing the ability to handle data heterogeneity (non-identical and independent…

Machine Learning · Computer Science 2021-07-01 Pravin Chandran , Raghavendra Bhat , Avinash Chakravarthi , Srikanth Chandar

Federated learning, where algorithms are trained across multiple decentralized devices without sharing local data, is increasingly popular in distributed machine learning practice. Typically, a graph structure $G$ exists behind local…

Machine Learning · Statistics 2022-09-20 Huiyuan Wang , Xuyang Zhao , Wei Lin

Dimensionality Reduction is a commonly used element in a machine learning pipeline that helps to extract important features from high-dimensional data. In this work, we explore an alternative federated learning system that enables…

Machine Learning · Computer Science 2020-11-16 Anna Bogdanova , Akie Nakai , Yukihiko Okada , Akira Imakura , Tetsuya Sakurai