English
Related papers

Related papers: Breaking the Memory Wall for Heterogeneous Federat…

200 papers

Federated Learning (FL) allows collaborative training while ensuring data privacy across distributed edge devices, making it a popular solution for privacy-sensitive applications. However, FL faces significant challenges due to statistical…

Machine Learning · Computer Science 2025-05-16 Huy Q. Le , Latif U. Khan , Choong Seon Hong

Federated learning (FL) aims at optimizing a shared global model over multiple edge devices without transmitting (private) data to the central server. While it is theoretically well-known that FL yields an optimal model -- centrally trained…

Machine Learning · Computer Science 2022-11-01 Youngjoon Lee , Sangwoo Park , Joonhyuk Kang

Federated Learning (FL) can be used in mobile edge networks to train machine learning models in a distributed manner. Recently, FL has been interpreted within a Model-Agnostic Meta-Learning (MAML) framework, which brings FL significant…

Machine Learning · Computer Science 2023-03-29 Chaoqun You , Kun Guo , Gang Feng , Peng Yang , Tony Q. S. Quek

Federated Learning provides a privacy-preserving paradigm for distributed learning, but suffers from statistical heterogeneity across clients. Personalized Federated Learning (PFL) mitigates this issue by considering client-specific models.…

Machine Learning · Statistics 2026-02-17 Ala Emrani , Amir Najafi , Abolfazl Motahari

Federated Learning (FL) is a promising paradigm for realizing edge intelligence, allowing collaborative learning among distributed edge devices by sharing models instead of raw data. However, the shared models are often assumed to be ideal,…

Machine Learning · Computer Science 2025-06-02 Dongzi Jin , Yong Xiao , Yingyu Li

Federated learning (FL) allows model training from local data collected by edge/mobile devices while preserving data privacy, which has wide applicability to image and vision applications. A challenge is that client devices in FL usually…

Machine Learning · Computer Science 2022-04-07 Yuang Jiang , Shiqiang Wang , Victor Valls , Bong Jun Ko , Wei-Han Lee , Kin K. Leung , Leandros Tassiulas

Most Continual Learning (CL) methods maintain performance on earlier tasks by storing exemplars in a replay buffer, introducing memory overhead that scales with the number of tasks and raising privacy concerns in regulated domains. We…

Machine Learning · Computer Science 2026-05-11 Mohammad Ali Vahedifar , Qi Zhang

Classical federated learning (FL) enables training machine learning models without sharing data for privacy preservation, but heterogeneous data characteristic degrades the performance of the localized model. Personalized FL (PFL) addresses…

Machine Learning · Computer Science 2023-11-13 Mingjia Shi , Yuhao Zhou , Kai Wang , Huaizheng Zhang , Shudong Huang , Qing Ye , Jiangcheng Lv

Federated Learning (FL) has garnered widespread interest in recent years. However, owing to strict privacy policies or limited storage capacities of training participants such as IoT devices, its effective deployment is often impeded by the…

Machine Learning · Computer Science 2025-03-05 Sheng Yue , Zerui Qin , Yongheng Deng , Ju Ren , Yaoxue Zhang , Junshan Zhang

Federated Learning (FL) has emerged as a transformative approach for enabling distributed machine learning while preserving user privacy, yet it faces challenges like communication inefficiencies and reliance on centralized infrastructures,…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-29 Sai Puppala , Ismail Hossain , Md Jahangir Alam , Sajedul Talukder , Zahidur Talukder , Syed Bahauddin

In cross-device Federated Learning (FL) environments, scaling synchronous FL methods is challenging as stragglers hinder the training process. Moreover, the availability of each client to join the training is highly variable over time due…

Machine Learning · Computer Science 2023-04-17 Tuo Zhang , Lei Gao , Sunwoo Lee , Mi Zhang , Salman Avestimehr

The ever-growing size of training datasets enhances the generalization capability of modern machine learning models but also incurs exorbitant computational costs. Existing data pruning approaches aim to accelerate training by removing…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Dongyue Wu , Zilin Guo , Jialong Zuo , Nong Sang , Changxin Gao

The large communication and computation overhead of federated learning (FL) is one of the main challenges facing its practical deployment over resource-constrained clients and systems. In this work, SpaFL: a communication-efficient FL…

Machine Learning · Computer Science 2024-12-11 Minsu Kim , Walid Saad , Merouane Debbah , Choong Seon Hong

Federated Learning (FL) is a well-known framework for successfully performing a learning task in an edge computing scenario where the devices involved have limited resources and incomplete data representation. The basic assumption of FL is…

Machine Learning · Computer Science 2023-12-08 Lorenzo Valerio , Chiara Boldrini , Andrea Passarella , János Kertész , Márton Karsai , Gerardo Iñiguez

Heterogeneity in data distributions and model architectures remains a significant challenge in federated learning (FL). Various heterogeneous FL (HtFL) approaches have recently been proposed to address this challenge. Among them,…

Machine Learning · Computer Science 2025-07-08 Gyuejeong Lee , Jihwan Shin , Daeyoung Choi

When the available hardware cannot meet the memory and compute requirements to efficiently train high performing machine learning models, a compromise in either the training quality or the model complexity is needed. In Federated Learning…

Machine Learning · Computer Science 2022-08-05 Xinchi Qiu , Javier Fernandez-Marques , Pedro PB Gusmao , Yan Gao , Titouan Parcollet , Nicholas Donald Lane

While a practical wireless network has many tiers where end users do not directly communicate with the central server, the users' devices have limited computation and battery powers, and the serving base station (BS) has a fixed bandwidth.…

Systems and Control · Electrical Eng. & Systems 2024-03-26 Md Ferdous Pervej , Richeng Jin , Huaiyu Dai

Federated learning (FL) enables distributed model training, yet in heterogeneous deployments, Bandwidth-Constrained Clients (BCCs) often contribute inefficiently due to limited uplink bandwidth. In model-heterogeneous FL with fixed small…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-12 Chengjie Ma , Seungeun Oh , Jihong Park , Seong-Lyun Kim

Federated learning is an approach to train machine learning models on the edge of the networks, as close as possible where the data is produced, motivated by the emerging problem of the inability to stream and centrally store the large…

Machine Learning · Computer Science 2022-10-07 Kuo-Yun Liang , Abhishek Srinivasan , Juan Carlos Andresen

The future of machine learning lies in moving data collection along with training to the edge. Federated Learning, for short FL, has been recently proposed to achieve this goal. The principle of this approach is to aggregate models learned…

Machine Learning · Computer Science 2023-07-13 Adnan Ben Mansour , Gaia Carenini , Alexandre Duplessis