English
Related papers

Related papers: DisPFL: Towards Communication-Efficient Personaliz…

200 papers

Federated learning (FL), which has gained increasing attention recently, enables distributed devices to train a common machine learning (ML) model for intelligent inference cooperatively without data sharing. However, problems in practical…

Machine Learning · Computer Science 2022-11-01 Yujie Zhou , Zhidu Li , Tong Tang , Ruyan Wang

Federated Learning is a promising approach for learning from user data while preserving data privacy. However, the high requirements of the model training process make it difficult for clients with limited memory or bandwidth to…

Cryptography and Security · Computer Science 2024-01-18 Minh K. Quan , Dinh C. Nguyen , Van-Dinh Nguyen , Mayuri Wijayasundara , Sujeeva Setunge , Pubudu N. Pathirana

In this paper, the problem of federated learning (FL) through digital communication between clients and a parameter server (PS) over a multiple access channel (MAC), also subject to differential privacy (DP) constraints, is studied. More…

Machine Learning · Computer Science 2020-11-03 Amir Sonee , Stefano Rini

Large language models (LLMs) have emerged as important components across various fields, yet their training requires substantial computation resources and abundant labeled data. It poses a challenge to robustly training LLMs for individual…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-13 Jiaxing QI , Zhongzhi Luan , Shaohan Huang , Carol Fung , Hailong Yang , Depei Qian

The large communication and computation overhead of federated learning (FL) is one of the main challenges facing its practical deployment over resource-constrained clients and systems. In this work, SpaFL: a communication-efficient FL…

Machine Learning · Computer Science 2024-12-11 Minsu Kim , Walid Saad , Merouane Debbah , Choong Seon Hong

Data heterogeneity poses a fundamental challenge in federated learning (FL), especially when clients differ not only in distribution but also in the reliability of their predictions across individual examples. While personalized FL (PFL)…

Machine Learning · Computer Science 2025-09-29 Amr Abourayya , Jens Kleesiek , Bharat Rao , Michael Kamp

Federated learning (FL) is an appealing paradigm that allows a group of machines (a.k.a. clients) to learn collectively while keeping their data local. However, due to the heterogeneity between the clients' data distributions, the model…

Machine Learning · Computer Science 2024-10-01 Youssef Allouah , Abdellah El Mrini , Rachid Guerraoui , Nirupam Gupta , Rafael Pinot

Federated learning (FL) enables collaboratively training a model while keeping the training data decentralized and private. However, one significant impediment to training a model using FL, especially large models, is the resource…

Machine Learning · Computer Science 2023-12-12 Seyed Mahmoud Sajjadi Mohammadabadi , Syed Zawad , Feng Yan , Lei Yang

Federated Learning (FL) is transforming the ML training ecosystem from a centralized over-the-cloud setting to distributed training over edge devices in order to strengthen data privacy. An essential but rarely studied challenge in FL is…

Machine Learning · Computer Science 2021-10-07 Chaoyang He , Zhengyu Yang , Erum Mushtaq , Sunwoo Lee , Mahdi Soltanolkotabi , Salman Avestimehr

Personalized federated learning becomes a hot research topic that can learn a personalized learning model for each client. Existing personalized federated learning models prefer to aggregate similar clients with similar data distribution to…

Machine Learning · Computer Science 2024-03-15 Xu Yang , Jiyuan Feng , Songyue Guo , Ye Wang , Ye Ding , Binxing Fang , Qing Liao

Federated learning (FL) is a decentralized machine learning technique that enables multiple clients to collaboratively train models without requiring clients to reveal their raw data to each other. Although traditional FL trains a single…

Machine Learning · Computer Science 2023-11-22 Junki Mori , Tomoyuki Yoshiyama , Furukawa Ryo , Isamu Teranishi

Federated learning (FL) takes a first step towards privacy-preserving machine learning by training models while keeping client data local. Models trained using FL may still leak private client information through model updates during…

Machine Learning · Computer Science 2023-01-18 Nasser Aldaghri , Hessam Mahdavifar , Ahmad Beirami

We introduce Ring-topology Decentralized Federated Learning (RDFL) for distributed model training, aiming to avoid the inherent risks of centralized failure in server-based FL. However, RDFL faces the challenge of low information-sharing…

Machine Learning · Computer Science 2025-04-29 Shunxin Guo , Jiaqi Lv , Xin Geng

In the age of data-driven decision making, preserving privacy while providing personalized experiences has become paramount. Personalized Federated Learning (PFL) offers a promising framework by decentralizing the learning process, thus…

Machine Learning · Computer Science 2025-01-31 Kevin Cooper , Michael Geller

Federated learning is a distributed, privacy-aware learning scenario which trains a single model on data belonging to several clients. Each client trains a local model on its data and the local models are then aggregated by a central party.…

Machine Learning · Computer Science 2020-01-01 Hesham Mostafa

Personalized federated learning (PFL) reduces the impact of non-independent and identically distributed (non-IID) data among clients by allowing each client to train a personalized model when collaborating with others. A key question in PFL…

Machine Learning · Computer Science 2023-09-21 Xinghao Wu , Xuefeng Liu , Jianwei Niu , Guogang Zhu , Shaojie Tang

Personalization in federated learning (FL) functions as a coordinator for clients with high variance in data or behavior. Ensuring the convergence of these clients' models relies on how closely users collaborate with those with similar…

Machine Learning · Computer Science 2023-02-24 Eunjeong Jeong , Marios Kountouris

We study a new form of federated learning where the clients train personalized local models and make predictions jointly with the server-side shared model. Using this new federated learning framework, the complexity of the central shared…

Machine Learning · Computer Science 2020-03-31 Alekh Agarwal , John Langford , Chen-Yu Wei

With the booming deployment of Internet of Things, health monitoring applications have gradually prospered. Within the recent COVID-19 pandemic situation, interest in permanent remote health monitoring solutions has raised, targeting to…

Machine Learning · Computer Science 2022-12-01 Dong Chu , Wael Jaafar , Halim Yanikomeroglu

In the realm of real-world devices, centralized servers in Federated Learning (FL) present challenges including communication bottlenecks and susceptibility to a single point of failure. Additionally, contemporary devices inherently exhibit…

Machine Learning · Computer Science 2024-08-15 Yasser H. Khalil , Amir H. Estiri , Mahdi Beitollahi , Nader Asadi , Sobhan Hemati , Xu Li , Guojun Zhang , Xi Chen