English
Related papers

Related papers: Aggregation Design for Personalized Federated Mult…

200 papers

Federated Learning has been recently proposed for distributed model training at the edge. The principle of this approach is to aggregate models learned on distributed clients to obtain a new more general "average" model (FedAvg). The…

Machine Learning · Statistics 2022-07-20 Adnan Ben Mansour , Gaia Carenini , Alexandre Duplessis , David Naccache

In this paper, we explore a novel federated multimodal instruction tuning task(FedMIT), which is significant for collaboratively fine-tuning MLLMs on different types of multimodal instruction data on distributed devices. To solve the new…

Machine Learning · Computer Science 2025-01-27 Baochen Xiong , Xiaoshan Yang , Yaguang Song , Yaowei Wang , Changsheng Xu

Wireless federated learning (FL) is an emerging machine learning paradigm that trains a global parametric model from distributed datasets via wireless communications. This paper proposes a unit-modulus wireless FL (UMWFL) framework, which…

Signal Processing · Electrical Eng. & Systems 2021-09-01 Shuai Wang , Dachuan Li , Rui Wang , Qi Hao , Yik-Chung Wu , Derrick Wing Kwan Ng

We propose clustered federated multitask learning to address statistical challenges in non-independent and identically distributed data across clients. Our approach tackles complexities in hierarchical wireless networks by clustering…

Networking and Internet Architecture · Computer Science 2024-07-15 Moqbel Hamood , Abdullatif Albaseer , Mohamed Abdallah , Ala Al-Fuqaha , Amr Mohamed

Machine learning for hybrid beamforming has been extensively studied by using centralized machine learning (CML) techniques, which require the training of a global model with a large dataset collected from the users. However, the…

Signal Processing · Electrical Eng. & Systems 2020-08-25 Ahmet M. Elbir , Sinem Coleri

Motivated by high resource costs of centralized machine learning schemes as well as data privacy concerns, federated learning (FL) emerged as an efficient alternative that relies on aggregating locally trained models rather than collecting…

Machine Learning · Computer Science 2023-12-22 Yiyue Chen , Haris Vikalo , Chianing Wang

We study a new form of federated learning where the clients train personalized local models and make predictions jointly with the server-side shared model. Using this new federated learning framework, the complexity of the central shared…

Machine Learning · Computer Science 2020-03-31 Alekh Agarwal , John Langford , Chen-Yu Wei

Personalized medication aims to tailor healthcare to individual patient characteristics. However, the heterogeneity of patient data across healthcare systems presents significant challenges to achieving accurate and effective personalized…

Artificial Intelligence · Computer Science 2024-12-10 Jiechao Gao , Yuangang Li

Personalized Federated Learning (pFL) holds immense promise for tailoring machine learning models to individual users while preserving data privacy. However, achieving optimal performance in pFL often requires a careful balancing act…

Machine Learning · Computer Science 2024-09-12 Azal Ahmad Khan , Ahmad Faraz Khan , Haider Ali , Ali Anwar

Federated learning (FL) is a distributed learning protocol in which a server needs to aggregate a set of models learned some independent clients to proceed the learning process. At present, model averaging, known as FedAvg, is one of the…

Machine Learning · Computer Science 2020-08-12 Kenta Nagura , Song Bian , Takashi Sato

With the increasing amount of multimedia data on modern mobile systems and IoT infrastructures, harnessing these rich multimodal data without breaching user privacy becomes a critical issue. Federated learning (FL) serves as a…

Machine Learning · Computer Science 2023-05-09 Qiying Yu , Yang Liu , Yimu Wang , Ke Xu , Jingjing Liu

Federated learning (FL) enables collaborative model training across distributed clients without centralizing data. However, existing approaches such as Federated Averaging (FedAvg) often perform poorly with heterogeneous data distributions,…

Machine Learning · Computer Science 2025-08-05 Gyuejeong Lee , Daeyoung Choi

Quick global aggregation of effective distributed parameters is crucial to federated learning (FL), which requires adequate bandwidth for parameters communication and sufficient user data for local training. Otherwise, FL may cost excessive…

Machine Learning · Computer Science 2022-08-25 Tao Guo , Song Guo , Junxiao Wang , Wenchao Xu

Large language models (LLMs) increasingly adopt Mixture-of-Experts (MoE) architectures to scale model capacity while reducing computation. Fine-tuning these MoE-based LLMs often requires access to distributed and privacy-sensitive data,…

Machine Learning · Computer Science 2026-03-24 Zihan Fang , Qianru Wang , Haonan An , Zheng Lin , Yiqin Deng , Xianhao Chen , Yuguang Fang

Collaboratively fine-tuning (FT) large language models (LLMs) over heterogeneous mobile devices fosters immense potential applications of personalized intelligence. However, such a vision faces critical system challenges. Conventional…

Machine Learning · Computer Science 2025-08-12 Xingke Yang , Liang Li , Sicong Li , Liwei Guan , Hao Wang , Xiaoqi Qi , Jiang Liu , Xin Fu , Miao Pan

Federated Learning (FL) is an emerging framework for distributed processing of large data volumes by edge devices subject to limited communication bandwidths, heterogeneity in data distributions and computational resources, as well as…

Machine Learning · Computer Science 2022-04-11 Yonghai Gong , Yichuan Li , Nikolaos M. Freris

In the era of advanced technologies, mobile devices are equipped with computing and sensing capabilities that gather excessive amounts of data. These amounts of data are suitable for training different learning models. Cooperated with…

Machine Learning · Computer Science 2020-04-07 Muhammad Asad , Ahmed Moustafa , Takayuki Ito , Muhammad Aslam

Federated learning (FL) is an emerging machine learning paradigm in which a central server coordinates multiple participants (clients) collaboratively to train on decentralized data. In practice, FL often faces statistical, system, and…

Machine Learning · Computer Science 2024-02-13 Liping Yi , Han Yu , Gang Wang , Xiaoguang Liu , Xiaoxiao Li

Personalized federated learning has received an upsurge of attention due to the mediocre performance of conventional federated learning (FL) over heterogeneous data. Unlike conventional FL which trains a single global consensus model,…

Machine Learning · Computer Science 2023-09-08 Jun Luo , Matias Mendieta , Chen Chen , Shandong Wu

Federated Learning (FL) facilitates collaborative machine learning by training models on local datasets, and subsequently aggregating these local models at a central server. However, the frequent exchange of model parameters between clients…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-15 Liwei Wang , Jun Li , Wen Chen , Qingqing Wu , Ming Ding