English
Related papers

Related papers: Resource-Efficient Federated Multimodal Learning v…

200 papers

Multimodal Large Language Models (MLLMs) excel in tasks like multimodal reasoning and cross-modal retrieval but face deployment challenges in real-world scenarios due to distributed multimodal data and strict privacy requirements. Federated…

Machine Learning · Computer Science 2025-06-19 Yao Zhang , Hewei Gao , Haokun Chen , Weiguo Li , Yunpu Ma , Volker Tresp

Federated Learning (FL) has gained significant attention in distributed machine learning by enabling collaborative model training across decentralized system while preserving data privacy. Although extensive research has addressed…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-05 Ahmad Dabaja , Rachid El-Azouzi

In the realm of real-world devices, centralized servers in Federated Learning (FL) present challenges including communication bottlenecks and susceptibility to a single point of failure. Additionally, contemporary devices inherently exhibit…

Machine Learning · Computer Science 2024-08-15 Yasser H. Khalil , Amir H. Estiri , Mahdi Beitollahi , Nader Asadi , Sobhan Hemati , Xu Li , Guojun Zhang , Xi Chen

In Federated Learning (FL), clients may have weak devices that cannot train the full model or even hold it in their memory space. To implement large-scale FL applications, thus, it is crucial to develop a distributed learning method that…

Machine Learning · Computer Science 2024-06-24 Sunwoo Lee , Tuo Zhang , Saurav Prakash , Yue Niu , Salman Avestimehr

Despite recent advancements in federated learning (FL) for medical image diagnosis, addressing data heterogeneity among clients remains a significant challenge for practical implementation. A primary hurdle in FL arises from the non-IID…

Machine Learning · Computer Science 2024-07-09 Pranab Sahoo , Ashutosh Tripathi , Sriparna Saha , Samrat Mondal

Federated learning (FL) provides a privacy-preserving solution for fine-tuning pre-trained large language models (LLMs) using distributed private datasets, enabling task-specific adaptation while preserving data privacy. However,…

Machine Learning · Computer Science 2025-01-09 Na Yan , Yang Su , Yansha Deng , Robert Schober

Federated Multi-Modal Learning (FMML) is an emerging field that integrates information from different modalities in federated learning to improve the learning performance. In this letter, we develop a parameter scheduling scheme to improve…

Information Theory · Computer Science 2024-06-13 Benshun Yin , Zhiyong Chen , Meixia Tao

Federated Learning (FL) enables collaborative learning across distributed clients while preserving data privacy. However, FL faces significant challenges when dealing with heterogeneous data distributions, which can lead to suboptimal…

Machine Learning · Computer Science 2025-03-11 Duy Phuong Nguyen , J. Pablo Munoz , Tanya Roosta , Ali Jannesari

Federated Learning (FL), as a distributed learning paradigm, trains models over distributed clients' data. FL is particularly beneficial for distributed training of Diffusion Models (DMs), which are high-quality image generators that…

Machine Learning · Computer Science 2025-07-10 Qianyu Long , Qiyuan Wang , Christos Anagnostopoulos , Daning Bi

Federated Learning (FL) enables decentralized model training while preserving data privacy. Despite its benefits, FL faces challenges with non-identically distributed (non-IID) data, especially in long-tailed scenarios with imbalanced class…

Machine Learning · Computer Science 2025-07-22 Tianle Li , Yongzhi Huang , Linshan Jiang , Qipeng Xie , Chang Liu , Wenfeng Du , Lu Wang , Kaishun Wu

Multimodal Federated Learning (MFL) with mixed modalities enables unimodal and multimodal clients to collaboratively train models while ensuring clients' privacy. As a representative sample of local data, prototypes offer an approach with…

Machine Learning · Computer Science 2025-08-05 Keke Gai , Mohan Wang , Jing Yu , Dongjue Wang , Qi Wu

Federated Learning (FL) can be used in mobile edge networks to train machine learning models in a distributed manner. Recently, FL has been interpreted within a Model-Agnostic Meta-Learning (MAML) framework, which brings FL significant…

Machine Learning · Computer Science 2023-03-29 Chaoqun You , Kun Guo , Gang Feng , Peng Yang , Tony Q. S. Quek

Federated Learning (FL) has emerged as a promising solution in Edge Computing (EC) environments to process the proliferation of data generated by edge devices. By collaboratively optimizing the global machine learning models on distributed…

Machine Learning · Computer Science 2024-02-14 Yongzhe Jia , Xuyun Zhang , Amin Beheshti , Wanchun Dou

Federated Learning (FL) has emerged as a privacy-preserving paradigm for training machine learning models across distributed edge devices in the Internet of Things (IoT). By keeping data local and coordinating model training through a…

Machine Learning · Computer Science 2025-12-30 Ziru Niu , Hai Dong , A. K. Qin , Tao Gu , Pengcheng Zhang

Unified multimodal models (UMMs) are emerging as strong foundation models that can do both generation and understanding tasks in a single architecture. However, they are typically trained in centralized settings where all training and…

Machine Learning · Computer Science 2026-01-23 Zhaolong Su , Leheng Zhao , Xiaoying Wu , Ziyue Xu , Jindong Wang

This paper proposes a novel scheme for cell-free massive multiple-input multiple-output (CFmMIMO) networks to support any federated learning (FL) framework. This scheme allows each instead of all the iterations of the FL framework to happen…

Signal Processing · Electrical Eng. & Systems 2020-06-16 Tung T. Vu , Duy T. Ngo , Nguyen H. Tran , Hien Quoc Ngo , Minh N. Dao , Richard H. Middleton

Federated learning enables many local devices to train a deep learning model jointly without sharing the local data. Currently, most of federated training schemes learns a global model by averaging the parameters of local models. However,…

Machine Learning · Computer Science 2021-10-26 Zhenwei Dai , Chen Dun , Yuxin Tang , Anastasios Kyrillidis , Anshumali Shrivastava

Federated Learning (FL) is a distributed machine learning (ML) paradigm, aiming to train a global model by exploiting the decentralized data across millions of edge devices. Compared with centralized learning, FL preserves the clients'…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-08-15 Bocheng Chen , Nikolay Ivanov , Guangjing Wang , Qiben Yan

Neural fields provide a memory-efficient representation of data, which can effectively handle diverse modalities and large-scale data. However, learning to map neural fields often requires large amounts of training data and computations,…

Machine Learning · Computer Science 2025-08-11 Junhyeog Yun , Minui Hong , Gunhee Kim

Large language models (LLMs) have emerged as important components across various fields, yet their training requires substantial computation resources and abundant labeled data. It poses a challenge to robustly training LLMs for individual…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-13 Jiaxing QI , Zhongzhi Luan , Shaohan Huang , Carol Fung , Hailong Yang , Depei Qian