English
Related papers

Related papers: Leveraging Foundation Models for Multi-modal Feder…

200 papers

Multimodal federated learning holds immense potential for collaboratively training models from multiple sources without sharing raw data, addressing both data scarcity and privacy concerns, two key challenges in healthcare. A major…

Machine Learning · Computer Science 2025-05-27 Pranav Poudel , Aavash Chhetri , Prashnna Gyawali , Georgios Leontidis , Binod Bhattarai

Federated learning (FL) enables collaboratively training deep learning models on decentralized data. However, there are three types of heterogeneities in FL setting bringing about distinctive challenges to the canonical federated learning…

Machine Learning · Computer Science 2020-09-18 Tao Shen , Jie Zhang , Xinkang Jia , Fengda Zhang , Gang Huang , Pan Zhou , Kun Kuang , Fei Wu , Chao Wu

Federated learning (FL) has attracted significant attention for enabling collaborative learning without exposing private data. Among the primary variants of FL, vertical federated learning (VFL) addresses feature-partitioned data held by…

Machine Learning · Computer Science 2026-03-31 Kihun Hong , Sejun Park , Ganguk Hwang

Many healthcare sensing applications utilize multimodal time-series data from sensors embedded in mobile and wearable devices. Federated Learning (FL), with its privacy-preserving advantages, is particularly well-suited for health…

Machine Learning · Computer Science 2024-11-28 Adiba Orzikulova , Jaehyun Kwak , Jaemin Shin , Sung-Ju Lee

The Internet of Things (IoT) ecosystem generates vast amounts of multimodal data from heterogeneous sources such as sensors, cameras, and microphones. As edge intelligence continues to evolve, IoT devices have progressed from simple data…

Machine Learning · Computer Science 2025-05-23 Heqiang Wang , Xiang Liu , Xiaoxiong Zhong , Lixing Chen , Fangming Liu , Weizhe Zhang

We present a novel approach in the domain of federated learning (FL), particularly focusing on addressing the challenges posed by modality heterogeneity, variability in modality availability across clients, and the prevalent issue of…

Machine Learning · Computer Science 2023-12-19 Minh Tran , Roochi Shah , Zejun Gong

Federated Learning (FL) enables decentralized model training across multiple parties while preserving privacy. However, most FL systems assume clients hold only unimodal data, limiting their real-world applicability, as institutions often…

Machine Learning · Computer Science 2025-04-17 Yu Zhang , Qingfeng Du , Jiaqi Lv

Federated learning (FL) has emerged as a powerful approach to safeguard data privacy by training models across distributed edge devices without centralizing local data. Despite advancements in homogeneous data scenarios, maintaining…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Yuting Ma , Shengeng Tang , Xiaohua Xu , Lechao Cheng

Federated learning (FL) enables collaborative model training across decentralized medical institutions while preserving data privacy. However, medical FL benchmarks remain scarce, with existing efforts focusing mainly on unimodal or bimodal…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Aavash Chhetri , Bibek Niroula , Pratik Shrestha , Yash Raj Shrestha , Lesley A Anderson , Prashnna K Gyawali , Loris Bazzani , Binod Bhattarai

Federated learning (FL) is a privacy-preserving paradigm for training collective machine learning models with locally stored data from multiple participants. Vertical federated learning (VFL) deals with the case where participants sharing…

Machine Learning · Computer Science 2020-01-31 Siwei Feng , Han Yu

Over the past few years, Federated Learning (FL) has become an emerging machine learning technique to tackle data privacy challenges through collaborative training. In the Federated Learning algorithm, the clients submit a locally trained…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-06-22 Tiantian Feng , Digbalay Bose , Tuo Zhang , Rajat Hebbar , Anil Ramakrishna , Rahul Gupta , Mi Zhang , Salman Avestimehr , Shrikanth Narayanan

Multimodal federated learning in real-world settings often encounters incomplete and heterogeneous data across clients. This results in misaligned local feature representations that limit the effectiveness of model aggregation. Unlike prior…

Machine Learning · Computer Science 2025-10-28 Duong M. Nguyen , Trong Nghia Hoang , Thanh Trung Huynh , Quoc Viet Hung Nguyen , Phi Le Nguyen

Multimodal Federated Learning (MMFL) utilizes multiple modalities in each client to build a more powerful Federated Learning (FL) model than its unimodal counterpart. However, the impact of missing modality in different clients, also called…

Machine Learning · Computer Science 2024-02-09 Pramit Saha , Divyanshu Mishra , Felix Wagner , Konstantinos Kamnitsas , J. Alison Noble

Federated Learning (FL) is an emerging paradigm that allows a model to be trained across a number of participants without sharing data. Recent works have begun to consider the effects of using pre-trained models as an initialization point…

Machine Learning · Computer Science 2023-11-07 Gwen Legate , Nicolas Bernier , Lucas Caccia , Edouard Oyallon , Eugene Belilovsky

Federated Learning with LoRA fine-tuning offers an efficient and privacy-aware solution for institutions to collaboratively leverage their large datasets to train VLLMs. However, participating institutions often possess heterogeneous…

Machine Learning · Computer Science 2026-05-19 Lishan Yang , Wei Emma Zhang , Nam Kha Nguygen , Po Hu , Yanjun Shu , Weitong Chen , Mong Yuan Sim

Federated learning (FL) allows edge devices to collaboratively train models without sharing local data. As FL gains popularity, clients may need to train multiple unrelated FL models, but communication constraints limit their ability to…

Machine Learning · Computer Science 2025-04-23 Haoran Zhang , Zejun Gong , Zekai Li , Marie Siew , Carlee Joe-Wong , Rachid El-Azouzi

Federated Learning (FL) is a distributed machine learning approach that enables devices to collaboratively train models without sharing their local data, ensuring user privacy and scalability. However, applying FL to real-world data…

Machine Learning · Computer Science 2024-08-14 Jieming Bian , Lei Wang , Jie Xu

Multimodal federated learning (FL) aims to enrich model training in FL settings where devices are collecting measurements across multiple modalities (e.g., sensors measuring pressure, motion, and other types of data). However, key…

Machine Learning · Computer Science 2024-08-21 Liangqi Yuan , Dong-Jun Han , Vishnu Pandi Chellapandi , Stanislaw H. Żak , Christopher G. Brinton

Federated learning (FL) offers a privacy-centric distributed learning framework, enabling model training on individual clients and central aggregation without necessitating data exchange. Nonetheless, FL implementations often suffer from…

Artificial Intelligence · Computer Science 2024-05-13 Rongyu Zhang , Yun Chen , Chenrui Wu , Fangxin Wang , Bo Li

Federated learning (FL) has been proposed to allow collaborative training of machine learning (ML) models among multiple parties where each party can keep its data private. In this paradigm, only model updates, such as model weights or…

Machine Learning · Computer Science 2021-06-18 Runhua Xu , Nathalie Baracaldo , Yi Zhou , Ali Anwar , James Joshi , Heiko Ludwig