English
Related papers

Related papers: Overcome Modal Bias in Multi-modal Federated Learn…

200 papers

Federated learning (FL) has obtained tremendous progress in providing collaborative training solutions for distributed data silos with privacy guarantees. However, few existing works explore a more realistic scenario where the clients hold…

Machine Learning · Computer Science 2024-06-18 Liwei Che , Jiaqi Wang , Xinyue Liu , Fenglong Ma

Multimodal federated learning (MFL) aims to enrich model training in FL settings where clients are collecting measurements across multiple modalities. However, key challenges to MFL remain unaddressed, particularly in heterogeneous network…

Machine Learning · Computer Science 2026-03-12 Liangqi Yuan , Dong-Jun Han , Su Wang , Devesh Upadhyay , Christopher G. Brinton

Multimodal Federated Learning (MMFL) utilizes multiple modalities in each client to build a more powerful Federated Learning (FL) model than its unimodal counterpart. However, the impact of missing modality in different clients, also called…

Machine Learning · Computer Science 2024-02-09 Pramit Saha , Divyanshu Mishra , Felix Wagner , Konstantinos Kamnitsas , J. Alison Noble

Multimodal federated learning (MFL) is a distributed framework for training multimodal models without uploading local multimodal data of clients, thereby effectively protecting client privacy. However, multimodal data is commonly…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-17 Xuefeng Han , Wen Chen , Jun Li , Ming Ding , Qingqing Wu , Kang Wei , Xiumei Deng , Yumeng Shao , Qiong Wu

Multimodal Federated Learning (MFL) enables clients with heterogeneous data modalities to collaboratively train models without sharing raw data, offering a privacy-preserving framework that leverages complementary cross-modal information.…

Machine Learning · Computer Science 2026-03-06 Min Tan , Junchao Ma , Yinfu Feng , Jiajun Ding , Wenwen Pan , Tingting Han , Qian Zheng , Zhenzhong Kuang , Zhou Yu

Multimodal federated learning (MFL) has emerged as a decentralized machine learning paradigm, allowing multiple clients with different modalities to collaborate on training a global model across diverse data sources without sharing their…

Machine Learning · Computer Science 2025-03-07 Huy Q. Le , Chu Myaet Thwal , Yu Qiao , Ye Lin Tun , Minh N. H. Nguyen , Eui-Nam Huh , Choong Seon Hong

Federated learning (FL) underpins advancements in privacy-preserving distributed computing by collaboratively training neural networks without exposing clients' raw data. Current FL paradigms primarily focus on uni-modal data, while…

Machine Learning · Computer Science 2024-01-03 Yunfeng Fan , Wenchao Xu , Haozhao Wang , Jiaqi Zhu , Song Guo

In the era of big data, data mining has become indispensable for uncovering hidden patterns and insights from vast and complex datasets. The integration of multimodal data sources further enhances its potential. Multimodal Federated…

Machine Learning · Computer Science 2025-08-22 Lishan Yang , Wei Emma Zhang , Quan Z. Sheng , Lina Yao , Weitong Chen , Ali Shakeri

Multimodal learning integrates information from different modalities to enhance model performance, yet it often suffers from modality imbalance, where dominant modalities overshadow weaker ones during joint optimization. This paper reveals…

Machine Learning · Computer Science 2025-10-17 Xiaoyu Ma , Hao Chen

Federated learning (FL) offers a privacy-centric distributed learning framework, enabling model training on individual clients and central aggregation without necessitating data exchange. Nonetheless, FL implementations often suffer from…

Artificial Intelligence · Computer Science 2024-05-13 Rongyu Zhang , Yun Chen , Chenrui Wu , Fangxin Wang , Bo Li

Federated Learning (FL) is a distributed machine learning approach that enables devices to collaboratively train models without sharing their local data, ensuring user privacy and scalability. However, applying FL to real-world data…

Machine Learning · Computer Science 2024-08-14 Jieming Bian , Lei Wang , Jie Xu

Multimodal Federated Learning (MFL) lies at the intersection of two pivotal research areas: leveraging complementary information from multiple modalities to improve downstream inference performance and enabling distributed training to…

Machine Learning · Computer Science 2025-05-29 Yuanzhe Peng , Jieming Bian , Lei Wang , Yin Huang , Jie Xu

Conventional methods for student modeling, which involve predicting grades based on measured activities, struggle to provide accurate results for minority/underrepresented student groups due to data availability biases. In this paper, we…

Multimodal federated learning (FL) is essential for real-world applications such as autonomous systems and healthcare, where data is distributed across heterogeneous clients with varying and often missing modalities. However, most existing…

Machine Learning · Computer Science 2026-04-15 Pranav M R , Jayant Chandwani , Ahmed M. Abdelmoniem , Arnab K. Paul

One of the key challenges of collaborative machine learning, without data sharing, is multimodal data heterogeneity in real-world settings. While Federated Learning (FL) enables model training across multiple clients, existing frameworks,…

Machine Learning · Computer Science 2025-10-16 Alejandro Guerra-Manzanares , Omar El-Herraoui , Michail Maniatakos , Farah E. Shamout

Multimodal federated learning (FL) aims to enrich model training in FL settings where devices are collecting measurements across multiple modalities (e.g., sensors measuring pressure, motion, and other types of data). However, key…

Machine Learning · Computer Science 2024-08-21 Liangqi Yuan , Dong-Jun Han , Vishnu Pandi Chellapandi , Stanislaw H. Żak , Christopher G. Brinton

Training ML models which are fair across different demographic groups is of critical importance due to the increased integration of ML in crucial decision-making scenarios such as healthcare and recruitment. Federated learning has been…

Machine Learning · Computer Science 2022-11-28 Yahya H. Ezzeldin , Shen Yan , Chaoyang He , Emilio Ferrara , Salman Avestimehr

Multimodal federated learning in real-world settings often encounters incomplete and heterogeneous data across clients. This results in misaligned local feature representations that limit the effectiveness of model aggregation. Unlike prior…

Machine Learning · Computer Science 2025-10-28 Duong M. Nguyen , Trong Nghia Hoang , Thanh Trung Huynh , Quoc Viet Hung Nguyen , Phi Le Nguyen

Training multimodal networks requires a vast amount of data due to their larger parameter space compared to unimodal networks. Active learning is a widely used technique for reducing data annotation costs by selecting only those samples…

Multimedia · Computer Science 2023-08-22 Meng Shen , Yizheng Huang , Jianxiong Yin , Heqing Zou , Deepu Rajan , Simon See

With the increasing amount of multimedia data on modern mobile systems and IoT infrastructures, harnessing these rich multimodal data without breaching user privacy becomes a critical issue. Federated learning (FL) serves as a…

Machine Learning · Computer Science 2023-05-09 Qiying Yu , Yang Liu , Yimu Wang , Ke Xu , Jingjing Liu
‹ Prev 1 2 3 10 Next ›