English
Related papers

Related papers: Cross-Modal Prototype based Multimodal Federated L…

200 papers

Federated learning (FL) has obtained tremendous progress in providing collaborative training solutions for distributed data silos with privacy guarantees. However, few existing works explore a more realistic scenario where the clients hold…

Machine Learning · Computer Science 2024-06-18 Liwei Che , Jiaqi Wang , Xinyue Liu , Fenglong Ma

Multimodal Federated Learning (MFL) with mixed modalities enables unimodal and multimodal clients to collaboratively train models while ensuring clients' privacy. As a representative sample of local data, prototypes offer an approach with…

Machine Learning · Computer Science 2025-08-05 Keke Gai , Mohan Wang , Jing Yu , Dongjue Wang , Qi Wu

Multimodal AI has demonstrated superior performance over unimodal approaches by leveraging diverse data sources for more comprehensive analysis. However, applying this effectiveness in healthcare is challenging due to the limited…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Pranav Poudel , Prashant Shrestha , Sanskar Amgain , Yash Raj Shrestha , Prashnna Gyawali , Binod Bhattarai

Recently, multimodal graph learning (MGL) has garnered significant attention for integrating diverse modality information and structured context to support various network applications. However, real-world graphs are often isolated due to…

Machine Learning · Computer Science 2026-05-14 Sirui Zhang , Haonan Wang , Xunkai Li , Zekai Chen , Shumeng Li , Hongchao Qin , Rong-Hua Li , Guoren Wang

In the era of big data, data mining has become indispensable for uncovering hidden patterns and insights from vast and complex datasets. The integration of multimodal data sources further enhances its potential. Multimodal Federated…

Machine Learning · Computer Science 2025-08-22 Lishan Yang , Wei Emma Zhang , Quan Z. Sheng , Lina Yao , Weitong Chen , Ali Shakeri

Multimodal Federated Learning (MMFL) utilizes multiple modalities in each client to build a more powerful Federated Learning (FL) model than its unimodal counterpart. However, the impact of missing modality in different clients, also called…

Machine Learning · Computer Science 2024-02-09 Pramit Saha , Divyanshu Mishra , Felix Wagner , Konstantinos Kamnitsas , J. Alison Noble

Multimodal Federated Learning (MFL) lies at the intersection of two pivotal research areas: leveraging complementary information from multiple modalities to improve downstream inference performance and enabling distributed training to…

Machine Learning · Computer Science 2025-05-29 Yuanzhe Peng , Jieming Bian , Lei Wang , Yin Huang , Jie Xu

Federated learning (FL) underpins advancements in privacy-preserving distributed computing by collaboratively training neural networks without exposing clients' raw data. Current FL paradigms primarily focus on uni-modal data, while…

Machine Learning · Computer Science 2024-01-03 Yunfeng Fan , Wenchao Xu , Haozhao Wang , Jiaqi Zhu , Song Guo

Federated Learning (FL) is a distributed machine learning approach that enables devices to collaboratively train models without sharing their local data, ensuring user privacy and scalability. However, applying FL to real-world data…

Machine Learning · Computer Science 2024-08-14 Jieming Bian , Lei Wang , Jie Xu

Federated learning (FL) facilitates the secure utilization of decentralized images, advancing applications in medical image recognition and autonomous driving. However, conventional FL faces two critical challenges in real-world deployment:…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Shiwei Lu , Yuhang He , Jiashuo Li , Qiang Wang , Yihong Gong

Multimodal Federated Learning (MFL) has emerged as a promising approach for collaboratively training multimodal models across distributed clients, particularly in healthcare domains. In the context of brain imaging analysis, modality…

Image and Video Processing · Electrical Eng. & Systems 2025-02-19 Xinpeng Wang , Rong Zhou , Han Xie , Xiaoying Tang , Lifang He , Carl Yang

Federated learning (FL) offers a privacy-centric distributed learning framework, enabling model training on individual clients and central aggregation without necessitating data exchange. Nonetheless, FL implementations often suffer from…

Artificial Intelligence · Computer Science 2024-05-13 Rongyu Zhang , Yun Chen , Chenrui Wu , Fangxin Wang , Bo Li

Multimodal federated learning (MFL) aims to enrich model training in FL settings where clients are collecting measurements across multiple modalities. However, key challenges to MFL remain unaddressed, particularly in heterogeneous network…

Machine Learning · Computer Science 2026-03-12 Liangqi Yuan , Dong-Jun Han , Su Wang , Devesh Upadhyay , Christopher G. Brinton

Selecting proper clients to participate in each federated learning (FL) round is critical to effectively harness a broad range of distributed data. Existing client selection methods simply consider the mining of distributed uni-modal data,…

Machine Learning · Computer Science 2024-07-30 Yunfeng Fan , Wenchao Xu , Haozhao Wang , Fushuo Huo , Jinyu Chen , Song Guo

Multimodal federated learning (MFL) is a distributed framework for training multimodal models without uploading local multimodal data of clients, thereby effectively protecting client privacy. However, multimodal data is commonly…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-17 Xuefeng Han , Wen Chen , Jun Li , Ming Ding , Qingqing Wu , Kang Wei , Xiumei Deng , Yumeng Shao , Qiong Wu

Federated learning (FL) enables collaborative model training across decentralized medical institutions while preserving data privacy. However, medical FL benchmarks remain scarce, with existing efforts focusing mainly on unimodal or bimodal…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Aavash Chhetri , Bibek Niroula , Pratik Shrestha , Yash Raj Shrestha , Lesley A Anderson , Prashnna K Gyawali , Loris Bazzani , Binod Bhattarai

In real-world scenarios, multimodal federated learning often faces the practical challenge of intricate modality missing, which poses constraints on building federated frameworks and significantly degrades model inference accuracy. Existing…

Machine Learning · Computer Science 2024-02-06 Guangyin Bao , Qi Zhang , Duoqian Miao , Zixuan Gong , Liang Hu , Ke Liu , Yang Liu , Chongyang Shi

Federated Learning (FL) is a method for training machine learning models using distributed data sources. It ensures privacy by allowing clients to collaboratively learn a shared global model while storing their data locally. However, a…

Machine Learning · Computer Science 2025-11-11 Manh Duong Nguyen , Trung Thanh Nguyen , Huy Hieu Pham , Trong Nghia Hoang , Phi Le Nguyen , Thanh Trung Huynh

Federated learning has received significant attention for its ability to simultaneously protect customer privacy and leverage distributed data from multiple devices for model training. However, conventional approaches often focus on…

Machine Learning · Computer Science 2025-10-07 Jiahao Zeng , Wolong Xing , Liangtao Shi , Xin Huang , Jialin Wang , Zhile Cao , Zhenkui Shi

Federated learning shows promise as a privacy-preserving collaborative learning technique. Existing heterogeneous federated learning mainly focuses on skewing the label distribution across clients. However, most approaches suffer from…

Machine Learning · Computer Science 2023-12-18 Shunxin Guo , Hongsong Wang , Xin Geng
‹ Prev 1 2 3 10 Next ›