English
Related papers

Related papers: ClusMFL: A Cluster-Enhanced Framework for Modality…

200 papers

Federated learning (FL) offers a privacy-centric distributed learning framework, enabling model training on individual clients and central aggregation without necessitating data exchange. Nonetheless, FL implementations often suffer from…

Artificial Intelligence · Computer Science 2024-05-13 Rongyu Zhang , Yun Chen , Chenrui Wu , Fangxin Wang , Bo Li

In this paper, we propose SimMLM, a simple yet powerful framework for multimodal learning with missing modalities. Unlike existing approaches that rely on sophisticated network architectures or complex data imputation techniques, SimMLM…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Sijie Li , Chen Chen , Jungong Han

Recent advancements in the acquisition of various brain data sources have created new opportunities for integrating multimodal brain data to assist in early detection of complex brain disorders. However, current data integration approaches…

Image and Video Processing · Electrical Eng. & Systems 2023-05-26 Reza Shirkavand , Liang Zhan , Heng Huang , Li Shen , Paul M. Thompson

Multimodal MRIs play a crucial role in clinical diagnosis and treatment. Feature disentanglement (FD)-based methods, aiming at learning superior feature representations for multimodal data analysis, have achieved significant success in…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Tianling Liu , Hongying Liu , Fanhua Shang , Lequan Yu , Tong Han , Liang Wan

Federated Learning (FL) is a decentralized paradigm that enables a client-server architecture to collaboratively train a global Artificial Intelligence model without sharing raw data, thereby preserving privacy. A key challenge in FL is…

Machine Learning · Computer Science 2025-10-07 Michael Ben Ali , Imen Megdiche , André Peninou , Olivier Teste

While multi-modal learning has been widely used for MRI reconstruction, it relies on paired multi-modal data which is difficult to acquire in real clinical scenarios. Especially in the federated setting, the common situation is that several…

Image and Video Processing · Electrical Eng. & Systems 2023-08-23 Yunlu Yan , Chun-Mei Feng , Yuexiang Li , Rick Siow Mong Goh , Lei Zhu

A common assumption in multimodal learning is the completeness of training data, i.e., full modalities are available in all training examples. Although there exists research endeavor in developing novel methods to tackle the incompleteness…

Computer Vision and Pattern Recognition · Computer Science 2021-03-11 Mengmeng Ma , Jian Ren , Long Zhao , Sergey Tulyakov , Cathy Wu , Xi Peng

Federated learning enables multiple hospitals to cooperatively learn a shared model without privacy disclosure. Existing methods often take a common assumption that the data from different hospitals have the same modalities. However, such a…

Image and Video Processing · Electrical Eng. & Systems 2023-06-06 Yunlu Yan , Hong Wang , Yawen Huang , Nanjun He , Lei Zhu , Yuexiang Li , Yong Xu , Yefeng Zheng

Skeleton-based action recognition has garnered significant attention due to the utilization of concise and resilient skeletons. Nevertheless, the absence of detailed body information in skeletons restricts performance, while other…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Jinfu Liu , Chen Chen , Mengyuan Liu

This study focuses on the feature extraction problem in multi-modal data regression. To address three core challenges in real-world scenarios: limited and non-IID data, effective extraction and fusion of multi-modal information, and…

Machine Learning · Computer Science 2025-12-03 Haozhe Wu

Multimodal federated learning holds immense potential for collaboratively training models from multiple sources without sharing raw data, addressing both data scarcity and privacy concerns, two key challenges in healthcare. A major…

Machine Learning · Computer Science 2025-05-27 Pranav Poudel , Aavash Chhetri , Prashnna Gyawali , Georgios Leontidis , Binod Bhattarai

Federated learning (FL) is a decentralized method enabling hospitals to collaboratively learn a model without sharing private patient data for training. In FL, participant hospitals periodically exchange training results rather than…

Cryptography and Security · Computer Science 2022-08-24 S. Maryam Hosseini , Milad Sikaroudi , Morteza Babaei , H. R. Tizhoosh

We present a novel approach in the domain of federated learning (FL), particularly focusing on addressing the challenges posed by modality heterogeneity, variability in modality availability across clients, and the prevalent issue of…

Machine Learning · Computer Science 2023-12-19 Minh Tran , Roochi Shah , Zejun Gong

The use of machine learning (ML) for cancer staging through medical image analysis has gained substantial interest across medical disciplines. When accompanied by the innovative federated learning (FL) framework, ML techniques can further…

Machine Learning · Computer Science 2024-10-10 Kasra Borazjani , Naji Khosravan , Leslie Ying , Seyyedali Hosseinalipour

Federated learning (FL) has emerged as a key paradigm for collaborative model training across multiple clients without sharing raw data, enabling privacy-preserving applications in areas such as radiology and pathology. However, works on…

Machine Learning · Computer Science 2025-10-31 Furkan Pala , Islem Rekik

Federated Learning (FL) is an evolving distributed machine learning approach that safeguards client privacy by keeping data on edge devices. However, the variation in data among clients poses challenges in training models that excel across…

Machine Learning · Computer Science 2025-03-04 Yongxin Guo , Xiaoying Tang , Tao Lin

Multimodal Federated Learning (MFL) enables clients with heterogeneous data modalities to collaboratively train models without sharing raw data, offering a privacy-preserving framework that leverages complementary cross-modal information.…

Machine Learning · Computer Science 2026-03-06 Min Tan , Junchao Ma , Yinfu Feng , Jiajun Ding , Wenwen Pan , Tingting Han , Qian Zheng , Zhenzhong Kuang , Zhou Yu

Dynamic functional connectivity (dFC) derived from resting-state functional magnetic resonance imaging (fMRI) has been extensively utilized in brain science research. The sliding window correlation (SWC) method is a widely used approach for…

Neurons and Cognition · Quantitative Biology 2026-03-27 Jinlong Hu , Jiatong Huang , Zijian Cai

Multi-Model Federated Learning (MMFL) is an emerging direction in Federated Learning (FL) where multiple models are trained in parallel, generally on various datasets. Optimizing the models' accuracies and training times in the MMFL setting…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-14 Shouxu Lin , Zimeng Pan , Yuhang Yao , Haeyoung Noh , Pei Zhang , Carlee Joe-Wong

Brain lesion segmentation from multi-modal MRI often assumes fixed modality sets or predefined pathologies, making existing models difficult to adapt across cohorts and imaging protocols. Continual learning (CL) offers a natural solution…

Image and Video Processing · Electrical Eng. & Systems 2026-01-21 Yousef Sadegheih , Dorit Merhof , Pratibha Kumari