English
Related papers

Related papers: ClusMFL: A Cluster-Enhanced Framework for Modality…

200 papers

With the increasing amount of multimedia data on modern mobile systems and IoT infrastructures, harnessing these rich multimodal data without breaching user privacy becomes a critical issue. Federated learning (FL) serves as a…

Machine Learning · Computer Science 2023-05-09 Qiying Yu , Yang Liu , Yimu Wang , Ke Xu , Jingjing Liu

Leveraging multimodal information from Magnetic Resonance Imaging (MRI) plays a vital role in lesion segmentation, especially for brain tumors. However, in clinical practice, multimodal MRI data are often incomplete, making it challenging…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Yulong Zou , Bo Liu , Cun-Jing Zheng , Yuan-ming Geng , Siyue Li , Qiankun Zuo , Shuihua Wang , Yudong Zhang , Jin Hong

The Internet of Things (IoT) ecosystem generates vast amounts of multimodal data from heterogeneous sources such as sensors, cameras, and microphones. As edge intelligence continues to evolve, IoT devices have progressed from simple data…

Machine Learning · Computer Science 2025-05-23 Heqiang Wang , Xiang Liu , Xiaoxiong Zhong , Lixing Chen , Fangming Liu , Weizhe Zhang

Under the organization of the base station (BS), wireless federated learning (FL) enables collaborative model training among multiple devices. However, the BS is merely responsible for aggregating local updates during the training process,…

Information Theory · Computer Science 2023-10-05 Jingheng Zheng , Wanli Ni , Hui Tian , Deniz Gunduz , Tony Q. S. Quek , Zhu Han

Most existing federated learning (FL) methods for medical image analysis only considered intramodal heterogeneity, limiting their applicability to multimodal imaging applications. In practice, some FL participants may possess only a subset…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Hong Liu , Dong Wei , Qian Dai , Xian Wu , Yefeng Zheng , Liansheng Wang

Multimodal Federated Learning (MMFL) enables privacy-preserving collaborative training, but real-world clinical applications often suffer from within-modality missingness caused by sensor intermittency or irregular sampling. Existing…

Machine Learning · Computer Science 2026-04-28 Wugeng Zheng , Ziwen Kan , Katie Wang , Chen Chen , Song Wang

Instance-level image retrieval in fashion is a challenging issue owing to its increasing importance in real-scenario visual fashion search. Cross-domain fashion retrieval aims to match the unconstrained customer images as queries for…

Computer Vision and Pattern Recognition · Computer Science 2022-10-28 Chen Bao , Xudong Zhang , Jiazhou Chen , Yongwei Miao

Incomplete multi-view unsupervised feature selection (IMUFS), which aims to identify representative features from unlabeled multi-view data containing missing values, has received growing attention in recent years. Despite their promising…

Machine Learning · Computer Science 2025-11-18 Zongxin Shen , Yanyong Huang , Dongjie Wang , Jinyuan Chang , Fengmao Lv , Tianrui Li , Xiaoyi Jiang

Multimodal federated learning (MFL) is a distributed framework for training multimodal models without uploading local multimodal data of clients, thereby effectively protecting client privacy. However, multimodal data is commonly…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-17 Xuefeng Han , Wen Chen , Jun Li , Ming Ding , Qingqing Wu , Kang Wei , Xiumei Deng , Yumeng Shao , Qiong Wu

Multimodal Federated Learning (MFL) lies at the intersection of two pivotal research areas: leveraging complementary information from multiple modalities to improve downstream inference performance and enabling distributed training to…

Machine Learning · Computer Science 2025-05-29 Yuanzhe Peng , Jieming Bian , Lei Wang , Yin Huang , Jie Xu

This study investigates clustered federated learning (FL), one of the formulations of FL with non-i.i.d. data, where the devices are partitioned into clusters and each cluster optimally fits its data with a localized model. We propose a…

Machine Learning · Computer Science 2023-12-27 Xue Yu , Ziyi Liu , Wu Wang , Yifan Sun

Multimodal federated learning (FL) aims to enrich model training in FL settings where devices are collecting measurements across multiple modalities (e.g., sensors measuring pressure, motion, and other types of data). However, key…

Machine Learning · Computer Science 2024-08-21 Liangqi Yuan , Dong-Jun Han , Vishnu Pandi Chellapandi , Stanislaw H. Żak , Christopher G. Brinton

Artificial intelligence has transformed the perspective of medical imaging, leading to a genuine technological revolution in modern computer-assisted healthcare systems. However, ubiquitously featured deep learning (DL) systems require…

Image and Video Processing · Electrical Eng. & Systems 2026-01-09 Dominika Ciupek , Maciej Malawski , Tomasz Pieciak

Clustered Federated Learning (CFL) improves performance under non-IID client heterogeneity by clustering clients and training one model per cluster, thereby balancing between a global model and fully personalized models. However, most CFL…

Machine Learning · Computer Science 2026-01-30 Mariona Jaramillo-Civill , Peng Wu , Pau Closas

Recent advancements in multimodal machine learning have empowered the development of accurate and robust AI systems in the medical domain, especially within centralized database systems. Simultaneously, Federated Learning (FL) has…

Multimodal clinical prediction faces three challenges: multiple foundation models (FMs) with complementary strengths per modality, pervasive missing modalities at training and test time, and sample-specific variation in modality…

Machine Learning · Computer Science 2026-05-19 Seungik Cho , Anqi Li , Wei Qiu

Federated Learning (FL) enables collaborative model training across distributed clients without sharing raw data, yet its performance deteriorates under statistical heterogeneity. Clustered Federated Learning addresses this challenge by…

Machine Learning · Computer Science 2026-05-01 Mahad Ali , Laura J. Brattain

In the ever-changing world of technology, continuous authentication and comprehensive access management are essential during user interactions with a device. Split Learning (SL) and Federated Learning (FL) have recently emerged as promising…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Mohamad Wazzeh , Mohamad Arafeh , Hani Sami , Hakima Ould-Slimane , Chamseddine Talhi , Azzam Mourad , Hadi Otrok

Clustered federated learning (CFL) addresses the performance challenges posed by data heterogeneity in federated learning (FL) by organizing edge devices with similar data distributions into clusters, enabling collaborative model training…

Machine Learning · Computer Science 2025-01-06 Yuxin Zhang , Haoyu Chen , Zheng Lin , Zhe Chen , Jin Zhao

Multimodal Federated Learning (MFL) with mixed modalities enables unimodal and multimodal clients to collaboratively train models while ensuring clients' privacy. As a representative sample of local data, prototypes offer an approach with…

Machine Learning · Computer Science 2025-08-05 Keke Gai , Mohan Wang , Jing Yu , Dongjue Wang , Qi Wu