English
Related papers

Related papers: CAR-MFL: Cross-Modal Augmentation by Retrieval for…

200 papers

Developing AI tools that preserve fairness is of critical importance, specifically in high-stakes applications such as those in healthcare. However, health AI models' overall prediction performance is often prioritized over the possible…

Machine Learning · Computer Science 2023-05-22 Raphael Poulain , Mirza Farhan Bin Tarek , Rahmatollah Beheshti

This study focuses on the feature extraction problem in multi-modal data regression. To address three core challenges in real-world scenarios: limited and non-IID data, effective extraction and fusion of multi-modal information, and…

Machine Learning · Computer Science 2025-12-03 Haozhe Wu

Multi-modal transformers mark significant progress in different domains, but siloed high-quality data hinders their further improvement. To remedy this, federated learning (FL) has emerged as a promising privacy-preserving paradigm for…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Guangyu Sun , Matias Mendieta , Aritra Dutta , Xin Li , Chen Chen

The Internet of Things (IoT) ecosystem generates vast amounts of multimodal data from heterogeneous sources such as sensors, cameras, and microphones. As edge intelligence continues to evolve, IoT devices have progressed from simple data…

Machine Learning · Computer Science 2025-05-23 Heqiang Wang , Xiang Liu , Xiaoxiong Zhong , Lixing Chen , Fangming Liu , Weizhe Zhang

Many healthcare sensing applications utilize multimodal time-series data from sensors embedded in mobile and wearable devices. Federated Learning (FL), with its privacy-preserving advantages, is particularly well-suited for health…

Machine Learning · Computer Science 2024-11-28 Adiba Orzikulova , Jaehyun Kwak , Jaemin Shin , Sung-Ju Lee

Federated Learning (FL) has emerged as a prominent privacy-preserving technique for enabling use cases like confidential clinical machine learning. FL operates by aggregating models trained by remote devices which owns the data. Thus, FL…

Machine Learning · Computer Science 2024-04-23 Michael Duchesne , Kaiwen Zhang , Chamseddine Talhi

While multi-modal learning has been widely used for MRI reconstruction, it relies on paired multi-modal data which is difficult to acquire in real clinical scenarios. Especially in the federated setting, the common situation is that several…

Image and Video Processing · Electrical Eng. & Systems 2023-08-23 Yunlu Yan , Chun-Mei Feng , Yuexiang Li , Rick Siow Mong Goh , Lei Zhu

Artificial intelligence (AI) has demonstrated considerable potential in the realm of medical imaging. However, the development of high-performance AI models typically necessitates training on large-scale, centralized datasets. This approach…

Cryptography and Security · Computer Science 2025-08-29 Mengyu Sun , Ziyuan Yang , Yongqiang Huang , Hui Yu , Yingyu Chen , Shuren Qi , Andrew Beng Jin Teoh , Yi Zhang

One of the key challenges of collaborative machine learning, without data sharing, is multimodal data heterogeneity in real-world settings. While Federated Learning (FL) enables model training across multiple clients, existing frameworks,…

Machine Learning · Computer Science 2025-10-16 Alejandro Guerra-Manzanares , Omar El-Herraoui , Michail Maniatakos , Farah E. Shamout

Multimodal Federated Learning (MMFL) utilizes multiple modalities in each client to build a more powerful Federated Learning (FL) model than its unimodal counterpart. However, the impact of missing modality in different clients, also called…

Machine Learning · Computer Science 2024-02-09 Pramit Saha , Divyanshu Mishra , Felix Wagner , Konstantinos Kamnitsas , J. Alison Noble

Multimodal Federated Learning (MMFL) enables privacy-preserving collaborative training, but real-world clinical applications often suffer from within-modality missingness caused by sensor intermittency or irregular sampling. Existing…

Machine Learning · Computer Science 2026-04-28 Wugeng Zheng , Ziwen Kan , Katie Wang , Chen Chen , Song Wang

Federated Learning (FL) is a suitable solution for making use of sensitive data belonging to patients, people, companies, or industries that are obligatory to work under rigid privacy constraints. FL mainly or partially supports data…

Image and Video Processing · Electrical Eng. & Systems 2021-12-30 Alper Emin Cetinkaya , Murat Akin , Seref Sagiroglu

The development of federated learning (FL) methods, which aim to learn from distributed databases (i.e., clients) without accessing data on clients, has recently attracted great attention. Most of these methods assume that the clients are…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Barış Büyüktaş , Gencer Sumbul , Begüm Demir

In the evolving application of medical artificial intelligence, federated learning is notable for its ability to protect training data privacy. Federated learning facilitates collaborative model development without the need to share local…

Machine Learning · Computer Science 2024-07-02 Luyuan Xie , Manqing Lin , ChenMing Xu , Tianyu Luan , Zhipeng Zeng , Wenjun Qian , Cong Li , Yuejian Fang , Qingni Shen , Zhonghai Wu

Recent advances in communication technologies and Internet-of-Medical-Things have transformed smart healthcare enabled by artificial intelligence (AI). Traditionally, AI techniques require centralized data collection and processing that may…

Multimodal Federated Learning (MFL) enables clients with heterogeneous data modalities to collaboratively train models without sharing raw data, offering a privacy-preserving framework that leverages complementary cross-modal information.…

Machine Learning · Computer Science 2026-03-06 Min Tan , Junchao Ma , Yinfu Feng , Jiajun Ding , Wenwen Pan , Tingting Han , Qian Zheng , Zhenzhong Kuang , Zhou Yu

The use of machine learning (ML) for cancer staging through medical image analysis has gained substantial interest across medical disciplines. When accompanied by the innovative federated learning (FL) framework, ML techniques can further…

Machine Learning · Computer Science 2024-10-10 Kasra Borazjani , Naji Khosravan , Leslie Ying , Seyyedali Hosseinalipour

Multimodal federated learning (MFL) aims to enrich model training in FL settings where clients are collecting measurements across multiple modalities. However, key challenges to MFL remain unaddressed, particularly in heterogeneous network…

Machine Learning · Computer Science 2026-03-12 Liangqi Yuan , Dong-Jun Han , Su Wang , Devesh Upadhyay , Christopher G. Brinton

Multimodal federated learning in real-world settings often encounters incomplete and heterogeneous data across clients. This results in misaligned local feature representations that limit the effectiveness of model aggregation. Unlike prior…

Machine Learning · Computer Science 2025-10-28 Duong M. Nguyen , Trong Nghia Hoang , Thanh Trung Huynh , Quoc Viet Hung Nguyen , Phi Le Nguyen

Federated learning has emerged as a promising approach for training machine learning models on decentralized data sources while preserving data privacy. However, challenges such as communication bottlenecks, heterogeneity of client devices,…

Machine Learning · Computer Science 2023-12-27 Anna Vettoruzzo , Mohamed-Rafik Bouguelia , Thorsteinn Rögnvaldsson