English
Related papers

Related papers: Multimodal Federated Learning with Missing Modalit…

200 papers

With the increasing amount of multimedia data on modern mobile systems and IoT infrastructures, harnessing these rich multimodal data without breaching user privacy becomes a critical issue. Federated learning (FL) serves as a…

Machine Learning · Computer Science 2023-05-09 Qiying Yu , Yang Liu , Yimu Wang , Ke Xu , Jingjing Liu

As a promising distributed machine learning paradigm, Federated Learning (FL) has attracted increasing attention to deal with data silo problems without compromising user privacy. By adopting the classic one-to-multi training scheme (i.e.,…

Machine Learning · Computer Science 2024-07-08 Ming Hu , Peiheng Zhou , Zhihao Yue , Zhiwei Ling , Yihao Huang , Anran Li , Yang Liu , Xiang Lian , Mingsong Chen

Federated learning (FL) is a training technique that enables client devices to jointly learn a shared model by aggregating locally-computed models without exposing their raw data. While most of the existing work focuses on improving the FL…

Machine Learning · Computer Science 2022-01-11 Sai Qian Zhang , Jieyu Lin , Qi Zhang

During multimodal model training and testing, certain data modalities may be absent due to sensor limitations, cost constraints, privacy concerns, or data loss, negatively affecting performance. Multimodal learning techniques designed to…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Renjie Wu , Hu Wang , Hsiang-Ting Chen , Gustavo Carneiro

Multimodal models often experience a significant performance drop when one or more modalities are missing during inference. To address this challenge, we propose a simple yet effective approach that enhances robustness to missing modalities…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Md Kaykobad Reza , Ameya Patil , Mashhour Solh , M. Salman Asif

Federated learning has emerged as a promising approach for training machine learning models on decentralized data sources while preserving data privacy. However, challenges such as communication bottlenecks, heterogeneity of client devices,…

Machine Learning · Computer Science 2023-12-27 Anna Vettoruzzo , Mohamed-Rafik Bouguelia , Thorsteinn Rögnvaldsson

Recently, the ever-growing demand for privacy-oriented machine learning has motivated researchers to develop federated and decentralized learning techniques, allowing individual clients to train models collaboratively without disclosing…

Machine Learning · Computer Science 2021-07-15 David Roschewitz , Mary-Anne Hartley , Luca Corinzia , Martin Jaggi

In traditional Federated Learning approaches like FedAvg, the global model underperforms when faced with data heterogeneity. Personalized Federated Learning (PFL) enables clients to train personalized models to fit their local data…

Machine Learning · Computer Science 2024-07-24 Xinghao Wu , Jianwei Niu , Xuefeng Liu , Mingjia Shi , Guogang Zhu , Shaojie Tang

Fusing multi-modal data can improve the performance of deep learning models. However, missing modalities are common for medical data due to patients' specificity, which is detrimental to the performance of multi-modal models in…

Image and Video Processing · Electrical Eng. & Systems 2023-09-28 Muyu Wang , Shiyu Fan , Yichen Li , Hui Chen

Federated Learning (FL) holds great potential for diverse applications owing to its privacy-preserving nature. However, its convergence is often challenged by non-IID data distributions, limiting its effectiveness in real-world deployments.…

Machine Learning · Computer Science 2025-04-22 Kun Zhai , Yifeng Gao , Difan Zou , Guangnan Ye , Siheng Chen , Xingjun Ma , Yu-Gang Jiang

This paper investigates federated multimodal learning (FML) assisted by unmanned aerial vehicles (UAVs) with a focus on minimizing system latency and providing convergence analysis. In this framework, UAVs are distributed throughout the…

Machine Learning · Computer Science 2025-10-03 Shaba Shaon , Dinh C. Nguyen

Federated learning is a distributed machine learning approach in which a single server and multiple clients collaboratively build machine learning models without sharing datasets on clients. A challenging issue of federated learning is data…

Machine Learning · Computer Science 2022-06-28 Koji Matsuda , Yuya Sasaki , Chuan Xiao , Makoto Onizuka

Multimodal learning has demonstrated remarkable performance improvements over unimodal architectures. However, multimodal learning methods often exhibit deteriorated performances if one or more modalities are missing. This may be attributed…

The federated learning (FL) framework enables edge clients to collaboratively learn a shared inference model while keeping privacy of training data on clients. Recently, many heuristics efforts have been made to generalize centralized…

Machine Learning · Computer Science 2022-07-18 Jiayin Jin , Jiaxiang Ren , Yang Zhou , Lingjuan Lyu , Ji Liu , Dejing Dou

Existing approaches in Federated Learning (FL) mainly focus on sending model parameters or gradients from clients to a server. However, these methods are plagued by significant inefficiency, privacy, and security concerns. Thanks to the…

Machine Learning · Computer Science 2024-06-04 Jie Zhang , Xiaohua Qi , Bo Zhao

Petabytes of data are generated each day by emerging Internet of Things (IoT), but only few of them can be finally collected and used for Machine Learning (ML) purposes due to the apprehension of data & privacy leakage, which seriously…

Machine Learning · Computer Science 2021-06-17 Yuhao Zhou , Ye Qing , Jiancheng Lv

Missing modality issues are common in real-world applications, arising from factors such as equipment failures and privacy concerns. When fine-tuning pre-trained models on downstream datasets with missing modalities, performance can degrade…

Machine Learning · Computer Science 2025-03-04 Zirun Guo , Shulei Wang , Wang Lin , Weicai Yan , Yangyang Wu , Tao Jin

Federated Learning (FL) is a distributed machine learning approach that enables devices to collaboratively train models without sharing their local data, ensuring user privacy and scalability. However, applying FL to real-world data…

Machine Learning · Computer Science 2024-08-14 Jieming Bian , Lei Wang , Jie Xu

The development of federated learning (FL) methods, which aim to learn from distributed databases (i.e., clients) without accessing data on clients, has recently attracted great attention. Most of these methods assume that the clients are…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Barış Büyüktaş , Gencer Sumbul , Begüm Demir

Federated Learning (FL) enables decentralized model training across multiple clients without exposing private data, making it ideal for privacy-sensitive applications. However, in real-world FL scenarios, clients often hold data from…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Huy Q. Le , Loc X. Nguyen , Yu Qiao , Seong Tae Kim , Eui-Nam Huh , Choong Seon Hong
‹ Prev 1 3 4 5 6 7 10 Next ›