中文
相关论文

相关论文: Multimodal Federated Learning with Missing Modalit…

200 篇论文

With the increasing amount of multimedia data on modern mobile systems and IoT infrastructures, harnessing these rich multimodal data without breaching user privacy becomes a critical issue. Federated learning (FL) serves as a…

机器学习 · 计算机科学 2023-05-09 Qiying Yu , Yang Liu , Yimu Wang , Ke Xu , Jingjing Liu

As a promising distributed machine learning paradigm, Federated Learning (FL) has attracted increasing attention to deal with data silo problems without compromising user privacy. By adopting the classic one-to-multi training scheme (i.e.,…

机器学习 · 计算机科学 2024-07-08 Ming Hu , Peiheng Zhou , Zhihao Yue , Zhiwei Ling , Yihao Huang , Anran Li , Yang Liu , Xiang Lian , Mingsong Chen

Federated learning (FL) is a training technique that enables client devices to jointly learn a shared model by aggregating locally-computed models without exposing their raw data. While most of the existing work focuses on improving the FL…

机器学习 · 计算机科学 2022-01-11 Sai Qian Zhang , Jieyu Lin , Qi Zhang

During multimodal model training and testing, certain data modalities may be absent due to sensor limitations, cost constraints, privacy concerns, or data loss, negatively affecting performance. Multimodal learning techniques designed to…

计算机视觉与模式识别 · 计算机科学 2026-02-05 Renjie Wu , Hu Wang , Hsiang-Ting Chen , Gustavo Carneiro

Multimodal models often experience a significant performance drop when one or more modalities are missing during inference. To address this challenge, we propose a simple yet effective approach that enhances robustness to missing modalities…

计算机视觉与模式识别 · 计算机科学 2025-10-28 Md Kaykobad Reza , Ameya Patil , Mashhour Solh , M. Salman Asif

Federated learning has emerged as a promising approach for training machine learning models on decentralized data sources while preserving data privacy. However, challenges such as communication bottlenecks, heterogeneity of client devices,…

机器学习 · 计算机科学 2023-12-27 Anna Vettoruzzo , Mohamed-Rafik Bouguelia , Thorsteinn Rögnvaldsson

Recently, the ever-growing demand for privacy-oriented machine learning has motivated researchers to develop federated and decentralized learning techniques, allowing individual clients to train models collaboratively without disclosing…

机器学习 · 计算机科学 2021-07-15 David Roschewitz , Mary-Anne Hartley , Luca Corinzia , Martin Jaggi

In traditional Federated Learning approaches like FedAvg, the global model underperforms when faced with data heterogeneity. Personalized Federated Learning (PFL) enables clients to train personalized models to fit their local data…

机器学习 · 计算机科学 2024-07-24 Xinghao Wu , Jianwei Niu , Xuefeng Liu , Mingjia Shi , Guogang Zhu , Shaojie Tang

Fusing multi-modal data can improve the performance of deep learning models. However, missing modalities are common for medical data due to patients' specificity, which is detrimental to the performance of multi-modal models in…

图像与视频处理 · 电气工程与系统科学 2023-09-28 Muyu Wang , Shiyu Fan , Yichen Li , Hui Chen

Federated Learning (FL) holds great potential for diverse applications owing to its privacy-preserving nature. However, its convergence is often challenged by non-IID data distributions, limiting its effectiveness in real-world deployments.…

机器学习 · 计算机科学 2025-04-22 Kun Zhai , Yifeng Gao , Difan Zou , Guangnan Ye , Siheng Chen , Xingjun Ma , Yu-Gang Jiang

This paper investigates federated multimodal learning (FML) assisted by unmanned aerial vehicles (UAVs) with a focus on minimizing system latency and providing convergence analysis. In this framework, UAVs are distributed throughout the…

机器学习 · 计算机科学 2025-10-03 Shaba Shaon , Dinh C. Nguyen

Federated learning is a distributed machine learning approach in which a single server and multiple clients collaboratively build machine learning models without sharing datasets on clients. A challenging issue of federated learning is data…

机器学习 · 计算机科学 2022-06-28 Koji Matsuda , Yuya Sasaki , Chuan Xiao , Makoto Onizuka

Multimodal learning has demonstrated remarkable performance improvements over unimodal architectures. However, multimodal learning methods often exhibit deteriorated performances if one or more modalities are missing. This may be attributed…

The federated learning (FL) framework enables edge clients to collaboratively learn a shared inference model while keeping privacy of training data on clients. Recently, many heuristics efforts have been made to generalize centralized…

机器学习 · 计算机科学 2022-07-18 Jiayin Jin , Jiaxiang Ren , Yang Zhou , Lingjuan Lyu , Ji Liu , Dejing Dou

Existing approaches in Federated Learning (FL) mainly focus on sending model parameters or gradients from clients to a server. However, these methods are plagued by significant inefficiency, privacy, and security concerns. Thanks to the…

机器学习 · 计算机科学 2024-06-04 Jie Zhang , Xiaohua Qi , Bo Zhao

Petabytes of data are generated each day by emerging Internet of Things (IoT), but only few of them can be finally collected and used for Machine Learning (ML) purposes due to the apprehension of data & privacy leakage, which seriously…

机器学习 · 计算机科学 2021-06-17 Yuhao Zhou , Ye Qing , Jiancheng Lv

Missing modality issues are common in real-world applications, arising from factors such as equipment failures and privacy concerns. When fine-tuning pre-trained models on downstream datasets with missing modalities, performance can degrade…

机器学习 · 计算机科学 2025-03-04 Zirun Guo , Shulei Wang , Wang Lin , Weicai Yan , Yangyang Wu , Tao Jin

Federated Learning (FL) is a distributed machine learning approach that enables devices to collaboratively train models without sharing their local data, ensuring user privacy and scalability. However, applying FL to real-world data…

机器学习 · 计算机科学 2024-08-14 Jieming Bian , Lei Wang , Jie Xu

The development of federated learning (FL) methods, which aim to learn from distributed databases (i.e., clients) without accessing data on clients, has recently attracted great attention. Most of these methods assume that the clients are…

计算机视觉与模式识别 · 计算机科学 2023-06-02 Barış Büyüktaş , Gencer Sumbul , Begüm Demir

Federated Learning (FL) enables decentralized model training across multiple clients without exposing private data, making it ideal for privacy-sensitive applications. However, in real-world FL scenarios, clients often hold data from…

计算机视觉与模式识别 · 计算机科学 2026-04-09 Huy Q. Le , Loc X. Nguyen , Yu Qiao , Seong Tae Kim , Eui-Nam Huh , Choong Seon Hong