中文
相关论文

相关论文: Multimodal Federated Learning with Missing Modalit…

200 篇论文

Federated learning allows for the training of machine learning models on multiple decentralized local datasets without requiring explicit data exchange. However, data pre-processing, including strategies for handling missing data, remains a…

Recently, foundation models have exhibited remarkable advancements in multi-modal learning. These models, equipped with millions (or billions) of parameters, typically require a substantial amount of data for finetuning. However, collecting…

机器学习 · 计算机科学 2023-08-25 Haokun Chen , Yao Zhang , Denis Krompass , Jindong Gu , Volker Tresp

The missing modality problem poses a fundamental challenge in multimodal sentiment analysis, significantly degrading model accuracy and generalization in real world scenarios. Existing approaches primarily improve robustness through prompt…

计算机视觉与模式识别 · 计算机科学 2026-04-08 Rongfei Chen , Tingting Zhang , Xiaoyu Shen , Wei Zhang

Federated Learning (FL) has emerged as a crucial distributed training paradigm, enabling discrete devices to collaboratively train a shared model under the coordination of a central server, while leveraging their locally stored private…

机器学习 · 计算机科学 2024-09-02 Wenhao Yuan , Xuehe Wang

The development of multimodal models has significantly advanced multimodal sentiment analysis and emotion recognition. However, in real-world applications, the presence of various missing modality cases often leads to a degradation in the…

计算与语言 · 计算机科学 2024-07-09 Zirun Guo , Tao Jin , Zhou Zhao

With the growing success of multi-modal learning, research on the robustness of multi-modal models, especially when facing situations with missing modalities, is receiving increased attention. Nevertheless, previous studies in this domain…

人工智能 · 计算机科学 2023-10-11 Siting Li , Chenzhuang Du , Yue Zhao , Yu Huang , Hang Zhao

Selecting proper clients to participate in each federated learning (FL) round is critical to effectively harness a broad range of distributed data. Existing client selection methods simply consider the mining of distributed uni-modal data,…

机器学习 · 计算机科学 2024-07-30 Yunfeng Fan , Wenchao Xu , Haozhao Wang , Fushuo Huo , Jinyu Chen , Song Guo

Meta federated learning (FL) is a personalized variant of FL, where multiple agents collaborate on training an initial shared model without exchanging raw data samples. The initial model should be trained in a way that current or new agents…

机器学习 · 计算机科学 2025-05-14 Mohammad Vahid Jamali , Hamid Saber , Jung Hyun Bae

Federated Learning is a machine learning paradigm where we aim to train machine learning models in a distributed fashion. Many clients/edge devices collaborate with each other to train a single model on the central. Clients do not share…

机器学习 · 计算机科学 2022-11-28 Mann Patel

Federated learning (FL) enables the collaborative training of deep neural networks across decentralized data archives (i.e., clients) without sharing the local data of the clients. Most of the existing FL methods assume that the data…

计算机视觉与模式识别 · 计算机科学 2025-03-14 Barış Büyüktaş , Gencer Sumbul , Begüm Demir

Federated learning encounters a critical challenge of data heterogeneity, adversely affecting the performance and convergence of the federated model. Various approaches have been proposed to address this issue, yet their effectiveness is…

机器学习 · 计算机科学 2023-12-06 Jinqian Chen , Jihua Zhu , Qinghai Zheng

Federated learning (FL) is a fast-developing technique that allows multiple workers to train a global model based on a distributed dataset. Conventional FL (FedAvg) employs gradient descent algorithm, which may not be efficient enough.…

机器学习 · 计算机科学 2022-10-27 Zhengjie Yang , Wei Bao , Dong Yuan , Nguyen H. Tran , Albert Y. Zomaya

Addressing intermittent client availability is critical for the real-world deployment of federated learning algorithms. Most prior work either overlooks the potential non-stationarity in the dynamics of client unavailability or requires…

分布式、并行与集群计算 · 计算机科学 2024-11-01 Ming Xiang , Stratis Ioannidis , Edmund Yeh , Carlee Joe-Wong , Lili Su

Federated Learning (FL) is a distributed learning paradigm that can learn a global or personalized model from decentralized datasets on edge devices. However, in the computer vision domain, model performance in FL is far behind centralized…

Federated learning is highly valued due to its high-performance computing in distributed environments while safeguarding data privacy. To address resource heterogeneity, researchers have proposed a semi-asynchronous federated learning…

分布式、并行与集群计算 · 计算机科学 2024-05-28 Yunbo Li , Jiaping Gui , Yue Wu

Federated Learning (FL) coordinates with numerous heterogeneous devices to collaboratively train a shared model while preserving user privacy. Despite its multiple advantages, FL faces new challenges. One challenge arises when devices drop…

机器学习 · 计算机科学 2021-06-09 Xinran Gu , Kaixuan Huang , Jingzhao Zhang , Longbo Huang

A common assumption in multimodal learning is the completeness of training data, i.e., full modalities are available in all training examples. Although there exists research endeavor in developing novel methods to tackle the incompleteness…

计算机视觉与模式识别 · 计算机科学 2021-03-11 Mengmeng Ma , Jian Ren , Long Zhao , Sergey Tulyakov , Cathy Wu , Xi Peng

Federated learning (FL) aims to train machine learning (ML) models across potentially millions of edge client devices. Yet, training and customizing models for FL clients is notoriously challenging due to the heterogeneity of client data,…

机器学习 · 计算机科学 2024-04-29 Yuxuan Zhu , Jiachen Liu , Mosharaf Chowdhury , Fan Lai

Most existing federated learning (FL) methods for medical image analysis only considered intramodal heterogeneity, limiting their applicability to multimodal imaging applications. In practice, some FL participants may possess only a subset…

计算机视觉与模式识别 · 计算机科学 2026-03-06 Hong Liu , Dong Wei , Qian Dai , Xian Wu , Yefeng Zheng , Liansheng Wang

Federated Learning (FL) has emerged as a decentralized machine learning technique, allowing clients to train a global model collaboratively without sharing private data. However, most FL studies ignore the crucial challenge of heterogeneous…

机器学习 · 计算机科学 2025-10-02 Huy Q. Le , Ye Lin Tun , Yu Qiao , Minh N. H. Nguyen , Keon Oh Kim , Eui-Nam Huh , Choong Seon Hong