中文
相关论文

相关论文: Multimodal Federated Learning With Missing Modalit…

200 篇论文

Federated Learning (FL) is a collaborative method for training models while preserving data privacy in decentralized settings. However, FL encounters challenges related to data heterogeneity, which can result in performance degradation. In…

机器学习 · 计算机科学 2023-11-23 Seongyoon Kim , Gihun Lee , Jaehoon Oh , Se-Young Yun

Multimodal deep learning, especially vision-language models, have gained significant traction in recent years, greatly improving performance on many downstream tasks, including content moderation and violence detection. However, standard…

计算机视觉与模式识别 · 计算机科学 2024-08-05 Zhuokai Zhao , Harish Palani , Tianyi Liu , Lena Evans , Ruth Toner

Automated blood morphology analysis can support hematological diagnostics in low- and middle-income countries (LMICs) but remains sensitive to dataset shifts from staining variability, imaging differences, and rare morphologies. Building…

机器学习 · 计算机科学 2026-01-08 Gabriel Ansah , Eden Ruffell , Delmiro Fernandez-Reyes , Petru Manescu

Federated learning (FL) based magnetic resonance (MR) image reconstruction can facilitate learning valuable priors from multi-site institutions without violating patient's privacy for accelerating MR imaging. However, existing methods rely…

图像与视频处理 · 电气工程与系统科学 2023-05-11 Juan Zou , Cheng Li , Ruoyou Wu , Tingrui Pei , Hairong Zheng , Shanshan Wang

Multi-modal medical imaging enables comprehensive diagnostics, yet current foundation models process 2D (e.g. X-ray) and 3D (e.g. CT) data with separate, dimensionality-specific architectures. We present MultiMedVision, a unified framework…

计算机视觉与模式识别 · 计算机科学 2026-05-12 Frank Li , Bardia Khosravi , Mohammadreza Chavoshi , Young Seok Jeon , Theo Dapamede , Hari Trivedi , Janice Newsome , Judy Gichoya

Federated learning (FL) enables collaborative model training across distributed devices without sharing raw data, but applying FL to multi-modal settings introduces significant challenges. Clients typically possess heterogeneous modalities…

机器学习 · 计算机科学 2026-03-20 Mohamed Badi , Chaouki Ben Issaid , Mehdi Bennis

Federated learning is a decentralized training approach that keeps data under stakeholder control while achieving superior performance over isolated training. While inter-institutional feature discrepancies pose a challenge in all federated…

图像与视频处理 · 电气工程与系统科学 2025-07-01 Vasilis Siomos , Jonathan Passerat-Palmbach , Giacomo Tarroni

Recent advancements in multimodal machine learning have empowered the development of accurate and robust AI systems in the medical domain, especially within centralized database systems. Simultaneously, Federated Learning (FL) has…

Widely available healthcare services are now getting popular because of advancements in wearable sensing techniques and mobile edge computing. People's health information is collected by edge devices such as smartphones and wearable bands…

机器学习 · 计算机科学 2023-10-31 Wenhao Yan , He Li , Kaoru Ota , Mianxiong Dong

Multimodal pathological images are usually in clinical diagnosis, but computer vision-based multimodal image-assisted diagnosis faces challenges with modality fusion, especially in the absence of expert-annotated data. To achieve the…

计算机视觉与模式识别 · 计算机科学 2025-09-24 Qinghua Lin , Guang-Hai Liu , Zuoyong Li , Yang Li , Yuting Jiang , Xiang Wu

Federated learning is a distributed machine learning approach in which clients train models locally with their own data and upload them to a server so that their trained results are shared between them without uploading raw data to the…

机器学习 · 计算机科学 2023-09-07 Yuto Hoshino , Hiroki Kawakami , Hiroki Matsutani

Federated learning enables joint training of machine learning models from distributed clients without sharing their local data. One key challenge in federated learning is to handle non-identically distributed data across the clients, which…

机器学习 · 计算机科学 2023-12-25 Tiejin Chen , Yuanpu Cao , Yujia Wang , Cho-Jui Hsieh , Jinghui Chen

Multimodal learning leverages the integration of diverse data modalities to enhance performance in complex tasks. Yet, it frequently encounters incomplete or redundant modality data in real-world scenarios. This paper presents a…

机器学习 · 计算机科学 2026-05-05 Richeng Zhou , Xuelin Zhang , Liyuan Liu

While federated learning (FL) enables fine-tuning of large language models (LLMs) without compromising data privacy, the substantial size of an LLM renders on-device training impractical for resource-constrained clients, such as mobile…

机器学习 · 计算机科学 2026-01-05 Zihan Fang , Zheng Lin , Senkang Hu , Yanan Ma , Yihang Tao , Yiqin Deng , Xianhao Chen , Yuguang Fang

Federated Foundation Models (FedFMs) represent a distributed learning paradigm that fuses general competences of foundation models as well as privacy-preserving capabilities of federated learning. This combination allows the large…

Federated learning (FL) offers a privacy-centric distributed learning framework, enabling model training on individual clients and central aggregation without necessitating data exchange. Nonetheless, FL implementations often suffer from…

人工智能 · 计算机科学 2024-05-13 Rongyu Zhang , Yun Chen , Chenrui Wu , Fangxin Wang , Bo Li

Selecting proper clients to participate in each federated learning (FL) round is critical to effectively harness a broad range of distributed data. Existing client selection methods simply consider the mining of distributed uni-modal data,…

机器学习 · 计算机科学 2024-07-30 Yunfeng Fan , Wenchao Xu , Haozhao Wang , Fushuo Huo , Jinyu Chen , Song Guo

Federated Learning (FL) has emerged as a prominent privacy-preserving technique for enabling use cases like confidential clinical machine learning. FL operates by aggregating models trained by remote devices which owns the data. Thus, FL…

机器学习 · 计算机科学 2024-04-23 Michael Duchesne , Kaiwen Zhang , Chamseddine Talhi

The development of federated learning (FL) methods, which aim to learn from distributed databases (i.e., clients) without accessing data on clients, has recently attracted great attention. Most of these methods assume that the clients are…

计算机视觉与模式识别 · 计算机科学 2023-06-02 Barış Büyüktaş , Gencer Sumbul , Begüm Demir

The combination of electronic health records (EHR) and medical images is crucial for clinicians in making diagnoses and forecasting prognosis. Strategically fusing these two data modalities has great potential to improve the accuracy of…

图像与视频处理 · 电气工程与系统科学 2024-10-24 Wenfang Yao , Kejing Yin , William K. Cheung , Jia Liu , Jing Qin