English
Related papers

Related papers: Federated Pseudo Modality Generation for Incomplet…

200 papers

Multimodal learning has shown significant performance boost compared to ordinary unimodal models across various domains. However, in real-world scenarios, multimodal signals are susceptible to missing because of sensor failures and adverse…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Nhi Kieu , Kien Nguyen , Arnold Wiliem , Clinton Fookes , Sridha Sridharan

Segmentation models for brain lesions in MRI are typically developed for a specific disease and trained on data with a predefined set of MRI modalities. Such models cannot segment the disease using data with a different set of MRI…

Image and Video Processing · Electrical Eng. & Systems 2024-11-20 Felix Wagner , Wentian Xu , Pramit Saha , Ziyun Liang , Daniel Whitehouse , David Menon , Virginia Newcombe , Natalie Voets , J. Alison Noble , Konstantinos Kamnitsas

Federated learning is proposed as an alternative to centralized machine learning since its client-server structure provides better privacy protection and scalability in real-world applications. In many applications, such as smart homes with…

Machine Learning · Computer Science 2022-02-21 Yuchen Zhao , Payam Barnaghi , Hamed Haddadi

Multimodal MRI provides critical complementary information for accurate brain tumor segmentation. However, conventional methods struggle when certain modalities are missing due to issues such as image quality, protocol inconsistencies,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-03 Runze Cheng , Xihang Qiu , Ming Li , Ye Zhang , Chun Li , Fei Yu

Multimodal learning faces a fundamental tension between deep, fine-grained fusion and computational scalability. While cross-attention models achieve strong performance through exhaustive pairwise fusion, their quadratic complexity is…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Yusuf Shihata

Brain MRI scans are often found in four modalities, consisting of T1-weighted with and without contrast enhancement (T1ce and T1w), T2-weighted imaging (T2w), and Flair. Leveraging complementary information from these different modalities…

Image and Video Processing · Electrical Eng. & Systems 2025-09-22 Bhavesh Sandbhor , Bheeshm Sharma , Balamurugan Palaniappan

Multimodal magnetic resonance imaging (MRI) provides complementary information for sub-region analysis of brain tumors. Plenty of methods have been proposed for automatic brain tumor segmentation using four common MRI modalities and…

Image and Video Processing · Electrical Eng. & Systems 2023-03-10 Hong Liu , Dong Wei , Donghuan Lu , Jinghan Sun , Liansheng Wang , Yefeng Zheng

In multi-contrast magnetic resonance imaging (MRI), compressed sensing theory can accelerate imaging by sampling fewer measurements within each contrast. The conventional optimization-based models suffer several limitations: strict…

Computer Vision and Pattern Recognition · Computer Science 2019-10-02 Liyan Sun , Zhiwen Fan , Yue Huang , Xinghao Ding , John Paisley

Multisequence Magnetic Resonance Imaging (MRI) provides a more reliable diagnosis in clinical applications through complementary information across sequences. However, in practice, the absence of certain MR sequences is a common problem…

Image and Video Processing · Electrical Eng. & Systems 2025-10-21 Jihoon Cho , Jonghye Woo , Jinah Park

Multi-modal MRIs are widely used in neuroimaging applications since different MR sequences provide complementary information about brain structures. Recent works have suggested that multi-modal deep learning analysis can benefit from…

Computer Vision and Pattern Recognition · Computer Science 2021-06-14 Jiahong Ouyang , Ehsan Adeli , Kilian M. Pohl , Qingyu Zhao , Greg Zaharchuk

Multimodal sentiment analysis in federated learning environments faces significant challenges due to missing modalities, heterogeneous data distributions, and unreliable client updates. Existing federated approaches often struggle to…

Machine Learning · Computer Science 2026-03-17 Xianxun Zhu , Zezhong Sun , Imad Rida , Erik Cambria , Junqi Su , Rui Wang , Hui Chen

The rapid evolution of Multimodal Large Language Models (MLLMs) is bottlenecked by the saturation of high-quality public data, while vast amounts of diverse multimodal data remain inaccessible in privacy-sensitive silos. Federated Learning…

Machine Learning · Computer Science 2026-03-31 Baochen Xiong , Yifan Xu , Xiaoshan Yang , Yaguang Song , Yaowei Wang , Changsheng Xu

The purpose of federated learning is to enable multiple clients to jointly train a machine learning model without sharing data. However, the existing methods for training an image segmentation model have been based on an unrealistic…

Computer Vision and Pattern Recognition · Computer Science 2022-05-05 Jeffry Wicaksana , Zengqiang Yan , Dong Zhang , Xijie Huang , Huimin Wu , Xin Yang , Kwang-Ting Cheng

Federated learning is a distributed, privacy-aware learning scenario which trains a single model on data belonging to several clients. Each client trains a local model on its data and the local models are then aggregated by a central party.…

Machine Learning · Computer Science 2020-01-01 Hesham Mostafa

Multimodal learning has gained increasing importance across various fields, offering the ability to integrate data from diverse sources such as images, text, and personalized records, which are frequently observed in medical domains.…

Machine Learning · Computer Science 2024-11-01 Sukwon Yun , Inyoung Choi , Jie Peng , Yangfan Wu , Jingxuan Bao , Qiyiwen Zhang , Jiayi Xin , Qi Long , Tianlong Chen

Multi-modal medical image completion has been extensively applied to alleviate the missing modality issue in a wealth of multi-modal diagnostic tasks. However, for most existing synthesis methods, their inferences of missing modalities can…

Image and Video Processing · Electrical Eng. & Systems 2022-07-08 Xiangxi Meng , Yuning Gu , Yongsheng Pan , Nizhuan Wang , Peng Xue , Mengkang Lu , Xuming He , Yiqiang Zhan , Dinggang Shen

Accurate brain tumor segmentation from Magnetic Resonance Imaging (MRI) is desirable to joint learning of multimodal images. However, in clinical practice, it is not always possible to acquire a complete set of MRIs, and the problem of…

Image and Video Processing · Electrical Eng. & Systems 2022-08-05 Yao Zhang , Nanjun He , Jiawei Yang , Yuexiang Li , Dong Wei , Yawen Huang , Yang Zhang , Zhiqiang He , Yefeng Zheng

Neuroimaging techniques including functional magnetic resonance imaging (fMRI) and electroencephalogram (EEG) have shown promise in detecting functional abnormalities in various brain disorders. However, existing studies often focus on a…

Image and Video Processing · Electrical Eng. & Systems 2024-10-01 Xinxu Wei , Kanhao Zhao , Yong Jiao , Nancy B. Carlisle , Hua Xie , Gregory A. Fonzo , Yu Zhang

The federated learning paradigm is wellsuited for the field of medical image analysis, as it can effectively cope with machine learning on isolated multicenter data while protecting the privacy of participating parties. However, current…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Zhekai Zhou , Guibo Luo , Mingzhi Chen , Zhenyu Weng , Yuesheng Zhu

To accelerate Magnetic Resonance (MR) imaging procedures, Multi-Contrast MR Reconstruction (MCMR) has become a prevalent trend that utilizes an easily obtainable modality as an auxiliary to support high-quality reconstruction of the target…

Image and Video Processing · Electrical Eng. & Systems 2024-09-24 Qi Chen , Xiaohan Xing , Zhen Chen , Zhiwei Xiong