English
Related papers

Related papers: Modality-Specific Enhancement and Complementary Fu…

200 papers

Medical image segmentation annotations exhibit variations among experts due to the ambiguous boundaries of segmented objects and backgrounds in medical images. Although using multiple annotations for each image in the fully-supervised has…

Computer Vision and Pattern Recognition · Computer Science 2023-11-20 Shuai Wang , Tengjin Weng , Jingyi Wang , Yang Shen , Zhidong Zhao , Yixiu Liu , Pengfei Jiao , Zhiming Cheng , Yaqi Wang

In this paper, we propose a novel mutual consistency network (MC-Net+) to effectively exploit the unlabeled data for semi-supervised medical image segmentation. The MC-Net+ model is motivated by the observation that deep models trained with…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Yicheng Wu , Zongyuan Ge , Donghao Zhang , Minfeng Xu , Lei Zhang , Yong Xia , Jianfei Cai

We propose a new deep learning method for tumour segmentation when dealing with missing imaging modalities. Instead of producing one network for each possible subset of observed modalities or using arithmetic operations to combine feature…

Image and Video Processing · Electrical Eng. & Systems 2019-10-22 Reuben Dorent , Samuel Joutard , Marc Modat , Sébastien Ourselin , Tom Vercauteren

Medical image segmentation plays a crucial role in computer-aided diagnosis. However, existing methods heavily rely on fully supervised training, which requires a large amount of labeled data with time-consuming pixel-wise annotations.…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Yunqi Gu , Tao Zhou , Yizhe Zhang , Yi Zhou , Kelei He , Chen Gong , Huazhu Fu

We introduce a novel uncertainty-aware multimodal segmentation framework that leverages both radiological images and associated clinical text for precise medical diagnosis. We propose a Modality Decoding Attention Block (MoDAB) with a…

Computer Vision and Pattern Recognition · Computer Science 2026-02-23 Aryan Das , Tanishq Rachamalla , Koushik Biswas , Swalpa Kumar Roy , Vinay Kumar Verma

Accurate brain tumor classification is crucial in medical imaging to ensure reliable diagnosis and effective treatment planning. This study introduces a novel double ensembling framework that synergistically combines pre-trained deep…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Zahid Ullah , Jihie Kim

Multi-modality image fusion enhances scene perception by combining complementary information. Unified models aim to share parameters across modalities for multi-modality image fusion, but large modality differences often cause gradient…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Xilai Li , Xiaosong Li , Weijun Jiang

Weakly supervised learning has emerged as an appealing alternative to alleviate the need for large labeled datasets in semantic segmentation. Most current approaches exploit class activation maps (CAMs), which can be generated from…

Computer Vision and Pattern Recognition · Computer Science 2022-01-17 Gaurav Patel , Jose Dolz

In this work, we propose a multi-modal Convolutional Neural Network (CNN) approach for brain tumor segmentation. We investigate how to combine different modalities efficiently in the CNN framework.We adapt various fusion methods, which are…

Computer Vision and Pattern Recognition · Computer Science 2018-09-21 Mehmet Aygün , Yusuf Hüseyin Şahin , Gözde Ünal

The fusion of complementary multimodal information is crucial in computational pathology for accurate diagnostics. However, existing multimodal learning approaches necessitate access to users' raw data, posing substantial privacy risks.…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Yuanzhe Peng , Jieming Bian , Jie Xu

Semi-supervised segmentation presents a promising approach for large-scale medical image analysis, effectively reducing annotation burdens while achieving comparable performance. This methodology holds substantial potential for streamlining…

Computer Vision and Pattern Recognition · Computer Science 2024-04-11 Zhenxi Zhang , Heng Zhou , Xiaoran Shi , Ran Ran , Chunna Tian , Feng Zhou

Self-Supervised Learning (SSL) methods harness the concept of semantic invariance by utilizing data augmentation strategies to produce similar representations for different deformations of the same input. Essentially, the model captures the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Huijie Guo , Ying Ba , Jie Hu , Lingyu Si , Wenwen Qiang , Lei Shi

The performance of supervised deep learning methods for medical image segmentation is often limited by the scarcity of labeled data. As a promising research direction, semi-supervised learning addresses this dilemma by leveraging unlabeled…

Image and Video Processing · Electrical Eng. & Systems 2024-05-13 Zihang Liu , Chunhui Zhao

Multimodal image-tabular learning is gaining attention, yet it faces challenges due to limited labeled data. While earlier work has applied self-supervised learning (SSL) to unlabeled data, its task-agnostic nature often results in learning…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Siyi Du , Xinzhe Luo , Declan P. O'Regan , Chen Qin

Medical image segmentation is clinically important, yet data privacy and the cost of expert annotation limit the availability of labeled data. Federated semi-supervised learning (FSSL) offers a solution but faces two challenges:…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Sahar Nasirihaghighi , Negin Ghamsarian , Yiping Li , Marcel Breeuwer , Raphael Sznitman , Klaus Schoeffmann

Deep neural networks are commonly used for automated medical image segmentation, but models will frequently struggle to generalize well across different imaging modalities. This issue is particularly problematic due to the limited…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Malo de Boisredon , Eugene Vorontsov , William Trung Le , Samuel Kadoury

Background: Brain tumor segmentation requires precise delineation of hierarchical structures from multi-sequence MRI. However, existing deep learning methods primarily rely on visual features, showing insufficient discriminative power in…

Computer Vision and Pattern Recognition · Computer Science 2025-11-13 Mingda Zhang , Kaiwen Pan

We introduce a deep learning image segmentation framework that is extremely robust to missing imaging modalities. Instead of attempting to impute or synthesize missing data, the proposed approach learns, for each modality, an embedding of…

Computer Vision and Pattern Recognition · Computer Science 2016-07-19 Mohammad Havaei , Nicolas Guizard , Nicolas Chapados , Yoshua Bengio

Multimodal foundation models can process several modalities. However, since the space of possible modalities is large and evolving over time, training a model from scratch to encompass all modalities is unfeasible. Moreover, integrating a…

Computation and Language · Computer Science 2025-09-08 Osman Batur İnce , André F. T. Martins , Oisin Mac Aodha , Edoardo M. Ponti

Multi-modal learning aims to enhance performance by unifying models from various modalities but often faces the "modality imbalance" problem in real data, leading to a bias towards dominant modalities and neglecting others, thereby limiting…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Yang Yang , Hongpeng Pan , Qing-Yuan Jiang , Yi Xu , Jinghui Tang