English
Related papers

Related papers: Semantic-guided Masked Mutual Learning for Multi-m…

200 papers

Multimodal learning has shown significant performance boost compared to ordinary unimodal models across various domains. However, in real-world scenarios, multimodal signals are susceptible to missing because of sensor failures and adverse…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Nhi Kieu , Kien Nguyen , Arnold Wiliem , Clinton Fookes , Sridha Sridharan

In this study, we introduce a multi-modal approach that efficiently integrates multi-scale clinical and dermoscopy features within a single network, thereby substantially reducing model parameters. The proposed method includes three novel…

Image and Video Processing · Electrical Eng. & Systems 2024-03-31 Peng Tang , Tobias Lasser

In this paper, we address the challenging modality-agnostic semantic segmentation (MaSS), aiming at centering the value of every modality at every feature granularity. Training with all available visual modalities and effectively fusing an…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Xu Zheng , Yuanhuiyi Lyu , Lutao Jiang , Jiazhou Zhou , Lin Wang , Xuming Hu

Magnetic Resonance (MR) images suffer from various types of artifacts due to motion, spatial resolution, and under-sampling. Conventional deep learning methods deal with removing a specific type of artifact, leading to separately trained…

Image and Video Processing · Electrical Eng. & Systems 2023-04-14 Arun Palla , Sriprabha Ramanarayanan , Keerthi Ram , Mohanasankar Sivaprakasam

Meta-learning has recently been an emerging data-efficient learning technique for various medical imaging operations and has helped advance contemporary deep learning models. Furthermore, meta-learning enhances the knowledge generalization…

Image and Video Processing · Electrical Eng. & Systems 2023-07-14 Sriprabha Ramanarayanan , Arun Palla , Keerthi Ram , Mohanasankar Sivaprakasam

Accurate brain tumor segmentation using multiparametric MRI is critical for effective treatment planning. However, in clinical settings, complete acquisition of all MRI sequences is not always possible. The absence of certain MRI modalities…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Danish Ali , Ajmal Mian , Naveed Akhtar , Ghulam Mubashar Hassan

Medical image segmentation is critical for computer-aided diagnosis. However, dense pixel-level annotation is time-consuming and expensive, and medical datasets often exhibit severe class imbalance. Such imbalance causes minority structures…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Yingxue Su , Yiheng Zhong , Keying Zhu , Zimu Zhang , Zhuoru Zhang , Yifang Wang , Yuxin Zhang , Jingxin Liu

Semi-supervised medical image segmentation is an effective method for addressing scenarios with limited labeled data. Existing methods mainly rely on frameworks such as mean teacher and dual-stream consistency learning. These approaches…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Kaiwen Huang , Yizhe Zhang , Yi Zhou , Tianyang Xu , Tao Zhou

Pre-trained segmentation models are a powerful and flexible tool for segmenting images. Recently, this trend has extended to medical imaging. Yet, often these methods only produce a single prediction for a given image, neglecting inherent…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Benjamin Towle , Xin Chen , Ke Zhou

Ophthalmologists typically require multimodal data sources to improve diagnostic accuracy in clinical decisions. However, due to medical device shortages, low-quality data and data privacy concerns, missing data modalities are common in…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Chengzhi Liu , Zile Huang , Zhe Chen , Feilong Tang , Yu Tian , Zhongxing Xu , Zihong Luo , Yalin Zheng , Yanda Meng

Semi-supervised learning (SSL) has achieved notable progress in medical image segmentation. To achieve effective SSL, a model needs to be able to efficiently learn from limited labeled data and effectively exploiting knowledge from abundant…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Juzheng Miao , Cheng Chen , Keli Zhang , Jie Chuai , Quanzheng Li , Pheng-Ann Heng

Accurate segmentation of brain metastases (BMs) in MR image is crucial for the diagnosis and follow-up of patients. Methods based on deep convolutional neural networks (CNNs) have achieved high segmentation performance. However, due to the…

Image and Video Processing · Electrical Eng. & Systems 2024-10-30 Zijiang Liu , Xiaoyu Liu , Linhao Qu , Yonghong Shi

Survival prediction of cancers is crucial for clinical practice, as it informs mortality risks and influences treatment plans. However, a static model trained on a single dataset fails to adapt to the dynamically evolving clinical…

Machine Learning · Computer Science 2026-01-21 Dianzhi Yu , Conghao Xiong , Yankai Chen , Wenqian Cui , Xinni Zhang , Yifei Zhang , Hao Chen , Joseph J. Y. Sung , Irwin King

Biomedical image segmentation plays a significant role in computer-aided diagnosis. However, existing CNN based methods rely heavily on massive manual annotations, which are very expensive and require huge human resources. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2023-01-13 Ruifei Zhang , Sishuo Liu , Yizhou Yu , Guanbin Li

Whole slide images (WSI) provide valuable phenotypic information for histological assessment and malignancy grading of tumors. The WSI-based grading promises to provide rapid diagnostic support and facilitate digital health. Currently, the…

Image and Video Processing · Electrical Eng. & Systems 2022-10-05 Lipei Zhang , Yiran Wei , Ying Fu , Stephen Price , Carola-Bibiane Schönlieb , Chao Li

Tumor segmentation from multi-modal brain MRI images is a challenging task due to the limited samples, high variance in shapes and uneven distribution of tumor morphology. The performance of automated medical image segmentation has been…

Image and Video Processing · Electrical Eng. & Systems 2024-02-13 Tianyi Ren , Ethan Honey , Harshitha Rebala , Abhishek Sharma , Agamdeep Chopra , Mehmet Kurt

Multi-label Recognition (MLR) involves assigning multiple labels to each data instance in an image, offering advantages over single-label classification in complex scenarios. However, it faces the challenge of annotating all relevant…

Machine Learning · Computer Science 2025-06-03 Ruhui Zhang , Hezhe Qiao , Pengcheng Xu , Mingsheng Shang , Lin Chen

Simultaneous segmentation and detection of liver tumors (hemangioma and hepatocellular carcinoma (HCC)) by using multi-modality non-contrast magnetic resonance imaging (NCMRI) are crucial for the clinical diagnosis. However, it is still a…

Image and Video Processing · Electrical Eng. & Systems 2022-01-11 Jianfeng Zhao , Dengwang Li , Shuo Li

Accurate segmentation of brain tumors from multi-modal Magnetic Resonance (MR) images is essential in brain tumor diagnosis and treatment. However, due to the existence of domain shifts among different modalities, the performance of…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Kelei He , Wen Ji , Tao Zhou , Zhuoyuan Li , Jing Huo , Xin Zhang , Yang Gao , Dinggang Shen , Bing Zhang , Junfeng Zhang

The significant amount of training data required for training Convolutional Neural Networks has become a bottleneck for applications like semantic segmentation. Few-shot semantic segmentation algorithms address this problem, with an aim to…

Computer Vision and Pattern Recognition · Computer Science 2020-09-16 Ayyappa Kumar Pambala , Titir Dutta , Soma Biswas