English
Related papers

Related papers: C^2M-DoT: Cross-modal consistent multi-view medica…

200 papers

Semi-supervised medical image segmentation (SSMIS) has witnessed substantial advancements by leveraging limited labeled data and abundant unlabeled data. Nevertheless, existing state-of-the-art (SOTA) methods encounter challenges in…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Wei Li , Ruifeng Bian , Wenyi Zhao , Weijin Xu , Huihua Yang

Image translation is one of the crucial approaches for mitigating information deficiencies in the infrared and visible modalities, while also facilitating the enhancement of modality-specific datasets. However, existing methods for infrared…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Bin Hu , Chenqiang Gao , Shurui Liu , Junjie Guo , Fang Chen , Fangcen Liu , Junwei Han

Multi-modal magnetic resonance imaging (MRI) provides rich, complementary information for analyzing diseases. However, the practical challenges of acquiring multiple MRI modalities, such as cost, scan time, and safety considerations, often…

Image and Video Processing · Electrical Eng. & Systems 2024-09-16 Zhaohu Xing , Sicheng Yang , Sixiang Chen , Tian Ye , Yijun Yang , Jing Qin , Lei Zhu

Medical image segmentation plays a crucial role in clinical workflows, but domain shift often leads to performance degradation when models are applied to unseen clinical domains. This challenge arises due to variations in imaging…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Yingkai Wang , Yaoyao Zhu , Xiuding Cai , Yuhao Xiao , Haotian Wu , Yu Yao

Multi-Object Tracking (MOT) aims to associate multiple objects across video frames and is a challenging vision task due to inherent complexities in the tracking environment. Most existing approaches train and track within a single domain,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Run Luo , Zikai Song , Longze Chen , Yunshui Li , Min Yang , Wei Yang

In hospitals, data are siloed to specific information systems that make the same information available under different modalities such as the different medical imaging exams the patient undergoes (CT scans, MRI, PET, Ultrasound, etc.) and…

Computer Vision and Pattern Recognition · Computer Science 2021-02-03 Tristan Sylvain , Francis Dutil , Tess Berthier , Lisa Di Jorio , Margaux Luck , Devon Hjelm , Yoshua Bengio

Accurate automatic medical image segmentation relies on high-quality, dense annotations, which are costly and time-consuming. Weakly supervised learning provides a more efficient alternative by leveraging sparse and coarse annotations…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Dongdong Meng , Sheng Li , Hao Wu , Suqing Tian , Wenjun Ma , Guoping Wang , Xueqing Yan

Brain disorders are a major challenge to global health, causing millions of deaths each year. Accurate diagnosis of these diseases relies heavily on advanced medical imaging techniques such as Magnetic Resonance Imaging (MRI) and Computed…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Xuran Zhu

Domain adaptation is an important task to enable learning when labels are scarce. While most works focus only on the image modality, there are many important multi-modal datasets. In order to leverage multi-modality for domain adaptation,…

Computer Vision and Pattern Recognition · Computer Science 2022-06-23 Maximilian Jaritz , Tuan-Hung Vu , Raoul de Charette , Émilie Wirbel , Patrick Pérez

Multimodal medical image fusion plays a crucial role in medical diagnosis by integrating complementary information from different modalities to enhance image readability and clinical applicability. However, existing methods mainly follow…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Haozhe Xiang , Han Zhang , Yu Cheng , Xiongwen Quan , Wanwan Huang

Since medical image data sets contain few samples and singular features, lesions are viewed as highly similar to other tissues. The traditional neural network has a limited ability to learn features. Even if a host of feature maps is…

Computer Vision and Pattern Recognition · Computer Science 2020-09-29 Hongfeng You , Long Yu , Shengwei Tian , Xiang Ma , Yan Xing , Xiaojie Ma

Medical imaging models frequently fail when deployed across hospitals, scanners, populations, or imaging protocols due to domain shift, limiting their clinical reliability. While transfer learning and domain adaptation address such shifts…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Mohammed M. Abdelsamea , Daniel Tweneboah Anyimadu , Tasneem Selim , Saif Alzubi , Lei Zhang , Ahmed Karam Eldaly , Xujiong Ye

In clinical practice, crossmodal information including medical images and tabular data is essential for disease diagnosis. There exists a significant modality gap between these data types, which obstructs advancements in crossmodal…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Tianling Liu , Hongying Liu , Fanhua Shang , Lequan Yu , Tong Han , Liang Wan

Recent advancements in Large Multimodal Models (LMMs) have attracted interest in their generalization capability with only a few samples in the prompt. This progress is particularly relevant to the medical domain, where the quality and…

Computation and Language · Computer Science 2024-05-06 Seonhee Cho , Choonghan Kim , Jiho Lee , Chetan Chilkunda , Sujin Choi , Joo Heung Yoon

Cross-domain few-shot medical image segmentation (CD-FSMIS) offers a promising and data-efficient solution for medical applications where annotations are severely scarce and multimodal analysis is required. However, existing methods…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Yuntian Bo , Tao Zhou , Zechao Li , Haofeng Zhang , Ling Shao

Any novel medical imaging modality that differs from previous protocols e.g. in the number of imaging channels, introduces a new domain that is heterogeneous from previous ones. This common medical imaging scenario is rarely considered in…

Image and Video Processing · Electrical Eng. & Systems 2021-09-22 Eleni Chiou , Francesco Giganti , Shonit Punwani , Iasonas Kokkinos , Eleftheria Panagiotaki

In surgical computer vision applications, obtaining labeled training data is challenging due to data-privacy concerns and the need for expert annotation. Unpaired image-to-image translation techniques have been explored to automatically…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Danush Kumar Venkatesh , Dominik Rivoir , Micha Pfeiffer , Fiona Kolbinger , Marius Distler , Jürgen Weitz , Stefanie Speidel

Medical diagnostic applications require models that can process multimodal medical inputs (images, patient histories, lab results) and generate diverse outputs including both textual reports and visual content (annotations, segmentation…

Clinical check-up reports are multimodal documents that combine page layouts, tables, numerical biomarkers, abnormality flags, imaging findings, and domain-specific terminology. Such heterogeneous evidence is difficult for laypersons to…

Computation and Language · Computer Science 2026-05-14 Sike Xiang , Shuang Chen , Kevin Qinghong Lin , Jialin Yu , Yijia Sun , Philip Torr , Amir Atapour-Abarghouei

Cross-modal medical image synthesis research focuses on reconstructing missing imaging modalities from available ones to support clinical diagnosis. Driven by clinical necessities for flexible modality reconstruction, we explore K to N…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Feng Yuan , Yifan Gao , Yuehua Ye , Haoyue Li , Xin Gao