English
Related papers

Related papers: PIMMS: Permutation Invariant Multi-Modal Segmentat…

200 papers

Multimodal pathological images are usually in clinical diagnosis, but computer vision-based multimodal image-assisted diagnosis faces challenges with modality fusion, especially in the absence of expert-annotated data. To achieve the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Qinghua Lin , Guang-Hai Liu , Zuoyong Li , Yang Li , Yuting Jiang , Xiang Wu

Manual segmentation of medical images (e.g., segmenting tumors in CT scans) is a high-effort task that can be accelerated with machine learning techniques. However, selecting the right segmentation approach depends on the evaluation…

Computer Vision and Pattern Recognition · Computer Science 2023-02-09 Seyed M. R. Modaresi , Aomar Osmani , Mohammadreza Razzazi , Abdelghani Chibani

Masked image modeling (MIM) with transformer backbones has recently been exploited as a powerful self-supervised pre-training technique. The existing MIM methods adopt the strategy to mask random patches of the image and reconstruct the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-05 Zhaohu Xing , Lei Zhu , Lequan Yu , Zhiheng Xing , Liang Wan

Medical Image Segmentation (MIS) plays a crucial role in medical therapy planning and robot navigation. Prototype learning methods in MIS focus on generating segmentation masks through pixel-to-prototype comparison. However, current…

Methodology · Statistics 2025-07-11 Guoyan Liang , Qin Zhou , Jingyuan Chen , Zhe Wang , Chang Yao

We present a cross-modality generation framework that learns to generate translated modalities from given modalities in MR images without real acquisition. Our proposed method performs NeuroImage-to-NeuroImage translation (abbreviated as…

Computer Vision and Pattern Recognition · Computer Science 2018-09-12 Qianye Yang , Nannan Li , Zixu Zhao , Xingyu Fan , Eric I-Chao Chang , Yan Xu

The research community has witnessed the powerful potential of self-supervised Masked Image Modeling (MIM), which enables the models capable of learning visual representation from unlabeled data. In this paper, to incorporate both the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Wenxuan Wang , Jing Wang , Chen Chen , Jianbo Jiao , Yuanxiu Cai , Shanshan Song , Jiangyun Li

MRI entails a great amount of cost, time and effort for the generation of all the modalities that are recommended for efficient diagnosis and treatment planning. Recent advancements in deep learning research show that generative models have…

Image and Video Processing · Electrical Eng. & Systems 2022-02-22 Jaya Chandra Raju , Kompella Subha Gayatri , Keerthi Ram , Rajeswaran Rangasami , Rajoo Ramachandran , Mohansankar Sivaprakasam

Real-life medical data is often multimodal and incomplete, fueling the growing need for advanced deep learning models capable of integrating them efficiently. The use of diverse modalities, including histopathology slides, MRI, and genetic…

Artificial Intelligence · Computer Science 2024-10-02 Lucas Robinet , Ahmad Berjaoui , Ziad Kheil , Elizabeth Cohen-Jonathan Moyal

We propose a novel unsupervised framework for \emph{Invariant Risk Minimization} (IRM), extending the concept of invariance to settings where labels are unavailable. Traditional IRM methods rely on labeled data to learn representations that…

Machine Learning · Computer Science 2026-03-05 Yotam Norman , Ron Meir

With the proposal of the Segment Anything Model (SAM), fine-tuning SAM for medical image segmentation (MIS) has become popular. However, due to the large size of the SAM model and the significant domain gap between natural and medical…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Jinfeng Wang , Sifan Song , Xinkun Wang , Yiyi Wang , Yiyi Miao , Jionglong Su , S. Kevin Zhou

Deep learning models have become the dominant method for medical image segmentation. However, they often struggle to be generalisable to unknown tasks involving new anatomical structures, labels, or shapes. In these cases, the model needs…

Image and Video Processing · Electrical Eng. & Systems 2024-09-17 Jing Xu

Segmenting curvilinear structures in medical images is essential for analyzing morphological patterns in clinical applications. Integrating topological properties, such as connectivity, improves segmentation accuracy and consistency.…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Zhuangzhi Gao , Feixiang Zhou , He Zhao , Xiuju Chen , Xiaoxin Li , Qinkai Yu , Yitian Zhao , Alena Shantsila , Gregory Y. H. Lip , Eduard Shantsila , Yalin Zheng

In clinical practice, full imaging is not always feasible, often due to complex acquisition protocols, stringent privacy regulations, or specific clinical needs. However, missing MR modalities pose significant challenges for tasks like…

Computer Vision and Pattern Recognition · Computer Science 2025-01-23 Aghiles Kebaili , Jérôme Lapuyade-Lahorgue , Pierre Vera , Su Ruan

Brain MRI scans are often found in four modalities, consisting of T1-weighted with and without contrast enhancement (T1ce and T1w), T2-weighted imaging (T2w), and Flair. Leveraging complementary information from these different modalities…

Image and Video Processing · Electrical Eng. & Systems 2025-09-22 Bhavesh Sandbhor , Bheeshm Sharma , Balamurugan Palaniappan

Imaging mass spectrometry (IMS) is a powerful tool for untargeted, highly multiplexed molecular mapping of tissue in biomedical research. IMS offers a means of mapping the spatial distributions of molecular species in biological tissue with…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Yijie Zhang , Luzhe Huang , Nir Pillar , Yuzhu Li , Lukasz G. Migas , Raf Van de Plas , Jeffrey M. Spraggins , Aydogan Ozcan

Multi-modality is widely used in medical imaging, because it can provide multiinformation about a target (tumor, organ or tissue). Segmentation using multimodality consists of fusing multi-information to improve the segmentation. Recently,…

Image and Video Processing · Electrical Eng. & Systems 2020-07-17 Tongxue Zhou , Su Ruan , Stéphane Canu

Brain Tumor Segmentation from magnetic resonance imaging (MRI) is a critical technique for early diagnosis. However, rather than having complete four modalities as in BraTS dataset, it is common to have missing modalities in clinical…

Computer Vision and Pattern Recognition · Computer Science 2019-04-17 Yan Shen , Mingchen Gao

Integrating multi-modal data to promote medical image analysis has recently gained great attention. This paper presents a novel scheme to learn the mutual benefits of different modalities to achieve better segmentation results for unpaired…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Jie Yang , Ye Zhu , Chaoqun Wang , Zhen Li , Ruimao Zhang

Due to the difficulties of obtaining multimodal paired images in clinical practice, recent studies propose to train brain tumor segmentation models with unpaired images and capture complementary information through modality translation.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-29 Zecheng Liu , Jia Wei , Rui Li

While deep learning methods have shown great success in medical image analysis, they require a number of medical images to train. Due to data privacy concerns and unavailability of medical annotators, it is oftentimes very difficult to…

Image and Video Processing · Electrical Eng. & Systems 2020-10-08 Yue Yang , Pengtao Xie