English
Related papers

Related papers: PIMMS: Permutation Invariant Multi-Modal Segmentat…

200 papers

Cell segmentation is a critical step for quantitative single-cell analysis in microscopy images. Existing cell segmentation methods are often tailored to specific modalities or require manual interventions to specify hyper-parameters in…

Accurate liver segmentation in multi-phase MRI is vital for liver fibrosis assessment, yet labeled data is often scarce and unevenly distributed across imaging modalities and vendor systems. We propose a label-efficient segmentation…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Quang-Khai Bui-Tran , Minh-Toan Dinh , Thanh-Huy Nguyen , Ba-Thinh Lam , Mai-Anh Vu , Ulas Bagci

When it comes to clinical images, automatic segmentation has a wide variety of applications and a considerable diversity of input domains, such as different types of Magnetic Resonance Images (MRIs) and Computerized Tomography (CT) scans.…

Image and Video Processing · Electrical Eng. & Systems 2024-02-28 Matteo Bastico , David Ryckelynck , Laurent Corté , Yannick Tillier , Etienne Decencière

The computer-aided analysis of medical scans is a longstanding goal in the medical imaging field. Currently, deep learning has became a dominant methodology for supporting pathologists and radiologist. Deep learning algorithms have been…

Machine Learning · Computer Science 2017-12-06 Jakub M. Tomczak , Maximilian Ilse , Max Welling

The field of computer vision is undergoing a paradigm shift toward large-scale foundation model pre-training via self-supervised learning (SSL). Leveraging large volumes of unlabeled brain MRI data, such models can learn anatomical priors…

Image and Video Processing · Electrical Eng. & Systems 2026-01-15 Petros Koutsouvelis , Matej Gazda , Leroy Volmer , Sina Amirrajab , Kamil Barbierik , Branislav Setlak , Jakub Gazda , Peter Drotar

Multiple Instance Learning (MIL) is widely used in medical imaging classification to reduce the labeling effort. While only bag labels are available for training, one typically seeks predictions at both bag and instance levels…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Francisco M. Castro-Macías , Pablo Morales-Álvarez , Yunan Wu , Rafael Molina , Aggelos K. Katsaggelos

A major focus of clinical imaging workflow is disease diagnosis and management, leading to medical imaging datasets strongly tied to specific clinical objectives. This scenario has led to the prevailing practice of developing task-specific…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Yunhe Gao , Zhuowei Li , Di Liu , Mu Zhou , Shaoting Zhang , Dimitris N. Metaxas

Multimodal learning has shown promise in medical imaging, combining complementary modalities like images and text. Vision-language models (VLMs) capture rich diagnostic cues but often require large paired datasets and prompt- or text-based…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Banafsheh Karimian , Giulia Avanzato , Soufian Belharbi , Alexis Guichemerre , Luke McCaffrey , Mohammadhadi Shateri , Eric Granger

Multi-modal medical image segmentation plays an essential role in clinical diagnosis. It remains challenging as the input modalities are often not well-aligned spatially. Existing learning-based methods mainly consider sharing trainable…

Computer Vision and Pattern Recognition · Computer Science 2021-01-06 Jingkun Chen , Wenqi Li , Hongwei Li , Jianguo Zhang

Magnetic Resonance Imaging (MRI) typically recruits multiple sequences (defined here as "modalities"). As each modality is designed to offer different anatomical and functional clinical information, there are evident disparities in the…

Image and Video Processing · Electrical Eng. & Systems 2022-03-09 Chengjia Wang , Guang Yang , Giorgos Papanastasiou

A patient undergoes multiple examinations in each hospital stay, where each provides different facets of the health status. These assessments include temporal data with varying sampling rates, discrete single-point measurements, therapeutic…

Computer Vision and Pattern Recognition · Computer Science 2025-01-31 Malte Tölle , Mohamad Scharaf , Samantha Fischer , Christoph Reich , Silav Zeid , Christoph Dieterich , Benjamin Meder , Norbert Frey , Philipp Wild , Sandy Engelhardt

Masked Image Modeling (MIM) is a powerful self-supervised strategy for visual pre-training without the use of labels. MIM applies random crops to input images, processes them with an encoder, and then recovers the masked inputs with a…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Maryam Haghighat , Peyman Moghadam , Shaheer Mohamed , Piotr Koniusz

Multi-modal learning is typically performed with network architectures containing modality-specific layers and shared layers, utilizing co-registered images of different modalities. We propose a novel learning scheme for unpaired…

Computer Vision and Pattern Recognition · Computer Science 2020-01-10 Qi Dou , Quande Liu , Pheng Ann Heng , Ben Glocker

Label-free cell classification is advantageous for supplying pristine cells for further use or examination, yet existing techniques frequently fall short in terms of specificity and speed. In this study, we address these limitations through…

Image and Video Processing · Electrical Eng. & Systems 2025-02-25 Khayrul Islam , Ratul Paul , Shen Wang , Yuwen Zhao , Partho Adhikary , Qiying Li , Xiaochen Qin , Yaling Liu

Deep learning models such as convolutional neural net- work have been widely used in 3D biomedical segmentation and achieve state-of-the-art performance. However, most of them often adapt a single modality or stack multiple modalities as…

Computer Vision and Pattern Recognition · Computer Science 2017-04-26 Kuan-Lun Tseng , Yen-Liang Lin , Winston Hsu , Chung-Yang Huang

Due to the flexibility of prompting, foundation models have become the dominant force in the domains of natural language processing and image generation. With the recent introduction of the Segment Anything Model (SAM), the prompt-driven…

Image and Video Processing · Electrical Eng. & Systems 2023-08-14 Yichi Zhang , Rushi Jiao

Medical image segmentation of tumors and organs at risk is a time-consuming yet critical process in the clinic that utilizes multi-modality imaging (e.g, different acquisitions, data types, and sequences) to increase segmentation precision.…

Image and Video Processing · Electrical Eng. & Systems 2023-06-07 Qisheng He , Nicholas Summerfield , Ming Dong , Carri Glide-Hurst

Image analysis using more than one modality (i.e. multi-modal) has been increasingly applied in the field of biomedical imaging. One of the challenges in performing the multimodal analysis is that there exist multiple schemes for fusing the…

Computer Vision and Pattern Recognition · Computer Science 2018-06-19 Zhe Guo , Xiang Li , Heng Huang , Ning Guo , Quanzheng Li

Automatic segmentation of medical images based on multi-modality is an important topic for disease diagnosis. Although the convolutional neural network (CNN) has been proven to have excellent performance in image segmentation tasks, it is…

Computer Vision and Pattern Recognition · Computer Science 2022-04-27 Xuejian Li , Shiqiang Ma , Jijun Tang , Fei Guo

The scarcity of labeled data often impedes the application of deep learning to the segmentation of medical images. Semi-supervised learning seeks to overcome this limitation by exploiting unlabeled examples in the learning process. In this…

Computer Vision and Pattern Recognition · Computer Science 2021-06-25 Jizong Peng , Marco Pedersoli , Christian Desrosiers