English
Related papers

Related papers: PIMMS: Permutation Invariant Multi-Modal Segmentat…

200 papers

Image segmentation is an important task in many medical applications. Methods based on convolutional neural networks attain state-of-the-art accuracy; however, they typically rely on supervised training with large labeled datasets. Labeling…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Amy Zhao , Guha Balakrishnan , Frédo Durand , John V. Guttag , Adrian V. Dalca

A versatile medical image segmentation model applicable to images acquired with diverse equipment and protocols can facilitate model deployment and maintenance. However, building such a model typically demands a large, diverse, and fully…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Xiaoyang Chen , Hao Zheng , Yuemeng Li , Yuncong Ma , Liang Ma , Hongming Li , Yong Fan

Existing image segmentation networks mainly leverage large-scale labeled datasets to attain high accuracy. However, labeling medical images is very expensive since it requires sophisticated expert knowledge. Thus, it is more desirable to…

Image and Video Processing · Electrical Eng. & Systems 2021-02-04 Yuhang Ding , Xin Yu , Yi Yang

Magnetic resonance (MR) protocols rely on several sequences to assess pathology and organ status properly. Despite advances in image analysis, we tend to treat each sequence, here termed modality, in isolation. Taking advantage of the…

Computer Vision and Pattern Recognition · Computer Science 2020-11-11 Agisilaos Chartsias , Giorgos Papanastasiou , Chengjia Wang , Scott Semple , David E. Newby , Rohan Dharmakumar , Sotirios A. Tsaftaris

Brain tumor segmentation remains a significant challenge, particularly in the context of multi-modal magnetic resonance imaging (MRI) where missing modality images are common in clinical settings, leading to reduced segmentation accuracy.…

Image and Video Processing · Electrical Eng. & Systems 2024-06-14 Zhongao Sun , Jiameng Li , Yuhan Wang , Jiarong Cheng , Qing Zhou , Chun Li

We are interested in inferring object segmentation by leveraging only object class information, and by considering only minimal priors on the object segmentation task. This problem could be viewed as a kind of weakly supervised segmentation…

Computer Vision and Pattern Recognition · Computer Science 2015-04-27 Pedro O. Pinheiro , Ronan Collobert

Vision foundation models like DINOv2 demonstrate remarkable potential in medical imaging despite their origin in natural image domains. However, their design inherently works best for uni-modal image analysis, limiting their effectiveness…

Image and Video Processing · Electrical Eng. & Systems 2025-09-09 Daniel Scholz , Ayhan Can Erdur , Viktoria Ehm , Anke Meyer-Baese , Jan C. Peeken , Daniel Rueckert , Benedikt Wiestler

Image-text multimodal representation learning aligns data across modalities and enables important medical applications, e.g., image classification, visual grounding, and cross-modal retrieval. In this work, we establish a connection between…

Computer Vision and Pattern Recognition · Computer Science 2023-06-14 Peiqi Wang , William M. Wells , Seth Berkowitz , Steven Horng , Polina Golland

A single biomedical image can be meaningfully segmented in multiple ways, depending on the desired application. For instance, a brain MRI can be segmented according to tissue types, vascular territories, broad anatomical regions,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Marianne Rakic , Siyu Gai , Etienne Chollet , John V. Guttag , Adrian V. Dalca

In real-world clinical settings, magnetic resonance imaging (MRI) frequently suffers from missing modalities due to equipment variability or patient cooperation issues, which can significantly affect model performance. To address this…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Zhejia Zhang , Junjie Wang , Le Zhang

Multiple instance learning (MIL) has emerged as a powerful framework for weakly supervised whole slide image (WSI) classification, enabling slide-level predictions without requiring detailed patch-level annotations. Despite its success, a…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Bryan Wong , Mun Yong Yi

Multiplex Imaging (MI) enables the simultaneous visualization of multiple biological markers in separate imaging channels at subcellular resolution, providing valuable insights into cell-type heterogeneity and spatial organization. However,…

Image and Video Processing · Electrical Eng. & Systems 2024-11-07 Simon Gutwein , Daria Lazic , Thomas Walter , Sabine Taschner-Mandl , Roxane Licandro

Studies on semi-supervised medical image segmentation (SSMIS) have seen fast progress recently. Due to the limited labelled data, SSMIS methods mainly focus on effectively leveraging unlabeled data to enhance the segmentation performance.…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Zhen Zhao , Ye Liu , Meng Zhao , Di Yin , Yixuan Yuan , Luping Zhou

Recent advancements in Large Multimodal Models (LMMs) have attracted interest in their generalization capability with only a few samples in the prompt. This progress is particularly relevant to the medical domain, where the quality and…

Computation and Language · Computer Science 2024-05-06 Seonhee Cho , Choonghan Kim , Jiho Lee , Chetan Chilkunda , Sujin Choi , Joo Heung Yoon

Developing reliable and generalizable deep learning systems for medical imaging faces significant obstacles due to spurious correlations, data imbalances, and limited text annotations in datasets. Addressing these challenges requires…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Amar Kumar , Anita Kriz , Mohammad Havaei , Tal Arbel

Automated medical image segmentation has achieved remarkable progress with fully labeled data. However, site-specific clinical priorities and the high cost of manual annotation often yield scans with only a subset of organs labeled, leading…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Qiaochu Zhao , Wei Wei , David Horowitz , Richard Bakst , Yading Yuan

Leveraging multiple training datasets to scale up image segmentation models is beneficial for increasing robustness and semantic understanding. Individual datasets have well-defined ground truth with non-overlapping mask layouts and…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Qilong Zhangli , Di Liu , Abhishek Aich , Dimitris Metaxas , Samuel Schulter

Rapid advancements in medical image segmentation performance have been significantly driven by the development of Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs). These models follow the discriminative pixel-wise…

Image and Video Processing · Electrical Eng. & Systems 2024-08-21 Jiayu Huo , Xi Ouyang , Sébastien Ourselin , Rachel Sparks

Multi-modal magnetic resonance imaging (MRI) provides information of lesions for computer-aided diagnosis from different views. Deep learning algorithms are suitable for identifying specific anatomical structures, segmenting lesions, and…

Image and Video Processing · Electrical Eng. & Systems 2025-01-17 Linxuan Han , Sa Xiao , Zimeng Li , Haidong Li , Xiuchao Zhao , Yeqing Han , Fumin Guo , Xin Zhou

Mid-InfraRed spectroscopy is a promising label-free technique that can offer insights into morphological and pathological alterations in biological tissues at the molecular level. Owing to the development of the Fourier Transform InfraRed…

Optics · Physics 2026-04-21 Xiangyu Zhao , Yudong Tian , Jingzhu Shao , Chongzhao Wu
‹ Prev 1 4 5 6 7 8 10 Next ›