English
Related papers

Related papers: PIMMS: Permutation Invariant Multi-Modal Segmentat…

200 papers

Few-shot image classification remains a critical challenge in the field of computer vision, particularly in data-scarce environments. Existing methods typically rely on pre-trained visual-language models, such as CLIP. However, due to the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Xi Yang , Pai Peng , Wulin Xie , Xiaohuan Lu , Jie Wen

Multimodal magnetic resonance imaging (MRI) is crucial for brain tumor segmentation, with many methods leveraging its four key modalities to capture complementary information for effective sub-region analysis. However, the absence of…

Artificial Intelligence · Computer Science 2026-05-19 Sha Tao , Jiao Pan , Yu Guo , Chao Yao

Understanding the morphological structure of medical images and precisely segmenting the region of interest or abnormality is an important task that can assist in diagnosis. However, the unique properties of medical imaging make clear…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Sungmin Kang , Jaeha Song , Jihie Kim

Referring image segmentation is a typical multi-modal task, which aims at generating a binary mask for referent described in given language expressions. Prior arts adopt a bimodal solution, taking images and languages as two modalities…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Zizhang Li , Mengmeng Wang , Jianbiao Mei , Yong Liu

Despite the progress of image segmentation for accurate visual entity segmentation, completing the diverse requirements of image editing applications for different-level region-of-interest selections remains unsolved. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Lu Qi , Jason Kuen , Weidong Guo , Jiuxiang Gu , Zhe Lin , Bo Du , Yu Xu , Ming-Hsuan Yang

Performance measures are an important tool for assessing and comparing different medical image segmentation algorithms. Unfortunately, the current measures have their weaknesses when it comes to assessing certain edge cases. These…

Computer Vision and Pattern Recognition · Computer Science 2022-10-26 Dennis Hartmann , Verena Schmid , Philip Meyer , Iñaki Soto-Rey , Dominik Müller , Frank Kramer

Multimodal Magnetic Resonance (MR) Imaging plays a crucial role in disease diagnosis due to its ability to provide complementary information by analyzing a relationship between multimodal images on the same subject. Acquiring all MR…

Image and Video Processing · Electrical Eng. & Systems 2024-02-02 Jihoon Cho , Xiaofeng Liu , Fangxu Xing , Jinsong Ouyang , Georges El Fakhri , Jinah Park , Jonghye Woo

Semantic segmentation models trained on public datasets have achieved great success in recent years. However, these models didn't consider the personalization issue of segmentation though it is important in practice. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2021-09-07 Yu Zhang , Chang-Bin Zhang , Peng-Tao Jiang , Ming-Ming Cheng , Feng Mao

With the development of multimodality and large language models, the deep learning-based technique for medical image captioning holds the potential to offer valuable diagnostic recommendations. However, current generic text and image…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Zhenyu Zhang , Benlu Wang , Weijie Liang , Yizhi Li , Xuechen Guo , Guanhong Wang , Shiyan Li , Gaoang Wang

Multiple Instance Learning (MIL) is a weakly-supervised problem in which one label is assigned to the whole bag of instances. An important class of MIL models is instance-based, where we first classify instances and then aggregate those…

Image and Video Processing · Electrical Eng. & Systems 2024-03-13 Łukasz Struski , Dawid Rymarczyk , Arkadiusz Lewicki , Robert Sabiniewicz , Jacek Tabor , Bartosz Zieliński

Multimodal medical image fusion (MMIF) aims to integrate images from different modalities to produce a comprehensive image that enhances medical diagnosis by accurately depicting organ structures, tissue textures, and metabolic information.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Tao Luo , Weihua Xu

For medical image analysis, segmentation models trained on one or several domains lack generalization ability to unseen domains due to discrepancies between different data acquisition policies. We argue that the degeneration in segmentation…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Ziqi Zhou , Lei Qi , Yinghuan Shi

Recent advances in multimodal learning have achieved remarkable success across diverse vision-language tasks. However, such progress heavily relies on large-scale image-text datasets, making training costly and inefficient. Prior efforts in…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Junhyeok Choi , Sangwoo Mo , Minwoo Chae

We tackle biomedical image segmentation in the scenario of only a few labeled brain MR images. This is an important and challenging task in medical applications, where manual annotations are time-consuming. Current multi-atlas based…

Computer Vision and Pattern Recognition · Computer Science 2020-01-14 Hyeon Woo Lee , Mert R. Sabuncu , Adrian V. Dalca

Medical image segmentation is vital for modern healthcare and is a key element of computer-aided diagnosis. While recent advancements in computer vision have explored unsupervised segmentation using pre-trained models, these methods have…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Mosong Ma , Tania Stathaki , Michalis Lazarou

Abdominal CT data are limited by high annotation costs and privacy constraints, which hinder the development of robust segmentation and diagnostic models. We present a Prior-Integrated Variation Modeling (PIVM) framework, a diffusion-based…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Dinglun He , Baoming Zhang , Xu Wang , Yao Hao , Deshan Yang , Ye Duan

Medical imaging is essential in healthcare to provide key insights into patient anatomy and pathology, aiding in diagnosis and treatment. Non-invasive techniques such as X-ray, Magnetic Resonance Imaging (MRI), Computed Tomography (CT), and…

Image and Video Processing · Electrical Eng. & Systems 2024-12-04 Fnu Neha , Deepshikha Bhati , Deepak Kumar Shukla , Sonavi Makarand Dalvi , Nikolaos Mantzou , Safa Shubbar

Medical imaging segmentation is a highly active area of research, with deep learning-based methods achieving state-of-the-art results in several benchmarks. However, the lack of standardized tools for training, testing, and evaluating new…

Image and Video Processing · Electrical Eng. & Systems 2024-11-19 Adrian Celaya , Evan Lim , Rachel Glenn , Brayden Mi , Alex Balsells , Dawid Schellingerhout , Tucker Netherton , Caroline Chung , Beatrice Riviere , David Fuentes

Content-based medical image retrieval is an important diagnostic tool that improves the explainability of computer-aided diagnosis systems and provides decision making support to healthcare professionals. Medical imaging data, such as…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Yunyan Xing , Benjamin J. Meyer , Mehrtash Harandi , Tom Drummond , Zongyuan Ge