English
Related papers

Related papers: Self-Attention Diffusion Models for Zero-Shot Biom…

200 papers

Supervised deep learning for semantic segmentation has achieved excellent results in accurately identifying anatomical and pathological structures in medical images. However, it often requires large annotated training datasets, which limits…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Luca Ciampi , Gabriele Lagani , Giuseppe Amato , Fabrizio Falchi

Medical image segmentation has witnessed significant advancements with the emergence of deep learning. However, the reliance of most neural network models on a substantial amount of annotated data remains a challenge for medical image…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Xiaoxiao Wu , Xiaowei Chen , Zhenguo Gao , Shulei Qu , Yuanyuan Qiu

Zero-shot and prompt-based models have excelled at visual reasoning tasks by leveraging large-scale natural image corpora, but they often fail on sparse and domain-specific scientific image data. We introduce Zenesis, a no-code interactive…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Shubhabrata Mukherjee , Jack Lang , Obeen Kwon , Iryna Zenyuk , Valerie Brogden , Adam Weber , Daniela Ushizima

Obtaining large-scale medical data, annotated or unannotated, is challenging due to stringent privacy regulations and data protection policies. In addition, annotating medical images requires that domain experts manually delineate…

Computer Vision and Pattern Recognition · Computer Science 2025-05-16 Tushar Kataria , Shireen Y. Elhabian

Segmentation in medical imaging is a critical component for the diagnosis, monitoring, and treatment of various diseases and medical conditions. Presently, the medical segmentation landscape is dominated by numerous specialized deep…

A major challenge in the segmentation of medical images is the large inter- and intra-observer variability in annotations provided by multiple experts. To address this challenge, we propose a novel method for multi-expert prediction using…

Image and Video Processing · Electrical Eng. & Systems 2023-06-16 Tomer Amit , Shmuel Shichrur , Tal Shaharabany , Lior Wolf

The Segment Anything Model (SAM) exhibits a capability to segment a wide array of objects in natural images, serving as a versatile perceptual tool for various downstream image segmentation tasks. In contrast, medical image segmentation…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Yizhe Zhang , Tao Zhou , Shuo Wang , Ye Wu , Pengfei Gu , Danny Z. Chen

Manually inspecting polyps from a colonoscopy for colorectal cancer or performing a biopsy on skin lesions for skin cancer are time-consuming, laborious, and complex procedures. Automatic medical image segmentation aims to expedite this…

Image and Video Processing · Electrical Eng. & Systems 2023-06-27 Akib Mohammed Khan , Alif Ashrafee , Fahim Shahriar Khan , Md. Bakhtiar Hasan , Md. Hasanul Kabir

Due to the scarcity of annotated data and the substantial computational costs of model, conventional tuning methods in medical image segmentation face critical challenges. Current approaches to adapting pretrained models, including…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Chenlin Xu , Lei Zhang , Lituan Wang , Xinyu Pu , Pengfei Ma , Guangwu Qian , Zizhou Wang , Yan Wang

Surgical tool segmentation in endoscopic images is an important problem: it is a crucial step towards full instrument pose estimation and it is used for integration of pre- and intra-operative images into the endoscopic view. While many…

Computer Vision and Pattern Recognition · Computer Science 2020-07-10 Daniil Pakhomov , Wei Shen , Nassir Navab

Segmentation is a core computer vision competency, with applications spanning a broad range of scientifically and economically valuable domains. To date, however, the prohibitive cost of annotation has limited the deployment of flexible…

Computer Vision and Pattern Recognition · Computer Science 2023-04-28 Gyungin Shin , Samuel Albanie , Weidi Xie

Foundation models have emerged as powerful tools across various domains including language, vision, and multimodal tasks. While prior works have addressed unsupervised image segmentation, they significantly lag behind supervised models. In…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Paul Couairon , Mustafa Shukor , Jean-Emmanuel Haugeard , Matthieu Cord , Nicolas Thome

Previous foundation models for fundus images were pre-trained with limited disease categories and knowledge base. Here we introduce a knowledge-rich vision-language model (RetiZero) that leverages knowledge from more than 400 fundus…

3D image segmentation is one of the most important and ubiquitous problems in medical image processing. It provides detailed quantitative analysis for accurate disease diagnosis, abnormal detection, and classification. Currently deep…

Computer Vision and Pattern Recognition · Computer Science 2019-06-19 Zhenxi Zhang , Jie Li , Zhusi Zhong , Zhicheng Jiao , Xinbo Gao

Despite that deep learning has achieved state-of-the-art performance for medical image segmentation, its success relies on a large set of manually annotated images for training that are expensive to acquire. In this paper, we propose an…

Image and Video Processing · Electrical Eng. & Systems 2021-01-01 Lu Wang , Dong Guo , Guotai Wang , Shaoting Zhang

Cross-modality image segmentation aims to segment the target modalities using a method designed in the source modality. Deep generative models can translate the target modality images into the source modality, thus enabling cross-modality…

Image and Video Processing · Electrical Eng. & Systems 2024-04-11 Zihao Wang , Yingyu Yang , Yuzhou Chen , Tingting Yuan , Maxime Sermesant , Herve Delingette , Ona Wu

The recent prevalence of deep neural networks has lead semantic segmentation networks to achieve human-level performance in the medical field when sufficient training data is provided. Such networks however fail to generalize when tasked…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Serban Stan , Mohammad Rostami

Recent work has shown that label-efficient few-shot learning through self-supervision can achieve promising medical image segmentation results. However, few-shot segmentation models typically rely on prototype representations of the…

Image and Video Processing · Electrical Eng. & Systems 2022-03-07 Stine Hansen , Srishti Gautam , Robert Jenssen , Michael Kampffmeyer

This paper investigates the use of large-scale diffusion models for Zero-Shot Video Object Segmentation (ZS-VOS) without fine-tuning on video data or training on any image segmentation data. While diffusion models have demonstrated strong…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Thanos Delatolas , Vicky Kalogeiton , Dim P. Papadopoulos

Medical image segmentation has made significant progress in recent years. Deep learning-based methods are recognized as data-hungry techniques, requiring large amounts of data with manual annotations. However, manual annotation is expensive…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 Yi Lin , Yufan Chen , Kwang-Ting Cheng , Hao Chen