English
Related papers

Related papers: How to build the best medical image segmentation a…

200 papers

Segment Anything (SAM) has recently pushed the boundaries of segmentation by demonstrating zero-shot generalization and flexible prompting after training on over one billion masks. Despite this, its mask prediction accuracy often falls…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Zezhong Fan , Xiaohan Li , Topojoy Biswas , Kaushiki Nag , Kannan Achan

Image segmentation is a long-standing challenge in computer vision, studied continuously over several decades, as evidenced by seminal algorithms such as N-Cut, FCN, and MaskFormer. With the advent of foundation models (FMs), contemporary…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Tianfei Zhou , Wang Xia , Fei Zhang , Boyu Chang , Wenguan Wang , Ye Yuan , Ender Konukoglu , Daniel Cremers

Nuclei instance segmentation is critical in computational pathology for cancer diagnosis and prognosis. Recently, the Segment Anything Model has demonstrated exceptional performance in various segmentation tasks, leveraging its rich priors…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Jingze Su , Tianle Zhu , Jiaxin Cai , Zhiyi Wang , Qi Li , Xiao Zhang , Tong Tong , Shu Wang , Wenxi Liu

We explore the feasibility and potential of building a ground-truth-free evaluation model to assess the quality of segmentations generated by the Segment Anything Model (SAM) and its variants in medical imaging. This evaluation model…

Image and Video Processing · Electrical Eng. & Systems 2024-09-25 Ahjol Senbi , Tianyu Huang , Fei Lyu , Qing Li , Yuhui Tao , Wei Shao , Qiang Chen , Chengyan Wang , Shuo Wang , Tao Zhou , Yizhe Zhang

Foundation models like SAM (Segment Anything Model) exhibit strong zero-shot image segmentation performance, but often fall short on domain-specific tasks. Fine-tuning these models typically requires significant manual effort and domain…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Breenda Das , Lennart Purucker , Timur Carstensen , Frank Hutter

Deep learning-based medical image segmentation typically requires large amount of labeled data for training, making it less applicable in clinical settings due to high annotation cost. Semi-supervised learning (SSL) has emerged as an…

Image and Video Processing · Electrical Eng. & Systems 2025-03-03 Yichi Zhang , Bohao Lv , Le Xue , Wenbo Zhang , Yuchen Liu , Yu Fu , Yuan Cheng , Yuan Qi

The recently introduced Segment Anything Model (SAM) combines a clever architecture and large quantities of training data to obtain remarkable image segmentation capabilities. However, it fails to reproduce such results for…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Tal Shaharabany , Aviad Dahan , Raja Giryes , Lior Wolf

Foundation segmentation models such as SAM and SAM-2 perform well on natural images but struggle with brain MRIs where structures like the caudate and thalamus lack sharp boundaries and have low contrast. Rather than fine tune these models…

Image and Video Processing · Electrical Eng. & Systems 2025-11-26 Keith Moore

The introduction of saliency map algorithms as an approach for assessing the interoperability of images has allowed for a deeper understanding of current black-box models with Artificial Intelligence. Their rise in popularity has led to…

Image and Video Processing · Electrical Eng. & Systems 2023-06-29 Evan Kellener , Ihina Nath , An Ngo , Thomas Nguyen , Joshua Schuman , Coen Adler , Arnav Kartikeya

In this study, we evaluate the performance of the Segment Anything Model (SAM) in clinical radiotherapy. Our results indicate that SAM's 'segment anything' mode can achieve clinically acceptable segmentation results in most organs-at-risk…

Image and Video Processing · Electrical Eng. & Systems 2023-07-06 Lian Zhang , Zhengliang Liu , Lu Zhang , Zihao Wu , Xiaowei Yu , Jason Holmes , Hongying Feng , Haixing Dai , Xiang Li , Quanzheng Li , Dajiang Zhu , Tianming Liu , Wei Liu

Summary: SAMRI is an MRI-specialized adaptation of the Segment Anything Model achieving superior whole-body MRI segmentation, particularly for small and clinically critical structures, through box and point prompts for rapid annotation.…

Image and Video Processing · Electrical Eng. & Systems 2026-05-19 Zhao Wang , Wei Dai , Thuy Thanh Dao , Steffen Bollmann , Hongfu Sun , Craig Engstrom , Shekhar S. Chandra

We present ENSAM (Equivariant, Normalized, Segment Anything Model), a lightweight and promptable model for universal 3D medical image segmentation. ENSAM combines a SegResNet-based encoder with a prompt encoder and mask decoder in a…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Elias Stenhede , Agnar Martin Bjørnstad , Arian Ranjbar

Medical image and video segmentation is a critical task for precision medicine, which has witnessed considerable progress in developing task or modality-specific and generalist models for 2D images. However, there have been limited studies…

Image and Video Processing · Electrical Eng. & Systems 2025-04-07 Jun Ma , Zongxin Yang , Sumin Kim , Bihui Chen , Mohammed Baharoon , Adibvafa Fallahpour , Reza Asakereh , Hongwei Lyu , Bo Wang

The semantic segmentation task in pathology plays an indispensable role in assisting physicians in determining the condition of tissue lesions. With the proposal of Segment Anything Model (SAM), more and more foundation models have seen…

Image and Video Processing · Electrical Eng. & Systems 2024-09-05 Mingya Zhang , Liang Wang , Zhihao Chen , Yiyuan Ge , Xianping Tao

We present Segment Anything Model 2 (SAM 2), a foundation model towards solving promptable visual segmentation in images and videos. We build a data engine, which improves model and data via user interaction, to collect the largest video…

The recent Segment Anything Models (SAMs) have emerged as foundational visual models for general interactive segmentation. Despite demonstrating robust generalization abilities, they still suffer performance degradations in scenarios…

Computer Vision and Pattern Recognition · Computer Science 2025-02-17 Yuan Yao , Qiushi Yang , Miaomiao Cui , Liefeng Bo

Image registration is a fundamental task in medical image analysis. Deformations are often closely related to the morphological characteristics of tissues, making accurate feature extraction crucial. Recent weakly supervised methods improve…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Yue He , Min Liu , Qinghao Liu , Jiazheng Wang , Yaonan Wang , Hang Zhang , Xiang Chen

Medical image segmentation has advanced rapidly over the past two decades, largely driven by deep learning, which has enabled accurate and efficient delineation of cells, tissues, organs, and pathologies across diverse imaging modalities.…

Image and Video Processing · Electrical Eng. & Systems 2025-08-29 Guoping Xu , Jayaram K. Udupa , Jax Luo , Songlin Zhao , Yajun Yu , Scott B. Raymond , Hao Peng , Lipeng Ning , Yogesh Rathi , Wei Liu , You Zhang

We introduce SAM3D, a new approach to semi-automatic zero-shot segmentation of 3D images building on the existing Segment Anything Model. We achieve fast and accurate segmentations in 3D images with a four-step strategy involving: user…

Image and Video Processing · Electrical Eng. & Systems 2024-08-09 Trevor J. Chan , Aarush Sahni , Yijin Fang , Jie Li , Alisha Luthra , Alison Pouch , Chamith S. Rajapakse

In the realm of artificial intelligence, the emergence of foundation models, backed by high computing capabilities and extensive data, has been revolutionary. Segment Anything Model (SAM), built on the Vision Transformer (ViT) model with…

Computer Vision and Pattern Recognition · Computer Science 2024-01-05 Xinyang Pu , Hecheng Jia , Linghao Zheng , Feng Wang , Feng Xu