English
Related papers

Related papers: Zero-Shot Gaze-based Volumetric Medical Image Segm…

200 papers

Segment Anything Model (SAM) has demonstrated impressive zero-shot performance and brought a range of unexplored capabilities to natural image segmentation tasks. However, as a very important branch of image segmentation, the performance of…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Bin Xie , Hao Tang , Dawen Cai , Yan Yan , Gady Agam

Existing volumetric medical image segmentation models are typically task-specific, excelling at specific target but struggling to generalize across anatomical structures or modalities. This limitation restricts their broader clinical use.…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Haoyu Wang , Sizheng Guo , Jin Ye , Zhongying Deng , Junlong Cheng , Tianbin Li , Jianpin Chen , Yanzhou Su , Ziyan Huang , Yiqing Shen , Bin Fu , Shaoting Zhang , Junjun He , Yu Qiao

The recent Segment Anything Model (SAM) 2 has demonstrated remarkable foundational competence in semantic segmentation, with its memory mechanism and mask decoder further addressing challenges in video tracking and object occlusion, thereby…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Jieming Yu , An Wang , Wenzhen Dong , Mengya Xu , Mobarakol Islam , Jie Wang , Long Bai , Hongliang Ren

The Segment Anything Model (SAM) and similar models build a family of promptable foundation models (FMs) for image and video segmentation. The object of interest is identified using prompts, such as bounding boxes or points. With these FMs…

Computer Vision and Pattern Recognition · Computer Science 2024-11-14 Caroline Magg , Hoel Kervadec , Clara I. Sánchez

Medical image segmentation is fundamental for biomedical discovery. Existing methods lack generalizability and demand extensive, time-consuming manual annotation for new clinical application. Here, we propose MedSAM-3, a text promptable…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Anglin Liu , Rundong Xue , Xu R. Cao , Yifan Shen , Yi Lu , Xiang Li , Qianqian Chen , Jintai Chen

The Segment Anything Model (SAM) has achieved a notable success in two-dimensional image segmentation in natural images. However, the substantial gap between medical and natural images hinders its direct application to medical image…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Quan Quan , Fenghe Tang , Zikang Xu , Heqin Zhu , S. Kevin Zhou

Due to low tissue contrast, irregular object appearance, and unpredictable location variation, segmenting the objects from different medical imaging modalities (e.g., CT, MR) is considered as an important yet challenging task. In this…

Computer Vision and Pattern Recognition · Computer Science 2018-05-10 Jinquan Sun , Yinghuan Shi , Yang Gao , Lei Wang , Luping Zhou , Wanqi Yang , Dinggang Shen

Accurate segmentation of 3D medical images is critical for clinical applications like disease assessment and treatment planning. While the Segment Anything Model 2 (SAM2) has shown remarkable success in video object segmentation by…

Image and Video Processing · Electrical Eng. & Systems 2025-10-13 Yeqing Yang , Le Xu , Lixia Tian

The Segment Anything Model (SAM), a foundation model for general image segmentation, has demonstrated impressive zero-shot performance across numerous natural image segmentation tasks. However, SAM's performance significantly declines when…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Cheng Chen , Juzheng Miao , Dufan Wu , Zhiling Yan , Sekeun Kim , Jiang Hu , Aoxiao Zhong , Zhengliang Liu , Lichao Sun , Xiang Li , Tianming Liu , Pheng-Ann Heng , Quanzheng Li

Breast MRI provides high-resolution volumetric imaging critical for tumor assessment and treatment planning, yet manual interpretation of 3D scans remains labor-intensive and subjective. While AI-powered tools hold promise for accelerating…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Solha Kang , Eugene Kim , Joris Vankerschaver , Utku Ozbulak

Since the release of Segment Anything 2 (SAM2), the medical imaging community has been actively evaluating its performance for 3D medical image segmentation. However, different studies have employed varying evaluation pipelines, resulting…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Yufan He , Pengfei Guo , Yucheng Tang , Andriy Myronenko , Vishwesh Nath , Ziyue Xu , Dong Yang , Can Zhao , Daguang Xu , Wenqi Li

We introduce GeoSAM2, a prompt-controllable framework for 3D part segmentation that casts the task as multi-view 2D mask prediction. Given a textureless object, we render normal and point maps from predefined viewpoints and accept simple 2D…

Computer Vision and Pattern Recognition · Computer Science 2025-08-28 Ken Deng , Yunhan Yang , Jingxiang Sun , Xihui Liu , Yebin Liu , Ding Liang , Yan-Pei Cao

Medical image and video segmentation is a critical task for precision medicine, which has witnessed considerable progress in developing task or modality-specific and generalist models for 2D images. However, there have been limited studies…

Image and Video Processing · Electrical Eng. & Systems 2025-04-07 Jun Ma , Zongxin Yang , Sumin Kim , Bihui Chen , Mohammed Baharoon , Adibvafa Fallahpour , Reza Asakereh , Hongwei Lyu , Bo Wang

We introduce SAM3D, a new approach to semi-automatic zero-shot segmentation of 3D images building on the existing Segment Anything Model. We achieve fast and accurate segmentations in 3D images with a four-step strategy involving: user…

Image and Video Processing · Electrical Eng. & Systems 2024-08-09 Trevor J. Chan , Aarush Sahni , Yijin Fang , Jie Li , Alisha Luthra , Alison Pouch , Chamith S. Rajapakse

Intelligent medical image segmentation methods are rapidly evolving and being increasingly applied, yet they face the challenge of domain transfer, where algorithm performance degrades due to different data distributions between source and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-12 Andrew Seohwan Yu , Mohsen Hariri , Xuecen Zhang , Mingrui Yang , Vipin Chaudhary , Xiaojuan Li

Image segmentation remains a pivotal component in medical image analysis, aiding in the extraction of critical information for precise diagnostic practices. With the advent of deep learning, automated image segmentation methods have risen…

Image and Video Processing · Electrical Eng. & Systems 2024-03-07 Nhat-Tan Bui , Dinh-Hieu Hoang , Minh-Triet Tran , Gianfranco Doretto , Donald Adjeroh , Brijesh Patel , Arabinda Choudhary , Ngan Le

Volumetric segmentation is important in medical imaging, but current methods face challenges like requiring lots of manual annotations and being tailored to specific tasks, which limits their versatility. General segmentation models used…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Zifan Chen , Xinyu Nan , Jiazheng Li , Jie Zhao , Haifeng Li , Ziling Lin , Haoshen Li , Heyun Chen , Yiting Liu , Lei Tang , Li Zhang , Bin Dong

Promptable segmentation, introduced by the Segment Anything Model (SAM), is a promising approach for medical imaging, as it enables clinicians to guide and refine model predictions interactively. However, SAM's architecture is designed for…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Théo Danielou , Daniel Tordjman , Pierre Manceron , Corentin Dancette

This study presents a novel multimodal medical image zero-shot segmentation algorithm named the text-visual-prompt segment anything model (TV-SAM) without any manual annotations. The TV-SAM incorporates and integrates the large language…

Interactive segmentation is a promising strategy for building robust, generalisable algorithms for volumetric medical image segmentation. However, inconsistent and clinically unrealistic evaluation hinders fair comparison and misrepresents…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Parhom Esmaeili , Virginia Fernandez , Pedro Borges , Eli Gibson , Sebastien Ourselin , M. Jorge Cardoso