English
Related papers

Related papers: Zero-Shot Gaze-based Volumetric Medical Image Segm…

200 papers

Foundation models for image segmentation have shown strong generalization in natural images, yet their applicability to 3D medical imaging remains limited. In this work, we study the zero-shot use of Segment Anything Model 2 (SAM2) for…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Miquel Lopez Escoriza , Pau Amargant Alvarez

Although new vision foundation models such as Segment Anything Model 2 (SAM2) have significantly enhanced zero-shot image segmentation capabilities, reliance on human-provided prompts poses significant challenges in adapting SAM2 to medical…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Yang Xing , Jiong Wu , Yuheng Bu , Kuang Gong

The Segment Anything Model (SAM) has demonstrated impressive performance in zero-shot promptable segmentation on natural images. The recently released Segment Anything Model 2 (SAM 2) claims to outperform SAM on images and extends the…

Image and Video Processing · Electrical Eng. & Systems 2025-04-16 Sourya Sengupta , Satrajit Chakrabarty , Ravi Soni

We introduce SAM2Point, a preliminary exploration adapting Segment Anything Model 2 (SAM 2) for zero-shot and promptable 3D segmentation. SAM2Point interprets any 3D data as a series of multi-directional videos, and leverages SAM 2 for…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Ziyu Guo , Renrui Zhang , Xiangyang Zhu , Chengzhuo Tong , Peng Gao , Chunyuan Li , Pheng-Ann Heng

Interactive Medical-SAM2 GUI is an open-source desktop application for semi-automatic annotation of 2D and 3D medical images. Built on the Napari multi-dimensional viewer, box/point prompting is integrated with SAM2-style propagation by…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Woojae Hong , Jong Ha Hwang , Jiyong Chung , Joongyeon Choi , Hyunngun Kim , Yong Hwy Kim

Foundation models have taken over natural language processing and image generation domains due to the flexibility of prompting. With the recent introduction of the Segment Anything Model (SAM), this prompt-driven paradigm has entered image…

Image and Video Processing · Electrical Eng. & Systems 2023-04-13 Saikat Roy , Tassilo Wald , Gregor Koehler , Maximilian R. Rokuss , Nico Disch , Julius Holzschuh , David Zimmerer , Klaus H. Maier-Hein

The Segment Anything Model 2 (SAM2) has recently demonstrated exceptional performance in zero-shot prompt segmentation for natural images and videos. However, when the propagation mechanism of SAM2 is applied to medical images, it often…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Yunhao Bai , Boxiang Yun , Zeli Chen , Qinji Yu , Yingda Xia , Yan Wang

Vision foundation models have achieved remarkable progress across various image analysis tasks. In the image segmentation task, foundation models like the Segment Anything Model (SAM) enable generalizable zero-shot segmentation through…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Xingxin He , Yifan Hu , Zhaoye Zhou , Mohamed Jarraya , Fang Liu

Previous work has reported that vision foundation models show promising zero-shot performance in eye image segmentation. Here we examine whether the latest iteration of the Segment Anything Model, SAM3, offers better eye image segmentation…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Diederick C. Niehorster , Marcus Nyström

Accurate organ segmentation is essential for clinical tasks such as radiotherapy planning and disease monitoring. Recent foundation models like MedSAM achieve strong results using point or bounding-box prompts but still require manual…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Wenjie Zhang , Liming Luo , Mengnan He , Jiarui Hai , Jiancheng Ye

Visual impairments present significant challenges to individuals worldwide, impacting daily activities and quality of life. Visual neuroprosthetics offer a promising solution, leveraging advancements in technology to provide a simplified…

Human-Computer Interaction · Computer Science 2025-09-25 Eleftherios Papadopoulos , Yagmur Güçlütürk

Recent advancements in large foundation models have shown promising potential in the medical industry due to their flexible prompting capability. One such model, the Segment Anything Model (SAM), a prompt-driven segmentation model, has…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Qi Wu , Yuyao Zhang , Marawan Elbatel

Image segmentation plays an essential role in medicine for both diagnostic and interventional tasks. Segmentation approaches are either manual, semi-automated or fully-automated. Manual segmentation offers full control over the quality of…

Computer Vision and Pattern Recognition · Computer Science 2019-03-21 Tomas Sakinis , Fausto Milletari , Holger Roth , Panagiotis Korfiatis , Petro Kostandy , Kenneth Philbrick , Zeynettin Akkus , Ziyue Xu , Daguang Xu , Bradley J. Erickson

A large portion of volumetric medical data, especially magnetic resonance imaging (MRI) data, is anisotropic, as the through-plane resolution is typically much lower than the in-plane resolution. Both 3D and purely 2D deep learning-based…

Image and Video Processing · Electrical Eng. & Systems 2023-11-29 Alex Ling Yu Hung , Haoxin Zheng , Kai Zhao , Xiaoxi Du , Kaifeng Pang , Qi Miao , Steven S. Raman , Demetri Terzopoulos , Kyunghyun Sung

The Segment Anything Model 2 (SAM2) has demonstrated remarkable promptable visual segmentation capabilities in video data, showing potential for extension to medical image segmentation (MIS) tasks involving 3D volumes and temporally…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Meng Lan , Lefei Zhang , Xiaomeng Li

The Segment Anything Model (SAM) has demonstrated strong and versatile segmentation capabilities, along with intuitive prompt-based interactions. However, customizing SAM for medical image segmentation requires massive amounts of…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Zhonghao Yan , Zijin Yin , Tianyu Lin , Xiangzhu Zeng , Kongming Liang , Zhanyu Ma

The Segment Anything Model (SAM) made an eye-catching debut recently and inspired many researchers to explore its potential and limitation in terms of zero-shot generalization capability. As the first promptable foundation model for…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Dongjie Cheng , Ziyuan Qin , Zekun Jiang , Shaoting Zhang , Qicheng Lao , Kang Li

We explore the transformative potential of SAM 2, a vision foundation model, in advancing gaze estimation and eye tracking technologies. By significantly reducing annotation time, lowering technical barriers through its ease of deployment,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Virmarie Maquiling , Sean Anthony Byrne , Diederick C. Niehorster , Marco Carminati , Enkelejda Kasneci

Eye gaze that reveals human observational patterns has increasingly been incorporated into solutions for vision tasks. Despite recent explorations on leveraging gaze to aid deep networks, few studies exploit gaze as an efficient annotation…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Yuan Zhong , Chenhui Tang , Yumeng Yang , Ruoxi Qi , Kang Zhou , Yuqi Gong , Pheng Ann Heng , Janet H. Hsiao , Qi Dou

Accurate vessel segmentation is critical for clinical applications such as disease diagnosis and surgical planning, yet remains challenging due to thin, branching structures and low texture contrast. While foundation models like the Segment…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Suzhong Fu , Rui Sun , Xuan Ding , Jingqi Dong , Yiming Yang , Yao Zhu , Min Chang Jordan Ren , Delin Deng , Angelica Aviles-Rivero , Shuguang Cui , Zhen Li