English
Related papers

Related papers: RP-SAM2: Refining Point Prompts for Stable Surgica…

200 papers

We introduce GeoSAM2, a prompt-controllable framework for 3D part segmentation that casts the task as multi-view 2D mask prediction. Given a textureless object, we render normal and point maps from predefined viewpoints and accept simple 2D…

Computer Vision and Pattern Recognition · Computer Science 2025-08-28 Ken Deng , Yunhan Yang , Jingxiang Sun , Xihui Liu , Yebin Liu , Ding Liang , Yan-Pei Cao

Purpose: Foundation models, trained on multitudes of public datasets, often require additional fine-tuning or re-prompting mechanisms to be applied to visually distinct target domains such as surgical videos. Further, without domain…

Image and Video Processing · Electrical Eng. & Systems 2025-07-02 Ssharvien Kumar Sivakumar , Yannik Frisch , Amin Ranem , Anirban Mukhopadhyay

Purpose: Accurate segmentation of prostate cancer on magnetic resonance (MR) images is crucial for planning image-guided interventions such as targeted biopsies, cryoablation, and radiotherapy. However, subtle and variable tumour…

Image and Video Processing · Electrical Eng. & Systems 2026-02-23 Junqing Yang , Natasha Thorley , Ahmed Nadeem Abbasi , Shonit Punwani , Zion Tse , Yipeng Hu , Shaheer U. Saeed

The precise tracking and segmentation of surgical instruments have led to a remarkable enhancement in the efficiency of surgical procedures. However, the challenge lies in achieving accurate segmentation of surgical instruments while…

Image and Video Processing · Electrical Eng. & Systems 2024-08-09 Jieming Yu , Long Bai , Guankun Wang , An Wang , Xiaoxiao Yang , Huxin Gao , Hongliang Ren

Accurate tongue segmentation is crucial for reliable TCM analysis. Supervised models require large annotated datasets, while SAM-family models remain prompt-driven. We present Memory-SAM, a training-free, human-prompt-free pipeline that…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Joongwon Chae , Lihui Luo , Xi Yuan , Dongmei Yu , Zhenglin Chen , Lian Zhang , Peiwu Qin

Domain adaptive segmentation (DAS) of numerous organelle instances from large-scale electron microscopy (EM) is a promising way to enable annotation-efficient learning. Inspired by SAM, we propose a promptable multitask framework, namely…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Jiabao Chen , Shan Xiong , Jialin Peng

Current methods for pathology image segmentation typically treat 2D slices independently, ignoring valuable cross-slice information. We present PathSeqSAM, a novel approach that treats 2D pathology slices as sequential video frames using…

Image and Video Processing · Electrical Eng. & Systems 2025-04-16 Mingyang Zhu , Yinting Liu , Mingyu Li , Jiacheng Wang

The Segment Anything Model (SAM) made an eye-catching debut recently and inspired many researchers to explore its potential and limitation in terms of zero-shot generalization capability. As the first promptable foundation model for…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Dongjie Cheng , Ziyuan Qin , Zekun Jiang , Shaoting Zhang , Qicheng Lao , Kang Li

The Segment Anything Model (SAM) is a deep neural network foundational model designed to perform instance segmentation which has gained significant popularity given its zero-shot segmentation ability. SAM operates by generating masks based…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Yona Falinie A. Gaus , Neelanjan Bhowmik , Brian K. S. Isaac-Medina , Toby P. Breckon

Foundation models like the Segment Anything Model (SAM) have significantly advanced promptable image segmentation in computer vision. However, extending these capabilities to videos presents substantial challenges, particularly in ensuring…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Haiyang Mei , Pengyu Zhang , Mike Zheng Shou

Segment Anything Models (SAMs), as vision foundation models, have demonstrated remarkable performance across various image analysis tasks. Despite their strong generalization capabilities, SAMs encounter challenges in fine-grained detail…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Haoran Shen , Peixian Zhuang , Jiahao Kou , Yuxin Zeng , Haoying Xu , Jiangyun Li

Promptable foundation models such as the Segment Anything Model (SAM) produce high-quality masks but remain semantically blind, relying on external prompts to specify categories. Existing vision-language approaches address this limitation…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Shayan Jalilian , Abdul Bais

The Segment Anything Model (SAM) has recently emerged as a significant breakthrough in foundation models, demonstrating remarkable zero-shot performance in object segmentation tasks. While SAM is designed for generalization, it exhibits…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Josh Stein , Maxime Di Folco , Julia A. Schnabel

Segment Anything Model 2 (SAM2) shows excellent performance in video object segmentation tasks; however, the heavy computational burden hinders its application in real-time video processing. Although there have been efforts to improve the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Jing Zhang , Zhikai Li , Xuewen Liu , Qingyi Gu

The Segment Anything Model (SAM) has recently demonstrated significant potential in medical image segmentation. Although SAM is primarily trained on 2D images, attempts have been made to apply it to 3D medical image segmentation. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Fangda Chen , Jintao Tang , Pancheng Wang , Ting Wang , Shasha Li , Ting Deng

The ability to segment objects based on open-ended language prompts remains a critical challenge, requiring models to ground textual semantics into precise spatial masks while handling diverse and unseen categories. We present OpenWorldSAM,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Shiting Xiao , Rishabh Kabra , Yuhang Li , Donghyun Lee , Joao Carreira , Priyadarshini Panda

Segment Anything Models (SAMs) like SEEM and SAM have demonstrated great potential in learning to segment anything. The core design of SAMs lies with Promptable Segmentation, which takes a handcrafted prompt as input and returns the…

Computer Vision and Pattern Recognition · Computer Science 2024-01-10 Jiaxing Huang , Kai Jiang , Jingyi Zhang , Han Qiu , Lewei Lu , Shijian Lu , Eric Xing

Segment Anything Model 2 (SAM2) exhibits strong generalisation for promptable segmentation in video clips; however, its integration with the audio modality remains underexplored. Existing approaches either convert audio into visual prompts…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Yuyuan Liu , Yuanhong Chen , Chong Wang , Junlin Han , Junde Wu , Can Peng , Jingkun Chen , Yu Tian , Gustavo Carneiro

Recent "segment anything" efforts show promise by learning from large-scale data, but adapting such models directly to medical images remains challenging due to the complexity of medical data, noisy annotations, and continual learning…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Zhiling Yan , Sifan Song , Dingjie Song , Yiwei Li , Rong Zhou , Weixiang Sun , Zhennong Chen , Sekeun Kim , Hui Ren , Tianming Liu , Quanzheng Li , Xiang Li , Lifang He , Lichao Sun

Recent advances in promptable segmentation, such as the Segment Anything Model (SAM), have enabled flexible, high-quality mask generation across a wide range of visual domains. However, SAM and similar models remain fundamentally…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Tyler Ward , Abdullah Imran