English
Related papers

Related papers: Memory-Augmented SAM2 for Training-Free Surgical V…

200 papers

The Segment Anything Model (SAM), a foundation model for general image segmentation, has demonstrated impressive zero-shot performance across numerous natural image segmentation tasks. However, SAM's performance significantly declines when…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Cheng Chen , Juzheng Miao , Dufan Wu , Zhiling Yan , Sekeun Kim , Jiang Hu , Aoxiao Zhong , Zhengliang Liu , Lichao Sun , Xiang Li , Tianming Liu , Pheng-Ann Heng , Quanzheng Li

The Segment Anything Model 2 (SAM2) has emerged as a foundation model for universal segmentation. Owing to its generalizable visual representations, SAM2 has been successfully applied to various downstream tasks. However, extending SAM2 to…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Jiyuan Liu , Jia Lin , Xiaofei Zhou , Runmin Cong , Deyang Liu , Zhi Liu

Video object segmentation (VOS) is a critical task in the development of video perception and understanding. The Segment-Anything Model 2 (SAM 2), released by Meta AI, is the current state-of-the-art architecture for end-to-end VOS. SAM 2…

Image and Video Processing · Electrical Eng. & Systems 2025-05-14 Clayton Bromley , Alexander Moore , Amar Saini , Doug Poland , Carmen Carrano

This paper presents MirrorSAM2, the first framework that adapts Segment Anything Model 2 (SAM2) to the task of RGB-D video mirror segmentation. MirrorSAM2 addresses key challenges in mirror detection, such as reflection ambiguity and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Mingchen Xu , Yukun Lai , Ze Ji , Jing Wu

Video camouflaged object segmentation (VCOS), aiming at segmenting camouflaged objects that seamlessly blend into their environment, is a fundamental vision task with various real-world applications. With the release of SAM2, video…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Yuli Zhou , Yawei Li , Yuqian Fu , Luca Benini , Ender Konukoglu , Guolei Sun

Interactive medical image segmentation (IMIS) has shown significant potential in enhancing segmentation accuracy by integrating iterative feedback from medical professionals. However, the limited availability of enough 3D medical data…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Chuyun Shen , Wenhao Li , Yuhang Shi , Xiangfeng Wang

Video Object Segmentation (VOS) task aims to segmenting a particular object instance throughout the entire video sequence given only the object mask of the first frame. Recently, Segment Anything Model 2 (SAM 2) is proposed, which is a…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Feiyu Pan , Hao Fang , Runmin Cong , Wei Zhang , Xiankai Lu

The Segment Anything Model (SAM), developed by Meta AI Research, represents a significant breakthrough in computer vision, offering a robust framework for image and video segmentation. This survey provides a comprehensive exploration of the…

Real-time video segmentation is a promising opportunity for AI-assisted surgery, offering intraoperative guidance by identifying tools and anatomical structures. Despite growing interest in surgical video segmentation, annotation protocols…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Utku Ozbulak , Seyed Amir Mousavi , Francesca Tozzi , Niki Rashidian , Wouter Willaert , Wesley De Neve , Joris Vankerschaver

Tracking cells and detecting mitotic events in time-lapse microscopy image sequences is a crucial task in biomedical research. However, it remains highly challenging due to dividing objects, low signal-tonoise ratios, indistinct boundaries,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-15 Zhu Chen , Mert Edgü , Er Jin , Johannes Stegmaier

Accurate segmentation of 3D medical images is critical for clinical applications like disease assessment and treatment planning. While the Segment Anything Model 2 (SAM2) has shown remarkable success in video object segmentation by…

Image and Video Processing · Electrical Eng. & Systems 2025-10-13 Yeqing Yang , Le Xu , Lixia Tian

The Segment Anything Model (SAM) has demonstrated impressive performance in zero-shot promptable segmentation on natural images. The recently released Segment Anything Model 2 (SAM 2) claims to outperform SAM on images and extends the…

Image and Video Processing · Electrical Eng. & Systems 2025-04-16 Sourya Sengupta , Satrajit Chakrabarty , Ravi Soni

As the successor to the Segment Anything Model (SAM), the Segment Anything Model 2 (SAM2) not only improves performance in image segmentation but also extends its capabilities to video segmentation. However, its effectiveness in segmenting…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Leiping Jie

Few-shot semantic segmentation has recently attracted great attention. The goal is to develop a model capable of segmenting unseen classes using only a few annotated samples. Most existing approaches adapt a pre-trained model by training…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Bernardo Forni , Gabriele Lombardi , Federico Pozzi , Mirco Planamente

The Segment Anything Model (SAM) family has become a widely adopted vision foundation model, but its ability to control segmentation granularity remains limited. Users often need to refine results manually - by adding more prompts or…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Junwei Yu , Trevor Darrell , XuDong Wang

Video segmentation is essential for advancing robotics and autonomous driving, particularly in open-world settings where continuous perception and object association across video frames are critical. While the Segment Anything Model (SAM)…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Pinxue Guo , Zixu Zhao , Jianxiong Gao , Chongruo Wu , Tong He , Zheng Zhang , Tianjun Xiao , Wenqiang Zhang

Accurate surgical instrument segmentation in endoscopy is crucial for computer-assisted interventions, yet remains challenging due to frequent occlusions, rapid motion, and long-term instrument re-entry. While SAM3 provides a powerful…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Valay Bundele , Mehran Hosseinzadeh , Hendrik P. A. Lensch

Segment Anything 3 (SAM3) has established a powerful foundation that robustly detects, segments, and tracks specified targets in videos. However, in its original implementation, its group-level collective memory selection is suboptimal for…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Ruiqi Shen , Chang Liu , Henghui Ding

Segment Anything Model (SAM) has demonstrated powerful zero-shot segmentation performance in natural scenes. The recently released Segment Anything Model 2 (SAM2) has further heightened researchers' expectations towards image segmentation…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Jialun Pei , Zhangjun Zhou , Tiantian Zhang

Medical image segmentation and video object segmentation are essential for diagnosing and analyzing diseases by identifying and measuring biological structures. Recent advances in natural domain have been driven by foundation models like…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Zhiling Yan , Weixiang Sun , Rong Zhou , Zhengqing Yuan , Kai Zhang , Yiwei Li , Tianming Liu , Quanzheng Li , Xiang Li , Lifang He , Lichao Sun