English
Related papers

Related papers: Memory-Augmented SAM2 for Training-Free Surgical V…

200 papers

We present CataractSAM-2, a domain-adapted extension of Meta's Segment Anything Model 2, designed for real-time semantic segmentation of cataract ophthalmic surgery videos with high accuracy. Positioned at the intersection of computer…

Autonomous-driving perception systems require robust Multi-Object Tracking (MOT) to operate reliably in dynamic environments. MOT maintains consistent object identities across frames while preserving spatial accuracy. Recent foundation…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Diogo Mendonça , Tiago Barros , Cristiano Premebida , Urbano J. Nunes

Training segmentation models for medical images continues to be challenging due to the limited availability of data annotations. Segment Anything Model (SAM) is a foundation model that is intended to segment user-defined objects of interest…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Maciej A. Mazurowski , Haoyu Dong , Hanxue Gu , Jichen Yang , Nicholas Konz , Yixin Zhang

Purpose: Accurate tumor segmentation is vital for adaptive radiation therapy (ART) but remains time-consuming and user-dependent. Segment Anything Model 2 (SAM2) shows promise for prompt-based segmentation but struggles with tumor accuracy.…

Image and Video Processing · Electrical Eng. & Systems 2025-07-28 Guoping Xu , Yan Dai , Hengrui Zhao , Ying Zhang , Jie Deng , Weiguo Lu , You Zhang

The Segment Anything Model (SAM) represents a state-of-the-art research advancement in natural image segmentation, achieving impressive results with input prompts such as points and bounding boxes. However, our evaluation and recent…

Computer Vision and Pattern Recognition · Computer Science 2023-08-31 Junlong Cheng , Jin Ye , Zhongying Deng , Jianpin Chen , Tianbin Li , Haoyu Wang , Yanzhou Su , Ziyan Huang , Jilong Chen , Lei Jiang , Hui Sun , Junjun He , Shaoting Zhang , Min Zhu , Yu Qiao

This paper presents enhancements to the SAM2 framework for video object tracking task, addressing challenges such as occlusions, background clutter, and target reappearance. We introduce a hierarchical motion estimation strategy, combining…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Ruixiang Chen , Guolei Sun , Yawei Li , Jie Qin , Luca Benini

The Segment Anything Model 2 (SAM2) has recently demonstrated exceptional performance in zero-shot prompt segmentation for natural images and videos. However, when the propagation mechanism of SAM2 is applied to medical images, it often…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Yunhao Bai , Boxiang Yun , Zeli Chen , Qinji Yu , Yingda Xia , Yan Wang

The Segment Anything Model 2 (SAM2) is a powerful foundation model for promptable segmentation. However, its high computational and memory costs are a major barrier to deployment on resource-constrained devices. In this paper, we present…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Nicola Farronato , Florian Scheidegger , Mattia Rigotti , Cristiano Malossi , Michele Magno , Haotong Qin

Surgical tool segmentation in endoscopic videos is an important component of computer assisted interventions systems. Recent success of image-based solutions using fully-supervised deep learning approaches can be attributed to the…

Computer Vision and Pattern Recognition · Computer Science 2020-07-23 Manish Sahu , Ronja Strömsdörfer , Anirban Mukhopadhyay , Stefan Zachow

Foundational models such as the Segment Anything Model (SAM) are gaining traction in medical imaging segmentation, supporting multiple downstream tasks. However, such models are supervised in nature, still relying on large annotated…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Aishik Konwer , Zhijian Yang , Erhan Bas , Cao Xiao , Prateek Prasanna , Parminder Bhatia , Taha Kass-Hout

Segmented light field images can serve as a powerful representation in many of computer vision tasks exploiting geometry and appearance of objects, such as object pose tracking. In the light field domain, segmentation presents an additional…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Nikolai Goncharov , Donald G. Dansereau

Medical image segmentation is crucial for clinical decision-making, but the scarcity of annotated data presents significant challenges. Few-shot segmentation (FSS) methods show promise but often require training on the target domain and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Lin Zhao , Xiao Chen , Eric Z. Chen , Yikang Liu , Terrence Chen , Shanhui Sun

On top of Segment Anything Model (SAM), SAM 2 further extends its capability from image to video inputs through a memory bank mechanism and obtains a remarkable performance compared with previous methods, making it a foundation model for…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Chong Zhou , Chenchen Zhu , Yunyang Xiong , Saksham Suri , Fanyi Xiao , Lemeng Wu , Raghuraman Krishnamoorthi , Bo Dai , Chen Change Loy , Vikas Chandra , Bilge Soran

Multimodal image fusion and semantic segmentation are critical for autonomous driving. Despite advancements, current models often struggle with segmenting densely packed elements due to a lack of comprehensive fusion features for guidance…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Daixun Li , Weiying Xie , Mingxiang Cao , Yunke Wang , Yusi Zhang , Leyuan Fang , Yunsong Li , Chang Xu

Segment Anything (SAM) has recently pushed the boundaries of segmentation by demonstrating zero-shot generalization and flexible prompting after training on over one billion masks. Despite this, its mask prediction accuracy often falls…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Zezhong Fan , Xiaohan Li , Topojoy Biswas , Kaushiki Nag , Kannan Achan

Video Object Segmentation and Tracking (VOST) presents a complex yet critical challenge in computer vision, requiring robust integration of segmentation and tracking across temporally dynamic frames. Traditional methods have struggled with…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Guoping Xu , Jayaram K. Udupa , Yajun Yu , Hua-Chieh Shao , Songlin Zhao , Wei Liu , You Zhang

Accurate surgical instrument segmentation is essential in cataract surgery for tasks such as skill assessment and workflow optimization. However, limited annotated data makes it difficult to develop fully automatic models. Prompt-based…

Tissues and Organs · Quantitative Biology 2025-04-11 Nuren Zhaksylyk , Ibrahim Almakky , Jay Paranjape , S. Swaroop Vedula , Shameema Sikder , Vishal M. Patel , Mohammad Yaqub

While the Segment Anything Model (SAM) excels in semantic segmentation for general-purpose images, its performance significantly deteriorates when applied to medical images, primarily attributable to insufficient representation of medical…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Yiming Zhang , Tianang Leng , Kun Han , Xiaohui Xie

Segment Anything Models (SAMs), as vision foundation models, have demonstrated remarkable performance across various image analysis tasks. Despite their strong generalization capabilities, SAMs encounter challenges in fine-grained detail…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Haoran Shen , Peixian Zhuang , Jiahao Kou , Yuxin Zeng , Haoying Xu , Jiangyun Li

Image segmentation plays an important role in vision understanding. Recently, the emerging vision foundation models continuously achieved superior performance on various tasks. Following such success, in this paper, we prove that the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Xinyu Xiong , Zihuang Wu , Shuangyi Tan , Wenxue Li , Feilong Tang , Ying Chen , Siying Li , Jie Ma , Guanbin Li