English
Related papers

Related papers: Memory-Augmented SAM2 for Training-Free Surgical V…

200 papers

The Segment Anything Model 2 (SAM 2) has emerged as a powerful foundation model for object segmentation in both images and videos, paving the way for various downstream video applications. The crucial design of SAM 2 for video segmentation…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Shuangrui Ding , Rui Qian , Xiaoyi Dong , Pan Zhang , Yuhang Zang , Yuhang Cao , Yuwei Guo , Dahua Lin , Jiaqi Wang

The Segment Anything Model 2 (SAM 2) is the latest generation foundation model for image and video segmentation. Trained on the expansive Segment Anything Video (SA-V) dataset, which comprises 35.5 million masks across 50.9K videos, SAM 2…

Image and Video Processing · Electrical Eng. & Systems 2024-08-06 Ange Lou , Yamin Li , Yike Zhang , Robert F. Labadie , Jack Noble

Surgical video segmentation is a critical task in computer-assisted surgery and is vital for enhancing surgical quality and patient outcomes. Recently, the Segment Anything Model 2 (SAM2) framework has shown superior advancements in image…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Haofeng Liu , Erli Zhang , Junde Wu , Mingxuan Hong , Yueming Jin

Surgical video segmentation is critical for AI to interpret spatial-temporal dynamics in surgery, yet model performance is constrained by limited annotated data. The SAM2 model, pretrained on natural videos, offers potential for zero-shot…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Cheng Yuan , Jian Jiang , Kunyi Yang , Lv Wu , Rui Wang , Zi Meng , Haonan Ping , Ziyu Xu , Yifan Zhou , Wanli Song , Hesheng Wang , Yueming Jin , Qi Dou , Yutong Ban

Promptable video object segmentation and tracking (VOST) has seen significant advances with the emergence of foundation models like Segment Anything Model 2 (SAM2); however, their application in surgical video analysis remains challenging…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Guoping Xu , Hua-Chieh Shao , You Zhang

The reliance on large labeled datasets presents a significant challenge in medical image segmentation. Few-shot learning offers a potential solution, but existing methods often still require substantial training data. This paper proposes a…

Image and Video Processing · Electrical Eng. & Systems 2025-03-10 Haiyue Zu , Jun Ge , Heting Xiao , Jile Xie , Zhangzhe Zhou , Yifan Meng , Jiayi Ni , Junjie Niu , Linlin Zhang , Li Ni , Huilin Yang

Surgical video segmentation is crucial for computer-assisted surgery, enabling precise localization and tracking of instruments and tissues. Interactive Video Object Segmentation (iVOS) models such as Segment Anything Model 2 (SAM2) provide…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Haofeng Liu , Ziyue Wang , Sudhanshu Mishra , Mingqi Gao , Guanyi Qin , Chang Han Low , Alex Y. W. Kong , Yueming Jin

Fully supervised deep learning (DL) models for surgical video segmentation have been shown to struggle with non-adversarial, real-world corruptions of image quality including smoke, bleeding, and low illumination. Foundation models for…

Image and Video Processing · Electrical Eng. & Systems 2024-08-19 Yiqing Shen , Hao Ding , Xinyuan Shao , Mathias Unberath

We present Segment Anything Model 2 (SAM 2), a foundation model towards solving promptable visual segmentation in images and videos. We build a data engine, which improves model and data via user interaction, to collect the largest video…

The recent Segment Anything Model (SAM) 2 has demonstrated remarkable foundational competence in semantic segmentation, with its memory mechanism and mask decoder further addressing challenges in video tracking and object occlusion, thereby…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Jieming Yu , An Wang , Wenzhen Dong , Mengya Xu , Mobarakol Islam , Jie Wang , Long Bai , Hongliang Ren

Medical image segmentation plays a pivotal role in clinical diagnostics and treatment planning, yet existing models often face challenges in generalization and in handling both 2D and 3D data uniformly. In this paper, we introduce Medical…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Jiayuan Zhu , Abdullah Hamdi , Yunli Qi , Yueming Jin , Junde Wu

The Segment Anything Model (SAM) is a powerful vision foundation model that is revolutionizing the traditional paradigm of segmentation. Despite this, a reliance on prompting each frame and large computational cost limit its usage in…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Zijian Wu , Adam Schmidt , Peter Kazanzides , Septimiu E. Salcudean

Recent "segment anything" efforts show promise by learning from large-scale data, but adapting such models directly to medical images remains challenging due to the complexity of medical data, noisy annotations, and continual learning…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Zhiling Yan , Sifan Song , Dingjie Song , Yiwei Li , Rong Zhou , Weixiang Sun , Zhennong Chen , Sekeun Kim , Hui Ren , Tianming Liu , Quanzheng Li , Xiang Li , Lifang He , Lichao Sun

Recent advances in medical image segmentation have been driven by deep learning; however, most existing methods remain limited by modality-specific designs and exhibit poor adaptability to dynamic medical imaging scenarios. The Segment…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Guoping Xu , Christopher Kabat , You Zhang

The unprecedented developments in segmentation foundational models have become a dominant force in the field of computer vision, introducing a multitude of previously unexplored capabilities in a wide range of natural images and videos.…

Computer Vision and Pattern Recognition · Computer Science 2024-08-26 Yichi Zhang , Zhenrong Shen

The Segmentation Anything Model 2 (SAM2) has proven to be a powerful foundation model for promptable visual object segmentation in both images and videos, capable of storing object-aware memories and transferring them temporally through…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Syed Hesham Syed Ariff , Yun Liu , Guolei Sun , Jing Yang , Henghui Ding , Xue Geng , Xudong Jiang

Despite significant advances in deep learning for image and video segmentation, existing models continue to face challenges in cross-domain adaptability and generalization. Image and video segmentation are fundamental tasks in computer…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Zhang Jiaxing , Tang Hao

Ultrasound (US) video segmentation remains a challenging problem due to strong inter- and intra-dataset variability, motion artifacts, and limited annotated data. Although foundation models such as Segment Anything Model 2 (SAM2)…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Xing Yao , Ahana Gangopadhyay , Hsi-Ming Chang , Ravi Soni

Surgical scene segmentation is critical in computer-assisted surgery and is vital for enhancing surgical quality and patient outcomes. Recently, referring surgical segmentation is emerging, given its advantage of providing surgeons with an…

Computer Vision and Pattern Recognition · Computer Science 2025-05-14 Haofeng Liu , Mingqi Gao , Xuxiao Luo , Ziyue Wang , Guanyi Qin , Junde Wu , Yueming Jin

The Segment Anything Model 2 (SAM2) has demonstrated remarkable promptable visual segmentation capabilities in video data, showing potential for extension to medical image segmentation (MIS) tasks involving 3D volumes and temporally…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Meng Lan , Lefei Zhang , Xiaomeng Li
‹ Prev 1 2 3 10 Next ›