中文
相关论文

相关论文: SAMURAI: Adapting Segment Anything Model for Zero-…

200 篇论文

Video Object Segmentation (VOS) task aims to segmenting a particular object instance throughout the entire video sequence given only the object mask of the first frame. Recently, Segment Anything Model 2 (SAM 2) is proposed, which is a…

计算机视觉与模式识别 · 计算机科学 2024-08-27 Feiyu Pan , Hao Fang , Runmin Cong , Wei Zhang , Xiankai Lu

Tracking cells and detecting mitotic events in time-lapse microscopy image sequences is a crucial task in biomedical research. However, it remains highly challenging due to dividing objects, low signal-tonoise ratios, indistinct boundaries,…

计算机视觉与模式识别 · 计算机科学 2025-09-15 Zhu Chen , Mert Edgü , Er Jin , Johannes Stegmaier

We present an effective approach for adapting the Segment Anything Model 2 (SAM2) to the Visual Object Tracking (VOT) task. Our method leverages the powerful pre-trained capabilities of SAM2 and incorporates several key techniques to…

计算机视觉与模式识别 · 计算机科学 2025-05-26 Cheng-Yen Yang , Hsiang-Wei Huang , Pyong-Kun Kim , Chien-Kai Kuo , Jui-Wei Chang , Kwang-Ju Kim , Chung-I Huang , Jenq-Neng Hwang

The advent of foundation models signals a new era in artificial intelligence. The Segment Anything Model (SAM) is the first foundation model for image segmentation. In this study, we evaluate SAM's ability to segment features from eye…

计算机视觉与模式识别 · 计算机科学 2024-04-09 Virmarie Maquiling , Sean Anthony Byrne , Diederick C. Niehorster , Marcus Nyström , Enkelejda Kasneci

Research has focused on Multi-Modal Semantic Segmentation (MMSS), where pixel-wise predictions are derived from multiple visual modalities captured by diverse sensors. Recently, the large vision model, Segment Anything Model 2 (SAM2), has…

计算机视觉与模式识别 · 计算机科学 2025-03-24 Chenfei Liao , Xu Zheng , Yuanhuiyi Lyu , Haiwei Xue , Yihong Cao , Jiawen Wang , Kailun Yang , Xuming Hu

Recent advances in medical image segmentation have been driven by deep learning; however, most existing methods remain limited by modality-specific designs and exhibit poor adaptability to dynamic medical imaging scenarios. The Segment…

计算机视觉与模式识别 · 计算机科学 2025-09-09 Guoping Xu , Christopher Kabat , You Zhang

The Segment Anything Model (SAM) is a deep neural network foundational model designed to perform instance segmentation which has gained significant popularity given its zero-shot segmentation ability. SAM operates by generating masks based…

计算机视觉与模式识别 · 计算机科学 2024-04-19 Yona Falinie A. Gaus , Neelanjan Bhowmik , Brian K. S. Isaac-Medina , Toby P. Breckon

As the successor to the Segment Anything Model (SAM), the Segment Anything Model 2 (SAM2) not only improves performance in image segmentation but also extends its capabilities to video segmentation. However, its effectiveness in segmenting…

计算机视觉与模式识别 · 计算机科学 2024-12-30 Leiping Jie

This paper presents enhancements to the SAM2 framework for video object tracking task, addressing challenges such as occlusions, background clutter, and target reappearance. We introduce a hierarchical motion estimation strategy, combining…

计算机视觉与模式识别 · 计算机科学 2025-09-03 Ruixiang Chen , Guolei Sun , Yawei Li , Jie Qin , Luca Benini

The recent Segment Anything Model (SAM) 2 has demonstrated remarkable foundational competence in semantic segmentation, with its memory mechanism and mask decoder further addressing challenges in video tracking and object occlusion, thereby…

计算机视觉与模式识别 · 计算机科学 2024-08-09 Jieming Yu , An Wang , Wenzhen Dong , Mengya Xu , Mobarakol Islam , Jie Wang , Long Bai , Hongliang Ren

Segmentation is an essential step for remote sensing image processing. This study aims to advance the application of the Segment Anything Model (SAM), an innovative image segmentation model by Meta AI, in the field of remote sensing image…

Segment Anything Model 2 (SAM2) shows excellent performance in video object segmentation tasks; however, the heavy computational burden hinders its application in real-time video processing. Although there have been efforts to improve the…

计算机视觉与模式识别 · 计算机科学 2026-02-11 Jing Zhang , Zhikai Li , Xuewen Liu , Qingyi Gu

Robust long-term tracking of drone is a critical requirement for modern surveillance systems, given their increasing threat potential. While detector-based approaches typically achieve strong frame-level accuracy, they often suffer from…

计算机视觉与模式识别 · 计算机科学 2026-01-09 Tamara R. Lenhard , Andreas Weinmann , Hichem Snoussi , Tobias Koch

Segment Anything Model (SAM) has demonstrated powerful zero-shot segmentation performance in natural scenes. The recently released Segment Anything Model 2 (SAM2) has further heightened researchers' expectations towards image segmentation…

计算机视觉与模式识别 · 计算机科学 2024-10-03 Jialun Pei , Zhangjun Zhou , Tiantian Zhang

The Segment Anything Model (SAM), developed by Meta AI Research, represents a significant breakthrough in computer vision, offering a robust framework for image and video segmentation. This survey provides a comprehensive exploration of the…

We explore the transformative potential of SAM 2, a vision foundation model, in advancing gaze estimation and eye tracking technologies. By significantly reducing annotation time, lowering technical barriers through its ease of deployment,…

计算机视觉与模式识别 · 计算机科学 2025-01-14 Virmarie Maquiling , Sean Anthony Byrne , Diederick C. Niehorster , Marco Carminati , Enkelejda Kasneci

Segmentation in medical imaging is a critical component for the diagnosis, monitoring, and treatment of various diseases and medical conditions. Presently, the medical segmentation landscape is dominated by numerous specialized deep…

Video segmentation is essential for advancing robotics and autonomous driving, particularly in open-world settings where continuous perception and object association across video frames are critical. While the Segment Anything Model (SAM)…

计算机视觉与模式识别 · 计算机科学 2024-10-14 Pinxue Guo , Zixu Zhao , Jianxiong Gao , Chongruo Wu , Tong He , Zheng Zhang , Tianjun Xiao , Wenqiang Zhang

Memory-based trackers are video object segmentation methods that form the target model by concatenating recently tracked frames into a memory buffer and localize the target by attending the current image to the buffered frames. While…

计算机视觉与模式识别 · 计算机科学 2024-12-05 Jovana Videnovic , Alan Lukezic , Matej Kristan

Recently, promptable segmentation models, such as the Segment Anything Model (SAM), have demonstrated robust zero-shot generalization capabilities on static images. These promptable models exhibit denoising abilities for imprecise prompt…

计算机视觉与模式识别 · 计算机科学 2024-03-08 Tao Zhou , Wenhan Luo , Qi Ye , Zhiguo Shi , Jiming Chen