English
Related papers

Related papers: Evaluating SAM2 for Video Semantic Segmentation

200 papers

Image segmentation plays an important role in vision understanding. Recently, the emerging vision foundation models continuously achieved superior performance on various tasks. Following such success, in this paper, we prove that the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Xinyu Xiong , Zihuang Wu , Shuangyi Tan , Wenxue Li , Feilong Tang , Ying Chen , Siying Li , Jie Ma , Guanbin Li

Segment Anything Model 2 (SAM 2) has emerged as a powerful tool for video object segmentation and tracking anything. Key components of SAM 2 that drive the impressive video object segmentation performance include a large multistage image…

\noindent Memory has become the central mechanism enabling robust visual object tracking in modern segmentation-based frameworks. Recent methods built upon Segment Anything Model 2 (SAM2) have demonstrated strong performance by refining how…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Mohamad Alansari , Muzammal Naseer , Hasan Al Marzouqi , Naoufel Werghi , Sajid Javed

Manual annotation of volumetric medical images, such as magnetic resonance imaging (MRI) and computed tomography (CT), is a labor-intensive and time-consuming process. Recent advancements in foundation models for video object segmentation,…

Image and Video Processing · Electrical Eng. & Systems 2025-11-04 Yuwen Chen , Zafer Yildiz , Qihang Li , Yaqian Chen , Haoyu Dong , Hanxue Gu , Nicholas Konz , Maciej A. Mazurowski

The Segment Anything Model (SAM), developed by Meta AI Research, represents a significant breakthrough in computer vision, offering a robust framework for image and video segmentation. This survey provides a comprehensive exploration of the…

As large-scale foundation models trained on billions of image--mask pairs covering a vast diversity of scenes, objects, and contexts, SAM and its upgraded version, SAM~2, have significantly influenced multiple fields within computer vision.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Xiaoqi Zhao , Youwei Pang , Shijie Chang , Yuan Zhao , Lihe Zhang , Chenyang Yu , Hanqi Liu , Jiaming Zuo , Jinsong Ouyang , Weisi Lin , Georges El Fakhri , Huchuan Lu , Xiaofeng Liu

This paper presents MirrorSAM2, the first framework that adapts Segment Anything Model 2 (SAM2) to the task of RGB-D video mirror segmentation. MirrorSAM2 addresses key challenges in mirror detection, such as reflection ambiguity and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Mingchen Xu , Yukun Lai , Ze Ji , Jing Wu

The unprecedented developments in segmentation foundational models have become a dominant force in the field of computer vision, introducing a multitude of previously unexplored capabilities in a wide range of natural images and videos.…

Computer Vision and Pattern Recognition · Computer Science 2024-08-26 Yichi Zhang , Zhenrong Shen

Referring video object segmentation (RVOS) requires tracking and segmenting an object throughout a video according to a given natural language expression, demanding both complex motion understanding and the alignment of visual…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Seongchan Kim , Woojeong Jin , Sangbeom Lim , Heeji Yoon , Hyunwook Choi , Seungryong Kim

Traditional visual object tracking (VOT) methods typically rely on task-specific supervised training, limiting their generalization to unseen objects and challenging scenarios with distractors, occlusion, and nonlinear motion. Recent vision…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Deyi Zhu , Yuji Wang , Yong Liu , Yansong Tang , Bingyao Yu , Jiwen Lu , Jie Zhou

Segment Anything Model 2 (SAM 2) serves as a core foundation model in the field of video segmentation. Building upon the original SAM model, it introduces a memory bank mechanism and demonstrates outstanding performance in tasks such as…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Zhaoyuan Ding , Yijing Yang , Han Shu , Xinghao Chen

Segment Anything Models (SAMs) like SEEM and SAM have demonstrated great potential in learning to segment anything. The core design of SAMs lies with Promptable Segmentation, which takes a handcrafted prompt as input and returns the…

Computer Vision and Pattern Recognition · Computer Science 2024-01-10 Jiaxing Huang , Kai Jiang , Jingyi Zhang , Han Qiu , Lewei Lu , Shijian Lu , Eric Xing

Surgical video segmentation is a critical task in computer-assisted surgery and is vital for enhancing surgical quality and patient outcomes. Recently, the Segment Anything Model 2 (SAM2) framework has shown superior advancements in image…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Haofeng Liu , Erli Zhang , Junde Wu , Mingxuan Hong , Yueming Jin

Recently segment anything model (SAM) has attracted widespread concerns, and it is often treated as a vision foundation model for universal segmentation. Some researchers have attempted to directly apply the foundation model to the RGB-D…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Jia Lin , Xiaofei Zhou , Jiyuan Liu , Runmin Cong , Guodao Zhang , Zhi Liu , Jiyong Zhang

Few-shot segmentation aims to segment unseen object categories from just a handful of annotated examples. This requires mechanisms that can both identify semantically related objects across images and accurately produce segmentation masks.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Claudia Cuttano , Gabriele Trivigno , Giuseppe Averta , Carlo Masone

Video Object Segmentation (VOS) is foundational to numerous computer vision applications, including surveillance, autonomous driving, robotics and generative video editing. However, existing VOS models often struggle with precise mask…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Elham Soltani Kazemi , Imad Eddine Toubal , Gani Rahmon , Jaired Collins , K. Palaniappan

This work presents Sa2VA, the first comprehensive, unified model for dense grounded understanding of both images and videos. Unlike existing multi-modal large language models, which are often limited to specific modalities and tasks, Sa2VA…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Haobo Yuan , Xiangtai Li , Tao Zhang , Yueyi Sun , Zilong Huang , Shilin Xu , Shunping Ji , Yunhai Tong , Lu Qi , Jiashi Feng , Ming-Hsuan Yang

Segment Anything Models (SAMs), as vision foundation models, have demonstrated remarkable performance across various image analysis tasks. Despite their strong generalization capabilities, SAMs encounter challenges in fine-grained detail…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Haoran Shen , Peixian Zhuang , Jiahao Kou , Yuxin Zeng , Haoying Xu , Jiangyun Li

The Segment Anything Model (SAM) represents a state-of-the-art research advancement in natural image segmentation, achieving impressive results with input prompts such as points and bounding boxes. However, our evaluation and recent…

Computer Vision and Pattern Recognition · Computer Science 2023-08-31 Junlong Cheng , Jin Ye , Zhongying Deng , Jianpin Chen , Tianbin Li , Haoyu Wang , Yanzhou Su , Ziyan Huang , Jilong Chen , Lei Jiang , Hui Sun , Junjun He , Shaoting Zhang , Min Zhu , Yu Qiao

Segment Anything Model (SAM) has recently shown its powerful effectiveness in visual segmentation tasks. However, there is less exploration concerning how SAM works on audio-visual tasks, such as visual sound localization and segmentation.…

Computer Vision and Pattern Recognition · Computer Science 2023-05-04 Shentong Mo , Yapeng Tian