中文
相关论文

相关论文: Track Anything: Segment Anything Meets Videos

200 篇论文

Recently, promptable segmentation models, such as the Segment Anything Model (SAM), have demonstrated robust zero-shot generalization capabilities on static images. These promptable models exhibit denoising abilities for imprecise prompt…

计算机视觉与模式识别 · 计算机科学 2024-03-08 Tao Zhou , Wenhan Luo , Qi Ye , Zhiguo Shi , Jiming Chen

Semantic Segmentation combines two sub-tasks: the identification of pixel-level image masks and the application of semantic labels to those masks. Recently, so-called Foundation Models have been introduced; general models trained on very…

计算机视觉与模式识别 · 计算机科学 2023-10-03 David Balaban , Justin Medich , Pranay Gosar , Justin Hart

Interactive video object segmentation is a crucial video task, having various applications from video editing to data annotating. However, current approaches struggle to accurately segment objects across diverse domains. Recently, Segment…

计算机视觉与模式识别 · 计算机科学 2024-06-11 Xiaoli Wei , Zhaoqing Wang , Yandong Guo , Chunxia Zhang , Tongliang Liu , Mingming Gong

The interactive segmentation task consists in the creation of object segmentation masks based on user interactions. The most common way to guide a model towards producing a correct segmentation consists in clicks on the object and…

计算机视觉与模式识别 · 计算机科学 2024-04-15 Robin Schön , Julian Lorenz , Katja Ludwig , Rainer Lienhart

Video object segmentation (VOS) is a critical task in the development of video perception and understanding. The Segment-Anything Model 2 (SAM 2), released by Meta AI, is the current state-of-the-art architecture for end-to-end VOS. SAM 2…

图像与视频处理 · 电气工程与系统科学 2025-05-14 Clayton Bromley , Alexander Moore , Amar Saini , Doug Poland , Carmen Carrano

With the emergence of the Segment Anything Model (SAM) as a foundational model for image segmentation, its application has been extensively studied across various domains, including the medical field. However, its potential in the context…

计算机视觉与模式识别 · 计算机科学 2023-10-17 SeungKyu Kim , Hyun-Jic Oh , Seonghui Min , Won-Ki Jeong

Recently, Meta AI Research approaches a general, promptable Segment Anything Model (SAM) pre-trained on an unprecedentedly large segmentation dataset (SA-1B). Without a doubt, the emergence of SAM will yield significant benefits for a wide…

计算机视觉与模式识别 · 计算机科学 2024-08-23 Wei Ji , Jingjing Li , Qi Bi , Tingwei Liu , Wenbo Li , Li Cheng

Visual object tracking is a fundamental video task in computer vision. Recently, the notably increasing power of perception algorithms allows the unification of single/multiobject and box/mask-based tracking. Among them, the Segment…

计算机视觉与模式识别 · 计算机科学 2023-07-27 Jiawen Zhu , Zhenyu Chen , Zeqi Hao , Shijie Chang , Lu Zhang , Dong Wang , Huchuan Lu , Bin Luo , Jun-Yan He , Jin-Peng Lan , Hanyuan Chen , Chenyang Li

The Segment Anything Model (SAM) is a deep neural network foundational model designed to perform instance segmentation which has gained significant popularity given its zero-shot segmentation ability. SAM operates by generating masks based…

计算机视觉与模式识别 · 计算机科学 2024-04-19 Yona Falinie A. Gaus , Neelanjan Bhowmik , Brian K. S. Isaac-Medina , Toby P. Breckon

Recent advances in segmentation foundation models have enabled accurate and efficient segmentation across a wide range of natural images and videos, but their utility to medical data remains unclear. In this work, we first present a…

图像与视频处理 · 电气工程与系统科学 2024-08-07 Jun Ma , Sumin Kim , Feifei Li , Mohammed Baharoon , Reza Asakereh , Hongwei Lyu , Bo Wang

Video Object Segmentation and Tracking (VOST) presents a complex yet critical challenge in computer vision, requiring robust integration of segmentation and tracking across temporally dynamic frames. Traditional methods have struggled with…

计算机视觉与模式识别 · 计算机科学 2025-08-05 Guoping Xu , Jayaram K. Udupa , Yajun Yu , Hua-Chieh Shao , Songlin Zhao , Wei Liu , You Zhang

We propose a method to efficiently equip the Segment Anything Model (SAM) with the ability to generate regional captions. SAM presents strong generalizability to segment anything while is short for semantic understanding. By introducing a…

计算机视觉与模式识别 · 计算机科学 2024-03-27 Xiaoke Huang , Jianfeng Wang , Yansong Tang , Zheng Zhang , Han Hu , Jiwen Lu , Lijuan Wang , Zicheng Liu

Meta AI recently released the Segment Anything model (SAM), which has garnered attention due to its impressive performance in class-agnostic segmenting. In this study, we explore the use of SAM for the challenging task of few-shot object…

计算机视觉与模式识别 · 计算机科学 2023-04-24 Zhiheng Ma , Xiaopeng Hong , Qinnan Shangguan

Video Object Segmentation (VOS) task aims to segmenting a particular object instance throughout the entire video sequence given only the object mask of the first frame. Recently, Segment Anything Model 2 (SAM 2) is proposed, which is a…

计算机视觉与模式识别 · 计算机科学 2024-08-27 Feiyu Pan , Hao Fang , Runmin Cong , Wei Zhang , Xiankai Lu

In light of the diminishing returns of traditional methods for enhancing transmission rates, the domain of semantic communication presents promising new frontiers. Focusing on image transmission, this paper explores the application of…

计算机视觉与模式识别 · 计算机科学 2023-06-06 Shehbaz Tariq , Brian Estadimas Arfeto , Chaoning Zhang , Hyundong Shin

Segmented light field images can serve as a powerful representation in many of computer vision tasks exploiting geometry and appearance of objects, such as object pose tracking. In the light field domain, segmentation presents an additional…

计算机视觉与模式识别 · 计算机科学 2024-11-22 Nikolai Goncharov , Donald G. Dansereau

Tracking cells and detecting mitotic events in time-lapse microscopy image sequences is a crucial task in biomedical research. However, it remains highly challenging due to dividing objects, low signal-tonoise ratios, indistinct boundaries,…

计算机视觉与模式识别 · 计算机科学 2025-09-15 Zhu Chen , Mert Edgü , Er Jin , Johannes Stegmaier

We present Perceive Anything Model (PAM), a conceptually straightforward and efficient framework for comprehensive region-level visual understanding in images and videos. Our approach extends the powerful segmentation model SAM 2 by…

计算机视觉与模式识别 · 计算机科学 2025-06-06 Weifeng Lin , Xinyu Wei , Ruichuan An , Tianhe Ren , Tingwei Chen , Renrui Zhang , Ziyu Guo , Wentao Zhang , Lei Zhang , Hongsheng Li

Recently segment anything model (SAM) has attracted widespread concerns, and it is often treated as a vision foundation model for universal segmentation. Some researchers have attempted to directly apply the foundation model to the RGB-D…

计算机视觉与模式识别 · 计算机科学 2025-11-14 Jia Lin , Xiaofei Zhou , Jiyuan Liu , Runmin Cong , Guodao Zhang , Zhi Liu , Jiyong Zhang

In the rapidly advancing field of robotics, the fusion of state-of-the-art visual technologies with mobile robotic arms has emerged as a critical integration. This paper introduces a novel system that combines the Segment Anything model…

机器人学 · 计算机科学 2024-04-30 Shimian Zhang , Qiuhong Lu