English
Related papers

Related papers: SAM2Long: Enhancing SAM 2 for Long Video Segmentat…

200 papers

Inspired by Segment Anything 2, which generalizes segmentation from images to videos, we propose SAM2MOT--a novel segmentation-driven paradigm for multi-object tracking that breaks away from the conventional detection-association framework.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Junjie Jiang , Zelin Wang , Manqi Zhao , Yin Li , DongSheng Jiang

The advent of large models, also known as foundation models, has significantly transformed the AI research landscape, with models like Segment Anything (SAM) achieving notable success in diverse image segmentation scenarios. Despite its…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Tianrun Chen , Ankang Lu , Lanyun Zhu , Chaotao Ding , Chunan Yu , Deyi Ji , Zejian Li , Lingyun Sun , Papa Mao , Ying Zang

The objective of this paper is motion segmentation -- discovering and segmenting the moving objects in a video. This is a much studied area with numerous careful, and sometimes complex, approaches and training schemes including:…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Junyu Xie , Charig Yang , Weidi Xie , Andrew Zisserman

Brain tumor segmentation presents a formidable challenge in the field of Medical Image Segmentation. While deep-learning models have been useful, human expert segmentation remains the most accurate method. The recently released Segment…

Image and Video Processing · Electrical Eng. & Systems 2023-10-11 Mohammad Peivandi , Jason Zhang , Michael Lu , Dongxiao Zhu , Zhifeng Kou

Segment Anything Model (SAM) has demonstrated powerful zero-shot segmentation performance in natural scenes. The recently released Segment Anything Model 2 (SAM2) has further heightened researchers' expectations towards image segmentation…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Jialun Pei , Zhangjun Zhou , Tiantian Zhang

We study the problem of segmenting moving objects in unconstrained videos. Given a video, the task is to segment all the objects that exhibit independent motion in at least one frame. We formulate this as a learning problem and design our…

Computer Vision and Pattern Recognition · Computer Science 2017-12-05 Pavel Tokmakov , Cordelia Schmid , Karteek Alahari

Referring video object segmentation (RVOS) aims to segment objects in a video according to textual descriptions, which requires the integration of multimodal information and temporal dynamics perception. The Segment Anything Model 2 (SAM 2)…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Fu Rong , Meng Lan , Qian Zhang , Lefei Zhang

As large-scale foundation models trained on billions of image--mask pairs covering a vast diversity of scenes, objects, and contexts, SAM and its upgraded version, SAM~2, have significantly influenced multiple fields within computer vision.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Xiaoqi Zhao , Youwei Pang , Shijie Chang , Yuan Zhao , Lihe Zhang , Chenyang Yu , Hanqi Liu , Jiaming Zuo , Jinsong Ouyang , Weisi Lin , Georges El Fakhri , Huchuan Lu , Xiaofeng Liu

Image segmentation plays an important role in vision understanding. Recently, the emerging vision foundation models continuously achieved superior performance on various tasks. Following such success, in this paper, we prove that the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Xinyu Xiong , Zihuang Wu , Shuangyi Tan , Wenxue Li , Feilong Tang , Ying Chen , Siying Li , Jie Ma , Guanbin Li

The ability to segment objects based on open-ended language prompts remains a critical challenge, requiring models to ground textual semantics into precise spatial masks while handling diverse and unseen categories. We present OpenWorldSAM,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Shiting Xiao , Rishabh Kabra , Yuhang Li , Donghyun Lee , Joao Carreira , Priyadarshini Panda

Referring video object segmentation (RVOS) requires segmenting and tracking objects in videos conditioned on natural-language expressions, demanding fine-grained understanding of both appearance and motion. Building on Sa2VA, which couples…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Quanzhu Niu , Dengxian Gong , Shihao Chen , Tao Zhang , Yikang Zhou , Haobo Yuan , Lu Qi , Xiangtai Li , Shunping Ji

Amodal segmentation is a challenging task that aims to predict the complete geometric shape of objects, including their occluded regions. Although existing methods primarily focus on amodal segmentation within the training domain, these…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Bo Zhang , Zhuotao Tian , Xin Tao , Songlin Tang , Jun Yu , Wenjie Pei

The Segment Anything Model 2 (SAM2) is a powerful foundation model for promptable segmentation. However, its high computational and memory costs are a major barrier to deployment on resource-constrained devices. In this paper, we present…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Nicola Farronato , Florian Scheidegger , Mattia Rigotti , Cristiano Malossi , Michele Magno , Haotong Qin

This paper investigates the fundamental discontinuity between the latest two Segment Anything Models: SAM2 and SAM3. We explain why the expertise in prompt-based segmentation of SAM2 does not transfer to the multimodal concept-driven…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Ranjan Sapkota , Konstantinos I. Roumeliotis , Manoj Karkee

Large-scale delineation of individual trees from remote sensing imagery is crucial to the advancement of ecological research, particularly as climate change and other environmental factors rapidly transform forest landscapes across the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Michelle Chen , David Russell , Amritha Pallavoor , Derek Young , Jane Wu

Large-scale Video Object Segmentation (LSVOS) addresses the challenge of accurately tracking and segmenting objects in long video sequences, where difficulties stem from object reappearance, small-scale targets, heavy occlusions, and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Yujie Xie , Hongyang Zhang , Zhihui Liu , Shihai Ruan

Foundation models for image segmentation have shown strong generalization in natural images, yet their applicability to 3D medical imaging remains limited. In this work, we study the zero-shot use of Segment Anything Model 2 (SAM2) for…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Miquel Lopez Escoriza , Pau Amargant Alvarez

The performance of image segmentation models has historically been constrained by the high cost of collecting large-scale annotated data. The Segment Anything Model (SAM) alleviates this original problem through a promptable,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Miguel Espinosa , Chenhongyi Yang , Linus Ericsson , Steven McDonagh , Elliot J. Crowley

The Segment Anything Model (SAM) family has become a widely adopted vision foundation model, but its ability to control segmentation granularity remains limited. Users often need to refine results manually - by adding more prompts or…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Junwei Yu , Trevor Darrell , XuDong Wang

On top of Segment Anything Model (SAM), SAM 2 further extends its capability from image to video inputs through a memory bank mechanism and obtains a remarkable performance compared with previous methods, making it a foundation model for…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Chong Zhou , Chenchen Zhu , Yunyang Xiong , Saksham Suri , Fanyi Xiao , Lemeng Wu , Raghuraman Krishnamoorthi , Bo Dai , Chen Change Loy , Vikas Chandra , Bilge Soran