English
Related papers

Related papers: Segment Anything Meets Point Tracking

200 papers

Video object segmentation (VOS) is a critical task in the development of video perception and understanding. The Segment-Anything Model 2 (SAM 2), released by Meta AI, is the current state-of-the-art architecture for end-to-end VOS. SAM 2…

Image and Video Processing · Electrical Eng. & Systems 2025-05-14 Clayton Bromley , Alexander Moore , Amar Saini , Doug Poland , Carmen Carrano

The Segment Anything Model (SAM) is the first foundation model for general image segmentation. It has achieved impressive results on various natural image segmentation tasks. However, medical image segmentation (MIS) is more challenging…

Image and Video Processing · Electrical Eng. & Systems 2024-01-18 Yuhao Huang , Xin Yang , Lian Liu , Han Zhou , Ao Chang , Xinrui Zhou , Rusi Chen , Junxuan Yu , Jiongquan Chen , Chaoyu Chen , Sijing Liu , Haozhe Chi , Xindi Hu , Kejuan Yue , Lei Li , Vicente Grau , Deng-Ping Fan , Fajin Dong , Dong Ni

This paper provides insights on the effectiveness of the zero shot, prompt-based Segment Anything Model (SAM) and its updated versions, SAM 2 and SAM 2.1, along with the non-promptable conventional neural network (CNN), for segmenting solar…

Computer Vision and Pattern Recognition · Computer Science 2025-01-06 Osher Rafaeli , Tal Svoray , Roni Blushtein-Livnon , Ariel Nahlieli

Current state-of-the-art Video Object Segmentation (VOS) methods rely on dense per-object mask annotations both during training and testing. This requires time-consuming and costly video annotation mechanisms. We propose a novel Point-VOS…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Idil Esen Zulfikar , Sabarinath Mahadevan , Paul Voigtlaender , Bastian Leibe

Segment Anything Model (SAM) is a foundation model for semantic segmentation and shows excellent generalization capability with the prompts. In this empirical study, we investigate the robustness and zero-shot generalizability of the SAM in…

Image and Video Processing · Electrical Eng. & Systems 2023-05-01 An Wang , Mobarakol Islam , Mengya Xu , Yang Zhang , Hongliang Ren

The recently introduced Segment Anything Model (SAM), a Visual Foundation Model (VFM), has demonstrated impressive capabilities in zero-shot segmentation tasks across diverse natural image datasets. Despite its success, SAM encounters…

Computer Vision and Pattern Recognition · Computer Science 2024-08-23 Chunpeng Zhou , Kangjie Ning , Qianqian Shen , Sheng Zhou , Zhi Yu , Haishuai Wang

With the rapid advancement of autonomous driving, vehicle perception, particularly detection and segmentation, has placed increasingly higher demands on algorithmic performance. Pre-trained large segmentation models, especially Segment…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Xiao Wang , Ziwen Wang , Wentao Wu , Anjie Wang , Jiashu Wu , Yantao Pan , Chenglong Li

Weakly supervised semantic segmentation (WSSS) aims to bypass the need for laborious pixel-level annotation by using only image-level annotation. Most existing methods rely on Class Activation Maps (CAM) to derive pixel-level pseudo-labels…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Tianle Chen , Zheda Mai , Ruiwen Li , Wei-lun Chao

Recently, Meta AI Research approaches a general, promptable Segment Anything Model (SAM) pre-trained on an unprecedentedly large segmentation dataset (SA-1B). Without a doubt, the emergence of SAM will yield significant benefits for a wide…

Computer Vision and Pattern Recognition · Computer Science 2024-08-23 Wei Ji , Jingjing Li , Qi Bi , Tingwei Liu , Wenbo Li , Li Cheng

In this paper, we propose a novel Visual Reference Prompt (VRP) encoder that empowers the Segment Anything Model (SAM) to utilize annotated reference images as prompts for segmentation, creating the VRP-SAM model. In essence, VRP-SAM can…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Yanpeng Sun , Jiahui Chen , Shan Zhang , Xinyu Zhang , Xiaofan Li , Qiang Chen , Gang Zhang , Errui Ding , Jingdong Wang , Zechao Li

The reliance on large labeled datasets presents a significant challenge in medical image segmentation. Few-shot learning offers a potential solution, but existing methods often still require substantial training data. This paper proposes a…

Image and Video Processing · Electrical Eng. & Systems 2025-03-10 Haiyue Zu , Jun Ge , Heting Xiao , Jile Xie , Zhangzhe Zhou , Yifan Meng , Jiayi Ni , Junjie Niu , Linlin Zhang , Li Ni , Huilin Yang

Meta AI Research has recently released SAM (Segment Anything Model) which is trained on a large segmentation dataset of over 1 billion masks. As a foundation model in the field of computer vision, SAM (Segment Anything Model) has gained…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Dongsheng Han , Chaoning Zhang , Yu Qiao , Maryam Qamar , Yuna Jung , SeungKyu Lee , Sung-Ho Bae , Choong Seon Hong

Recent advances in segmentation foundation models have enabled accurate and efficient segmentation across a wide range of natural images and videos, but their utility to medical data remains unclear. In this work, we first present a…

Image and Video Processing · Electrical Eng. & Systems 2024-08-07 Jun Ma , Sumin Kim , Feifei Li , Mohammed Baharoon , Reza Asakereh , Hongwei Lyu , Bo Wang

Visual foundation models have achieved remarkable results in zero-shot image classification and segmentation, but zero-shot change detection remains an open problem. In this paper, we propose the segment any change models (AnyChange), a new…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Zhuo Zheng , Yanfei Zhong , Liangpei Zhang , Stefano Ermon

The success of large language models has inspired the computer vision community to explore image segmentation foundation model that is able to zero/few-shot generalize through prompt engineering. Segment-Anything(SAM), among others, is the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-11 Haojie Zhang , Yongyi Su , Xun Xu , Kui Jia

The Segment-Anything Model (SAM) is a vision foundation model for segmentation with a prompt-driven framework. SAM generates class-agnostic masks based on user-specified instance-referring prompts. However, adapting SAM for automated…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Hussni Mohd Zakir , Eric Tatt Wei Ho

Segmenting and recognizing diverse object parts is crucial in computer vision and robotics. Despite significant progress in object segmentation, part-level segmentation remains underexplored due to complex boundaries and scarce annotated…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Xinjian Wu , Ruisong Zhang , Jie Qin , Shijie Ma , Cheng-Lin Liu

The Segmentation Anything Model 2 (SAM2) has proven to be a powerful foundation model for promptable visual object segmentation in both images and videos, capable of storing object-aware memories and transferring them temporally through…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Syed Hesham Syed Ariff , Yun Liu , Guolei Sun , Jing Yang , Henghui Ding , Xue Geng , Xudong Jiang

The recent advancements in large-scale pre-training techniques have significantly enhanced the capabilities of vision foundation models, notably the Segment Anything Model (SAM), which can generate precise masks based on point and box…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Anqi Zhang , Guangyu Gao , Jianbo Jiao , Chi Harold Liu , Yunchao Wei

Segment Anything Model (SAM) has attracted significant attention due to its impressive zero-shot transfer performance and high versatility for numerous vision applications (like image editing with fine-grained control). Many of such…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Chaoning Zhang , Dongshen Han , Yu Qiao , Jung Uk Kim , Sung-Ho Bae , Seungkyu Lee , Choong Seon Hong