English
Related papers

Related papers: AuralSAM2: Enabling SAM2 Hear Through Pyramid Audi…

200 papers

Promptable video object segmentation and tracking (VOST) has seen significant advances with the emergence of foundation models like Segment Anything Model 2 (SAM2); however, their application in surgical video analysis remains challenging…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Guoping Xu , Hua-Chieh Shao , You Zhang

The Segment Anything Model (SAM) has demonstrated impressive performance in zero-shot promptable segmentation on natural images. The recently released Segment Anything Model 2 (SAM 2) claims to outperform SAM on images and extends the…

Image and Video Processing · Electrical Eng. & Systems 2025-04-16 Sourya Sengupta , Satrajit Chakrabarty , Ravi Soni

The Segmentation Anything Model 2 (SAM2) has proven to be a powerful foundation model for promptable visual object segmentation in both images and videos, capable of storing object-aware memories and transferring them temporally through…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Syed Hesham Syed Ariff , Yun Liu , Guolei Sun , Jing Yang , Henghui Ding , Xue Geng , Xudong Jiang

Multimodal Large Language Models (MLLMs) have demonstrated strong image-level visual understanding and reasoning, yet their pixel-level perception across both images and videos remains limited. Foundation segmentation models such as the SAM…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Hao Wang , Limeng Qiao , Chi Zhang , Lin Ma , Guanglu Wan , Xiangyuan Lan , Xiaodan Liang

Segment Anything Model 2 (SAM2) demonstrated impressive zero-shot capabilities on natural images but faces challenges in biomedical segmentation due to significant domain shifts and prompt dependency. To address these limitations, we…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Hinako Mitsuoka , Kazuhiro Hotta

The recent Segment Anything Model (SAM) 2 has demonstrated remarkable foundational competence in semantic segmentation, with its memory mechanism and mask decoder further addressing challenges in video tracking and object occlusion, thereby…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Jieming Yu , An Wang , Wenzhen Dong , Mengya Xu , Mobarakol Islam , Jie Wang , Long Bai , Hongliang Ren

Segment Anything Model (SAM), a prompt-driven foundation model for natural image segmentation, has demonstrated impressive zero-shot performance. However, SAM does not work when directly applied to medical image segmentation, since SAM…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Bin Xie , Hao Tang , Bin Duan , Dawen Cai , Yan Yan , Gady Agam

Medical image segmentation is a crucial and time-consuming task in clinical care, where mask precision is extremely important. The Segment Anything Model (SAM) offers a promising approach, as it provides an interactive interface based on…

Computer Vision and Pattern Recognition · Computer Science 2025-04-30 Julien Khlaut , Elodie Ferreres , Daniel Tordjman , Hélène Philippe , Tom Boeken , Pierre Manceron , Corentin Dancette

The Segment Anything Model 2 (SAM2) has recently demonstrated exceptional performance in zero-shot prompt segmentation for natural images and videos. However, when the propagation mechanism of SAM2 is applied to medical images, it often…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Yunhao Bai , Boxiang Yun , Zeli Chen , Qinji Yu , Yingda Xia , Yan Wang

The goal of Audio-Visual Segmentation (AVS) is to localize and segment the sounding source objects from video frames. Research on AVS suffers from data scarcity due to the high cost of fine-grained manual annotations. Recent works attempt…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Kyungbok Lee , You Zhang , Zhiyao Duan

Segment Anything Model (SAM) has gained significant attention because of its ability to segment various objects in images given a prompt. The recently developed SAM 2 has extended this ability to video inputs. This opens an opportunity to…

Computer Vision and Pattern Recognition · Computer Science 2024-08-23 Haoyu Dong , Hanxue Gu , Yaqian Chen , Jichen Yang , Yuwen Chen , Maciej A. Mazurowski

Promptable foundation models such as the Segment Anything Model (SAM) produce high-quality masks but remain semantically blind, relying on external prompts to specify categories. Existing vision-language approaches address this limitation…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Shayan Jalilian , Abdul Bais

Segment Anything Model 2 (SAM 2), a prompt-driven foundation model extending SAM to both image and video domains, has shown superior zero-shot performance compared to its predecessor. Building on SAM's success in medical image segmentation,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-06 Bin Xie , Hao Tang , Yan Yan , Gady Agam

Referring video object segmentation (RVOS) aims to segment objects in a video according to textual descriptions, which requires the integration of multimodal information and temporal dynamics perception. The Segment Anything Model 2 (SAM 2)…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Fu Rong , Meng Lan , Qian Zhang , Lefei Zhang

Deep learning-based medical image segmentation models often suffer from domain shift, where the models trained on a source domain do not generalize well to other unseen domains. As a prompt-driven foundation model with powerful…

Image and Video Processing · Electrical Eng. & Systems 2024-07-10 Yifan Gao , Wei Xia , Dingdu Hu , Wenkui Wang , Xin Gao

Foundation models such as the recently introduced Segment Anything Model (SAM) have achieved remarkable results in image segmentation tasks. However, these models typically require user interaction through handcrafted prompts such as…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Mélanie Gaillochet , Christian Desrosiers , Hervé Lombaert

The Segment Anything model (SAM) has shown a generalized ability to group image pixels into patches, but applying it to semantic-aware segmentation still faces major challenges. This paper presents SAM-CP, a simple approach that establishes…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Pengfei Chen , Lingxi Xie , Xinyue Huo , Xuehui Yu , Xiaopeng Zhang , Yingfei Sun , Zhenjun Han , Qi Tian

Semantic segmentation is a core task in computer vision. Existing methods are generally divided into two categories: automatic and interactive. Interactive approaches, exemplified by the Segment Anything Model (SAM), have shown promise as…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Yimu Pan , Sitao Zhang , Alison D. Gernand , Jeffery A. Goldstein , James Z. Wang

360 video object segmentation (360VOS) aims to predict temporally-consistent masks in 360 videos, offering full-scene coverage, benefiting applications, such as VR/AR and embodied AI. Learning 360VOS model is nontrivial due to the lack of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Dingwen Xiao , Weiming Zhang , Shiqi Wen , Lin Wang

The Segment Anything Model (SAM) family has become a widely adopted vision foundation model, but its ability to control segmentation granularity remains limited. Users often need to refine results manually - by adding more prompts or…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Junwei Yu , Trevor Darrell , XuDong Wang